-- Logs begin at Wed 2022-06-01 03:05:43 UTC, end at Wed 2022-06-01 04:48:22 UTC. -- Jun 01 04:11:58.197614 dv-cinder-667108-37-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 01 04:11:58.206664 dv-cinder-667108-37-smb devstack@keystone.service[80220]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 01 04:11:58.208671 dv-cinder-667108-37-smb devstack@keystone.service[80220]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 1 04:11:58 2022] *** Jun 01 04:11:58.208671 dv-cinder-667108-37-smb devstack@keystone.service[80220]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 01 04:11:58.208671 dv-cinder-667108-37-smb devstack@keystone.service[80220]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 01 04:11:58.208671 dv-cinder-667108-37-smb devstack@keystone.service[80220]: nodename: dv-cinder-667108-37-smb Jun 01 04:11:58.208671 dv-cinder-667108-37-smb devstack@keystone.service[80220]: machine: x86_64 Jun 01 04:11:58.208671 dv-cinder-667108-37-smb devstack@keystone.service[80220]: clock source: unix Jun 01 04:11:58.208671 dv-cinder-667108-37-smb devstack@keystone.service[80220]: pcre jit disabled Jun 01 04:11:58.208671 dv-cinder-667108-37-smb devstack@keystone.service[80220]: detected number of CPU cores: 4 Jun 01 04:11:58.208671 dv-cinder-667108-37-smb devstack@keystone.service[80220]: current working directory: / Jun 01 04:11:58.208671 dv-cinder-667108-37-smb devstack@keystone.service[80220]: detected binary path: /usr/bin/uwsgi-core Jun 01 04:11:58.208671 dv-cinder-667108-37-smb devstack@keystone.service[80220]: your processes number limit is 47680 Jun 01 04:11:58.208671 dv-cinder-667108-37-smb devstack@keystone.service[80220]: your memory page size is 4096 bytes Jun 01 04:11:58.208671 dv-cinder-667108-37-smb devstack@keystone.service[80220]: detected max file descriptor number: 2048 Jun 01 04:11:58.209509 dv-cinder-667108-37-smb devstack@keystone.service[80220]: lock engine: pthread robust mutexes Jun 01 04:11:58.209509 dv-cinder-667108-37-smb devstack@keystone.service[80220]: thunder lock: enabled Jun 01 04:11:58.209509 dv-cinder-667108-37-smb devstack@keystone.service[80220]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 01 04:11:58.209509 dv-cinder-667108-37-smb devstack@keystone.service[80220]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 01 04:11:58.253796 dv-cinder-667108-37-smb devstack@keystone.service[80220]: Python main interpreter initialized at 0x5595262a99c0 Jun 01 04:11:58.253796 dv-cinder-667108-37-smb devstack@keystone.service[80220]: python threads support enabled Jun 01 04:11:58.253796 dv-cinder-667108-37-smb devstack@keystone.service[80220]: your server socket listen backlog is limited to 100 connections Jun 01 04:11:58.253796 dv-cinder-667108-37-smb devstack@keystone.service[80220]: your mercy for graceful operations on workers is 90 seconds Jun 01 04:11:58.254292 dv-cinder-667108-37-smb devstack@keystone.service[80220]: mapped 403077 bytes (393 KB) for 2 cores Jun 01 04:11:58.254292 dv-cinder-667108-37-smb devstack@keystone.service[80220]: *** Operational MODE: preforking *** Jun 01 04:11:58.254530 dv-cinder-667108-37-smb devstack@keystone.service[80220]: *** uWSGI is running in multiple interpreter mode *** Jun 01 04:11:58.254530 dv-cinder-667108-37-smb devstack@keystone.service[80220]: spawned uWSGI master process (pid: 80220) Jun 01 04:11:58.254745 dv-cinder-667108-37-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 01 04:11:58.258003 dv-cinder-667108-37-smb devstack@keystone.service[80220]: spawned uWSGI worker 1 (pid: 80231, cores: 1) Jun 01 04:11:58.258003 dv-cinder-667108-37-smb devstack@keystone.service[80220]: spawned uWSGI worker 2 (pid: 80232, cores: 1) Jun 01 04:11:58.258003 dv-cinder-667108-37-smb devstack@keystone.service[80220]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 01 04:12:03.937819 dv-cinder-667108-37-smb devstack@keystone.service[80231]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 01 04:12:03.937819 dv-cinder-667108-37-smb devstack@keystone.service[80231]: from cryptography.utils import int_from_bytes Jun 01 04:12:03.938684 dv-cinder-667108-37-smb devstack@keystone.service[80232]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 01 04:12:03.938684 dv-cinder-667108-37-smb devstack@keystone.service[80232]: from cryptography.utils import int_from_bytes Jun 01 04:12:03.939148 dv-cinder-667108-37-smb devstack@keystone.service[80231]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 01 04:12:03.939148 dv-cinder-667108-37-smb devstack@keystone.service[80231]: from cryptography.utils import int_from_bytes Jun 01 04:12:03.939291 dv-cinder-667108-37-smb devstack@keystone.service[80232]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 01 04:12:03.939291 dv-cinder-667108-37-smb devstack@keystone.service[80232]: from cryptography.utils import int_from_bytes Jun 01 04:12:03.987859 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 01 04:12:03.988038 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 01 04:12:03.988216 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 01 04:12:03.988326 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] command line args: [] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 01 04:12:03.988413 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 01 04:12:03.988487 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 01 04:12:03.988593 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] command line args: [] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 01 04:12:03.988679 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ================================================================================ {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 01 04:12:03.988865 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 01 04:12:03.988945 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] admin_token = **** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.989048 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ================================================================================ {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 01 04:12:03.989135 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] config_dir = [] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.989278 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.989375 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] admin_token = **** {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.989455 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] config_source = [] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.989527 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] config_dir = [] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.989608 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] debug = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.989714 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.989842 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.990088 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] config_source = [] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.990088 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] debug = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.990225 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.990293 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.990383 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.990593 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.990686 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.990756 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.990816 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.990977 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.991058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] list_limit = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.991185 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.991275 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] log_config_append = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.991414 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.991502 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] list_limit = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.991564 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] log_dir = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.991622 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] log_config_append = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.991765 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] log_file = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.991856 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.991919 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] log_dir = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.991981 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.992081 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] log_file = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.992210 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.992309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.992428 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.992560 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.992651 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.992799 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.992893 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.992973 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.993053 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.993206 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.993334 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.993418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.993536 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.993620 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.993694 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.993846 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.993936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.994158 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.994727 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.994895 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.994978 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.995132 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.995213 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.995366 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.995454 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.995616 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.995696 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.995862 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.996103 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.32/identity {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.996182 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.996284 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] publish_errors = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.996529 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.996614 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.32/identity {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.996732 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.996855 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] publish_errors = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.996930 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.997045 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.997120 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.997221 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.997355 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.997508 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.997631 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] standard_threads = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.997706 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.997802 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.997890 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.998069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.998153 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] standard_threads = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.998246 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.998332 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.998426 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] use_journal = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.998555 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.998635 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] use_json = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.998759 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.998836 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] use_stderr = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.998912 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] use_journal = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.998991 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] use_syslog = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.999063 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] use_json = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.999132 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.999223 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] use_stderr = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.999357 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:03.999435 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] use_syslog = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.999593 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:03.999679 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 04:12:03.999851 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:03.999929 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.000086 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.000170 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.000333 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.000418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.000568 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.000691 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.000813 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.000897 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.001041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.001115 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.001280 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.001365 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.001522 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.001599 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.001768 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.001846 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.002020 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.002113 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.002270 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.002355 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.002505 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.002583 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.002747 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.002824 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.002980 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.003069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.003216 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.003295 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.003463 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.003547 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.003702 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.003787 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.003942 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.004020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.004176 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.004254 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.004428 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.004507 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.004661 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.004740 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.004916 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.004994 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.005165 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.005242 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.005394 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.005480 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.005624 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.005707 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.005852 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.005931 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.006091 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.006168 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.006343 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.006422 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.006576 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.006729 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.006805 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.006879 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.007017 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.007102 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.007261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.007348 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.007492 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.007571 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.007729 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.007807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.007974 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.008060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.008203 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.008279 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.008438 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.008516 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.008669 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.008757 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.008896 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.008973 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.009124 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.009202 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.009352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.009438 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.009579 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.009656 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.009834 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.009911 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.010090 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.010184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.010325 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.010408 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.010562 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.010639 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.010791 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.010880 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.011164 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.011290 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.011389 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.011495 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.011591 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.011695 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.011695 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.011921 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.012039 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.012120 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.012238 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.012323 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.012396 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.012512 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.012587 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.012660 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.012818 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.012912 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.013046 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.013169 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.013292 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.013377 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.013522 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.013609 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.013759 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.013839 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.014021 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.014120 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.014248 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.014326 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.014481 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.014560 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.014706 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.014786 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.014947 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.015029 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.015181 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.015312 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.015417 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.015496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.015654 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.015745 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.015903 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.015990 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.016148 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.016227 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.016382 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.016464 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.016616 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.016724 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.016849 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.016928 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.017082 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.017162 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.017317 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.017396 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.017550 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.017629 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.017787 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.017865 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.018042 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.018121 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.018276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.018355 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.018510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.018589 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.018743 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.018825 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.018977 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.019056 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.019215 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.019294 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.019451 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.019532 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.019686 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.019764 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.019923 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.020003 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.020165 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.020245 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.020398 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.020484 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.020632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.020712 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.020865 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.020954 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.021094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.021175 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.021323 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.021402 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.021550 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.021630 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.021780 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.021859 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.022026 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.022110 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.022264 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.022342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.022494 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.022580 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.022732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.022810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.022965 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.023043 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.023211 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.023291 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.023450 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.023528 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.023688 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.023773 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.023917 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] auth.external = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.024002 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.024144 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.024223 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.024403 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] auth.external = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.024489 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.024636 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.024743 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.024873 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] auth.password = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.024953 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.025100 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] auth.token = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.025179 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.025359 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.025450 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] auth.password = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.025596 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.025676 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] auth.token = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.025841 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.025920 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.026093 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.026186 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.026342 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.026421 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.026576 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.026661 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.026801 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.026889 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.027036 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] credential.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.027116 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.027280 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.027359 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.027517 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] credential.caching = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.027605 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.027760 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.027839 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.027997 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.028075 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.028238 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.028325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.028472 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.028552 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.028713 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.028792 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.028950 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.029037 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.029183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.029262 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.029434 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.029517 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.029684 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.029772 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.029938 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.030037 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.030223 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.030303 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.030464 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.030555 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.030717 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.030805 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.030951 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] federation.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.031031 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.031184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.031272 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.031429 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.031509 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] federation.caching = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.031673 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.031752 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.031903 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.032095 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.032171 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.032235 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.032374 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.032463 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.032619 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.032711 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.032854 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.032934 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.033107 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.033187 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.033342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.033439 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.033588 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.033668 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.033822 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.033902 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.034092 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.034187 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.034333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] identity.caching = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.034413 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.034565 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.034645 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.034806 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.034895 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.035045 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.035125 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.035274 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.035353 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.035509 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.035590 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.035742 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.035824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.035984 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.036063 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.036213 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.036293 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.036444 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.036529 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.036674 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.036754 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.036917 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.036999 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.037149 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.037227 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.037396 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.037476 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.037647 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.037728 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.037890 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.038000 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.038170 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.038251 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.038415 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.038502 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.038652 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.038731 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.038884 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.038970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.039119 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.039200 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.039350 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.039429 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.039822 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.039912 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.039996 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.040070 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.040142 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.040214 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.040285 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.040356 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.040494 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.040574 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.040738 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.040826 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.041500 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.041586 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.041738 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.041818 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.041997 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.042081 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.042242 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.042321 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.042469 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.042550 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.042706 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.042787 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.042933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.043013 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.043169 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.043251 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.043398 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.043477 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.043634 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.043713 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.043869 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.043949 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.044103 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.044183 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.044338 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.044417 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.044579 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.044661 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.044807 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.044887 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.045035 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.045114 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.045286 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.045367 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.045518 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.045598 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.045752 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.045837 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.045996 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.046080 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.046240 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.046321 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.046470 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.046550 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.046705 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.046785 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.046939 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.user = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.047078 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.047180 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.047312 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.047557 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.047639 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.047794 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.047874 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.048037 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.048124 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.048273 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.048353 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.048504 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.048584 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.048740 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.048829 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.048968 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.049048 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.049201 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.049287 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.049431 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.049520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.049667 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.049747 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.049899 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.049997 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.050173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.050265 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.050419 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.050499 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.050665 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.050745 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.050894 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.050984 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.051137 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.051218 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.051367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.051445 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.051599 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.051686 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.051834 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.051915 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.052069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.052148 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.052304 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.052391 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.052542 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.052623 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.052775 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.052855 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.053026 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.053113 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.053254 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.053333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.053497 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.053577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.053732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.053829 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.053964 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.054097 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.054218 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.054298 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.054451 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.054543 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.054691 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.054772 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.054918 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.054998 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.055153 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.055308 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.055385 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.055456 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] resource.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.055618 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.055698 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.055860 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] resource.caching = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.055949 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.056094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.056173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.056341 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.056421 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.056616 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.057234 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.057395 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.057477 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.057650 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.057730 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.057887 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.057993 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.058158 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.058239 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.058395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] role.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.058475 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.058632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.058721 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] role.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.058860 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.058939 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] role.caching = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.059107 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] role.driver = sql {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.059186 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.059340 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.059429 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.059586 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.059665 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.059831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.059911 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.060076 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.060164 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.060321 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.060401 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.060564 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.060644 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.060811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.060892 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.061041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.061121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.061288 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.061367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.061520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.061599 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.061767 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.061846 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.062034 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.062120 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.062286 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.062430 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.062536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.062666 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.062915 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.062995 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.063161 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.063242 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.063407 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.063486 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.063654 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.063737 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.063886 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.063967 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.064137 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.064280 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.064378 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.064466 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.064613 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.064694 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.064844 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.064924 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.065073 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.065154 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.065307 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.065390 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.065547 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.065627 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.065782 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.065871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.066056 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.066138 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.066294 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.066374 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.066528 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.066630 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.066759 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.066839 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.066992 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] token.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.067072 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.067221 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.067309 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.067458 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] token.caching = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.067539 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.067691 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.067770 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.067938 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.068025 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.068177 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.068258 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.068410 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.068489 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.068904 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.068998 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.069146 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.069226 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.069389 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.069469 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.069623 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.069710 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.069859 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.069939 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.070114 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.070197 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.070352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.070444 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.070589 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.070670 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.070816 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.070895 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.071054 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.071142 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.071293 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.071373 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.071538 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.071618 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.connection = **** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.071830 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.071919 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.072073 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.072161 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.connection = **** {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.072355 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.072446 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.072598 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.072679 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.072833 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.072913 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.073067 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.073148 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.073301 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.073380 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.073532 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.073612 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.073766 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.073847 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.074017 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.074099 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.074263 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.074343 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.074498 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.074580 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.074740 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.074819 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.074974 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.075053 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.075221 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.075304 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.075455 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.075534 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.075694 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.075773 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.075924 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.076004 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.076077 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 01 04:12:04.076149 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.076387 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 04:12:04.076557 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 01 04:12:04.105435 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.105656 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.105881 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.105967 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.106212 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.106442 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.114476 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.114945 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.143039 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.143263 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.143445 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.143678 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.198060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.198526 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.247544 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.247772 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.248503 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.248741 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.314154 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.314322 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.314414 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.314480 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.314591 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.314702 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.314810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.314927 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.315011 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.315147 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.315229 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.315364 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.338776 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.339000 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.339132 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.339216 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.339367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.339455 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.339595 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.339680 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.339805 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.339886 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.340012 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.340103 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.340219 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.340429 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.351210 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.351532 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.364333 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.364575 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.364699 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.364800 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.364876 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.364977 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.365077 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.365187 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.365270 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.365395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.365477 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.365604 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.365688 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.365820 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 04:12:04.382697 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.382808 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.382900 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 01 04:12:04.382985 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 01 04:12:04.383226 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.383310 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.383422 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 01 04:12:04.383543 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 01 04:12:04.383701 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.383820 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.383943 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.384026 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.384196 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.384287 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.384448 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.384530 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.395399 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.395496 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.395670 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.395767 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.395933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.396016 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.396211 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.396293 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.404869 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 04:12:04.404968 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 04:12:04.408217 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 04:12:04.408311 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 04:12:04.408492 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.408587 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.408766 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.408848 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.409041 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.409123 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.409314 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.409404 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.409678 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.409761 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.409947 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.410044 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.410244 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.410329 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.410506 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.410590 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.410774 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.410864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.411033 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.411113 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.438083 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.438253 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.439790 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 04:12:04.439978 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 04:12:04.440062 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.440254 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.445597 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 04:12:04.445819 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 04:12:04.445917 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.446125 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.446208 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.446402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.453490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 04:12:04.453728 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.453811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 04:12:04.454051 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.458252 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 04:12:04.458575 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 04:12:04.458657 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.458918 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.458999 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.459200 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.459281 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.459476 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.459567 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.459750 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.459832 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.460019 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.460099 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.460282 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.460364 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.460544 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.480171 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.480298 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.480447 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.480551 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.485128 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 04:12:04.485216 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 04:12:04.488814 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.488903 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.489104 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.489186 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.494090 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 04:12:04.494177 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 04:12:04.497664 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 04:12:04.497766 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 04:12:04.502839 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.502967 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.503143 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.503264 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.503431 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.503545 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.503695 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.503826 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.503968 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.504104 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.504241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.504379 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.523299 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 04:12:04.523503 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 04:12:04.523597 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.523785 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.523865 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.524049 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.524161 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.524327 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.532572 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.532877 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.534325 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.534599 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.534680 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.534894 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.537630 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 04:12:04.537906 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.538008 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 04:12:04.538216 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.538297 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.538492 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.538574 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.538766 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.538846 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.539051 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.552822 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 04:12:04.553049 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 04:12:04.553134 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.553331 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.553420 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.553609 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.553690 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.553885 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.553967 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.554185 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.554268 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.554450 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.554531 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.554719 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.573345 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 04:12:04.573663 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 04:12:04.576968 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 04:12:04.577053 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 04:12:04.580332 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.580692 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.581924 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.582328 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.583589 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 04:12:04.583867 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.583948 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 04:12:04.584146 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.584229 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.584494 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.592244 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.592507 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.593862 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 04:12:04.594162 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 04:12:04.597118 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.597371 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.597502 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.597640 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.597734 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.597920 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.598019 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.598218 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.607154 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 04:12:04.607435 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.607811 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.607900 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 04:12:04.608130 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.608512 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.616086 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 04:12:04.616362 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.616640 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.616909 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.617175 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.617456 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.617732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.618026 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.618304 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.618567 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.618833 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.619165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.619441 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.619699 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.620206 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 04:12:04.620493 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.620769 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.621039 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.621306 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.621583 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.621861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.622164 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.622434 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.622705 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.622972 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.623235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.623512 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.623776 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 04:12:04.658725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5595262a99c0 pid: 80232 (default app) Jun 01 04:12:04.662057 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bfdb6-5f70-48b3-8887-645421647cf9 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:04.662351 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bfdb6-5f70-48b3-8887-645421647cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:04.662627 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bfdb6-5f70-48b3-8887-645421647cf9 None None] PATH_INFO: `/v3` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:04.662842 dv-cinder-667108-37-smb devstack@keystone.service[80231]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5595262a99c0 pid: 80231 (default app) Jun 01 04:12:04.666902 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1/1] 10.222.0.32 () {50 vars in 791 bytes} [Wed Jun 1 04:12:04 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:12.630844 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617d2c1-7f43-48c5-8c71-09b5b0c9d24e None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:12.631417 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617d2c1-7f43-48c5-8c71-09b5b0c9d24e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:12.631417 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617d2c1-7f43-48c5-8c71-09b5b0c9d24e None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:12.635775 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1/2] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:12:12.641129 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c7e0e-bd71-43e6-854b-38d4542d03de None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:12.641504 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c7e0e-bd71-43e6-854b-38d4542d03de None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:12.641728 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c7e0e-bd71-43e6-854b-38d4542d03de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:12.717194 dv-cinder-667108-37-smb devstack@keystone.service[80232]: INFO dbcounter [None req-0c1c7e0e-bd71-43e6-854b-38d4542d03de None None] Registered counter for database keystone Jun 01 04:12:12.738580 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG oslo_db.sqlalchemy.engines [None req-0c1c7e0e-bd71-43e6-854b-38d4542d03de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80232) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 01 04:12:12.744630 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writer thread running {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 01 04:12:13.027417 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG passlib.handlers.bcrypt [None req-0c1c7e0e-bd71-43e6-854b-38d4542d03de None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80232) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 01 04:12:13.027832 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG passlib.handlers.bcrypt [None req-0c1c7e0e-bd71-43e6-854b-38d4542d03de None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80232) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 01 04:12:13.083251 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-0c1c7e0e-bd71-43e6-854b-38d4542d03de None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:13.084838 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-0c1c7e0e-bd71-43e6-854b-38d4542d03de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:13.209148 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 2/3] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 569 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 01 04:12:13.374928 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617d2c1-7f43-48c5-8c71-09b5b0c9d24e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:13.445717 dv-cinder-667108-37-smb devstack@keystone.service[80231]: INFO dbcounter [None req-4617d2c1-7f43-48c5-8c71-09b5b0c9d24e None None] Registered counter for database keystone Jun 01 04:12:13.465714 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG oslo_db.sqlalchemy.engines [None req-4617d2c1-7f43-48c5-8c71-09b5b0c9d24e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80231) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 01 04:12:13.471912 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writer thread running {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 01 04:12:13.699499 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617d2c1-7f43-48c5-8c71-09b5b0c9d24e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:13.703679 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb03084-1633-482c-9fea-f45003f96e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:13.704335 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb03084-1633-482c-9fea-f45003f96e5b admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:13.704621 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb03084-1633-482c-9fea-f45003f96e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:13.704901 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb03084-1633-482c-9fea-f45003f96e5b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:13.712959 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb03084-1633-482c-9fea-f45003f96e5b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:13.765116 dv-cinder-667108-37-smb devstack@keystone.service[80231]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5cb03084-1633-482c-9fea-f45003f96e5b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 01 04:12:13.765459 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb03084-1633-482c-9fea-f45003f96e5b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:13.774849 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 2/4] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Jun 1 04:12:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 01 04:12:13.780856 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c7e0e-bd71-43e6-854b-38d4542d03de None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:13.795575 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c7e0e-bd71-43e6-854b-38d4542d03de None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:13.800009 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272d663-feca-4665-933f-e0257080cde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:13.801120 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272d663-feca-4665-933f-e0257080cde0 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:13.801408 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272d663-feca-4665-933f-e0257080cde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:13.801686 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272d663-feca-4665-933f-e0257080cde0 admin admin] PATH_INFO: `/v3/projects/7aa99b52f0384814a1f8896bb995a2b2` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:13.803216 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272d663-feca-4665-933f-e0257080cde0 admin admin] RBAC: Authorizing `identity:get_project(project_id=7aa99b52f0384814a1f8896bb995a2b2)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:13.855475 dv-cinder-667108-37-smb devstack@keystone.service[80232]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1272d663-feca-4665-933f-e0257080cde0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 01 04:12:13.855823 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272d663-feca-4665-933f-e0257080cde0 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:13.860460 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 3/5] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Jun 1 04:12:13 2022] GET /identity/v3/projects/7aa99b52f0384814a1f8896bb995a2b2 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:16.045186 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8866a7-c256-413e-8956-75e4e349ec37 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:16.045728 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8866a7-c256-413e-8956-75e4e349ec37 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:16.045728 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8866a7-c256-413e-8956-75e4e349ec37 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:16.049902 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 3/6] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:12:16.055251 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5938e9-1137-4e66-bbfd-e7972edeea71 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:16.055663 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5938e9-1137-4e66-bbfd-e7972edeea71 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:16.055814 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5938e9-1137-4e66-bbfd-e7972edeea71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:16.075273 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-fa5938e9-1137-4e66-bbfd-e7972edeea71 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:16.076781 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-fa5938e9-1137-4e66-bbfd-e7972edeea71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:16.084573 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 4/7] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 01 04:12:16.107027 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8866a7-c256-413e-8956-75e4e349ec37 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:16.119827 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8866a7-c256-413e-8956-75e4e349ec37 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:16.124113 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a600b-ccbc-4b73-be8d-fd5be9be6dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:16.124745 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a600b-ccbc-4b73-be8d-fd5be9be6dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:16.125035 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a600b-ccbc-4b73-be8d-fd5be9be6dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:16.125314 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a600b-ccbc-4b73-be8d-fd5be9be6dc0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:16.132958 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a600b-ccbc-4b73-be8d-fd5be9be6dc0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:16.134786 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a600b-ccbc-4b73-be8d-fd5be9be6dc0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:16.143490 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 4/8] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Jun 1 04:12:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 01 04:12:16.149029 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5938e9-1137-4e66-bbfd-e7972edeea71 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:16.158162 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5938e9-1137-4e66-bbfd-e7972edeea71 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:16.162487 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd1234-a2f6-4cc4-a2b8-cfcfd50bc4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:16.163352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd1234-a2f6-4cc4-a2b8-cfcfd50bc4fb admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:16.163637 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd1234-a2f6-4cc4-a2b8-cfcfd50bc4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:16.163915 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd1234-a2f6-4cc4-a2b8-cfcfd50bc4fb admin admin] PATH_INFO: `/v3/users/9d7c60c25057425ca69e91e85691a580` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:16.165296 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd1234-a2f6-4cc4-a2b8-cfcfd50bc4fb admin admin] RBAC: Authorizing `identity:get_user(user_id=9d7c60c25057425ca69e91e85691a580)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:16.167681 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd1234-a2f6-4cc4-a2b8-cfcfd50bc4fb admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:16.169247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 5/9] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Jun 1 04:12:16 2022] GET /identity/v3/users/9d7c60c25057425ca69e91e85691a580 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:18.441543 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc1b56-6ca2-4cd3-81dd-7041b3244c6a None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:18.442054 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc1b56-6ca2-4cd3-81dd-7041b3244c6a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:18.442054 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc1b56-6ca2-4cd3-81dd-7041b3244c6a None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:18.443804 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 5/10] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:12:18.448723 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b6218-37e0-4c35-9697-66a09f08e948 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:18.449425 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b6218-37e0-4c35-9697-66a09f08e948 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:18.449425 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b6218-37e0-4c35-9697-66a09f08e948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:18.466942 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-c86b6218-37e0-4c35-9697-66a09f08e948 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:18.468111 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c86b6218-37e0-4c35-9697-66a09f08e948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:18.490928 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f74d63-e22b-4047-b9e0-076d3037150e None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:18.491212 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f74d63-e22b-4047-b9e0-076d3037150e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:18.491493 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f74d63-e22b-4047-b9e0-076d3037150e None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:18.492928 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 6/11] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:12:18.500198 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3443d-fb8f-448e-a0d2-2dafc317ba92 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:18.500615 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3443d-fb8f-448e-a0d2-2dafc317ba92 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:18.501102 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3443d-fb8f-448e-a0d2-2dafc317ba92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:18.559798 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG passlib.handlers.bcrypt [None req-c2c3443d-fb8f-448e-a0d2-2dafc317ba92 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80231) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 01 04:12:18.560233 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG passlib.handlers.bcrypt [None req-c2c3443d-fb8f-448e-a0d2-2dafc317ba92 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80231) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 01 04:12:18.565368 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 6/12] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:12:18.588887 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b6218-37e0-4c35-9697-66a09f08e948 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:18.607905 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c2c3443d-fb8f-448e-a0d2-2dafc317ba92 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:18.609503 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c2c3443d-fb8f-448e-a0d2-2dafc317ba92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:18.612745 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:18.694690 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b6218-37e0-4c35-9697-66a09f08e948 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:18.714317 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 7/13] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 04:12:18.732201 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1faea-ebd3-4568-a2fe-7d034a8f02b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:18.733000 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1faea-ebd3-4568-a2fe-7d034a8f02b8 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:18.733288 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1faea-ebd3-4568-a2fe-7d034a8f02b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:18.733577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1faea-ebd3-4568-a2fe-7d034a8f02b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:18.743542 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3443d-fb8f-448e-a0d2-2dafc317ba92 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:18.744924 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef1faea-ebd3-4568-a2fe-7d034a8f02b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:12:18.756200 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-bef1faea-ebd3-4568-a2fe-7d034a8f02b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:12:18.756200 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:12:18.756200 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:12:18.756200 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:12:18.756200 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:12:18.756200 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:12:18.756200 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:12:18.756200 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:12:18.756200 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:12:18.756200 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:12:18.756200 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:12:18.756200 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:12:18.756200 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:12:18.756200 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:12:18.756200 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:12:18.756200 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:12:18.757316 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:12:18.757316 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:12:18.757316 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:12:18.757316 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:12:18.757316 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:12:18.757316 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:12:18.757316 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:12:18.757316 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:12:18.757316 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:12:18.757316 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:12:18.757316 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:12:18.757316 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:12:18.757316 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:12:18.757316 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:12:18.757316 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:12:18.757316 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:12:18.758331 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:12:18.758331 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:12:18.758331 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:12:18.758331 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:12:18.758331 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:12:18.758331 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:12:18.758331 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:12:18.758331 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:12:18.758331 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:12:18.758331 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:12:18.758331 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:12:18.758331 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:12:18.758331 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 7/14] 10.222.0.32 () {56 vars in 1096 bytes} [Wed Jun 1 04:12:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:12:18.763669 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1faea-ebd3-4568-a2fe-7d034a8f02b8 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:18.846528 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:18.856250 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3443d-fb8f-448e-a0d2-2dafc317ba92 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:18.858796 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:18.867093 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1faea-ebd3-4568-a2fe-7d034a8f02b8 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:18.895331 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4d2dc-b925-4901-b9a2-e5f533bad1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:18.896224 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4d2dc-b925-4901-b9a2-e5f533bad1c9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:18.896517 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4d2dc-b925-4901-b9a2-e5f533bad1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:18.896858 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4d2dc-b925-4901-b9a2-e5f533bad1c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:18.902356 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043be22-64f1-4459-a7ef-d7a4162249d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:18.903024 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043be22-64f1-4459-a7ef-d7a4162249d8 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:18.903308 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043be22-64f1-4459-a7ef-d7a4162249d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:18.903585 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043be22-64f1-4459-a7ef-d7a4162249d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:18.904344 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043be22-64f1-4459-a7ef-d7a4162249d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:18.904652 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043be22-64f1-4459-a7ef-d7a4162249d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:18.906074 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043be22-64f1-4459-a7ef-d7a4162249d8 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:18.920007 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 8/15] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:12:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:12:18.925464 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043be22-64f1-4459-a7ef-d7a4162249d8 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:18.966751 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d4d2dc-b925-4901-b9a2-e5f533bad1c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:18.968203 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d4d2dc-b925-4901-b9a2-e5f533bad1c9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:19.025527 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043be22-64f1-4459-a7ef-d7a4162249d8 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:19.065368 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303b16c-0343-45d3-9fc0-9ff71ba657ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:19.065742 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 8/16] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:12:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 01 04:12:19.066269 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303b16c-0343-45d3-9fc0-9ff71ba657ad None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:19.066553 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303b16c-0343-45d3-9fc0-9ff71ba657ad None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:19.066830 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303b16c-0343-45d3-9fc0-9ff71ba657ad None admin] PATH_INFO: `/v3/users/9d7c60c25057425ca69e91e85691a580` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:19.068050 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303b16c-0343-45d3-9fc0-9ff71ba657ad None admin] RBAC: Authorizing `identity:get_user(user_id=9d7c60c25057425ca69e91e85691a580)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:19.069780 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303b16c-0343-45d3-9fc0-9ff71ba657ad None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:19.071689 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4d2dc-b925-4901-b9a2-e5f533bad1c9 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:19.071809 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 9/17] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:12:18 2022] GET /identity/v3/users/9d7c60c25057425ca69e91e85691a580 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:12:19.075563 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:19.076934 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303b16c-0343-45d3-9fc0-9ff71ba657ad None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:19.091159 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:19.170558 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4d2dc-b925-4901-b9a2-e5f533bad1c9 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:19.177554 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303b16c-0343-45d3-9fc0-9ff71ba657ad None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:19.204924 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d30ba-0f9e-481f-ba32-e48fe0a770c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:19.205715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d30ba-0f9e-481f-ba32-e48fe0a770c2 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:19.206022 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d30ba-0f9e-481f-ba32-e48fe0a770c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:19.206307 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d30ba-0f9e-481f-ba32-e48fe0a770c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:19.211563 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6659d5-2d08-4ea1-8ba5-713489dec269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:19.212880 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6659d5-2d08-4ea1-8ba5-713489dec269 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:19.213160 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6659d5-2d08-4ea1-8ba5-713489dec269 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:19.213434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6659d5-2d08-4ea1-8ba5-713489dec269 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:19.214635 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6659d5-2d08-4ea1-8ba5-713489dec269 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:19.217075 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6659d5-2d08-4ea1-8ba5-713489dec269 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:19.218656 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 10/18] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:12:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:12:19.224394 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6659d5-2d08-4ea1-8ba5-713489dec269 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:19.224904 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d30ba-0f9e-481f-ba32-e48fe0a770c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:19.226410 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d30ba-0f9e-481f-ba32-e48fe0a770c2 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:19.247509 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-9f5d30ba-0f9e-481f-ba32-e48fe0a770c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:12:19.247509 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:12:19.247509 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:12:19.247509 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:12:19.247509 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:12:19.247509 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:12:19.247509 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:12:19.247509 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:12:19.247509 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:12:19.247509 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:12:19.247509 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:12:19.247509 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:12:19.247509 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:12:19.247509 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:12:19.247509 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:12:19.248362 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:12:19.248362 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:12:19.248362 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:12:19.248362 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:12:19.248362 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:12:19.248362 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:12:19.248362 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:12:19.248362 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:12:19.248362 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:12:19.248362 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:12:19.248362 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:12:19.248362 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:12:19.248362 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:12:19.248362 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:12:19.248362 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:12:19.248362 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:12:19.248362 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:12:19.249181 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:12:19.249181 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:12:19.249181 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:12:19.249181 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:12:19.249181 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 9/19] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:12:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:12:19.254940 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d30ba-0f9e-481f-ba32-e48fe0a770c2 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:19.310165 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:19.311201 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:19.331412 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6659d5-2d08-4ea1-8ba5-713489dec269 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:19.354687 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d30ba-0f9e-481f-ba32-e48fe0a770c2 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:19.364983 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f803696-1dce-496a-845c-4ccb3d5859ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:19.365625 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f803696-1dce-496a-845c-4ccb3d5859ae None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:19.365910 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f803696-1dce-496a-845c-4ccb3d5859ae None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:19.366211 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f803696-1dce-496a-845c-4ccb3d5859ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:19.367034 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f803696-1dce-496a-845c-4ccb3d5859ae None admin] RBAC: Adding query filter params (role.id=76fc054ad9544460a7be1e2010c23642, scope.domain.id=default, user.id=9d7c60c25057425ca69e91e85691a580) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:19.367343 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f803696-1dce-496a-845c-4ccb3d5859ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:19.368806 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f803696-1dce-496a-845c-4ccb3d5859ae None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:19.375529 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 11/20] 10.222.0.32 () {56 vars in 1322 bytes} [Wed Jun 1 04:12:19 2022] GET /identity/v3/role_assignments?user.id=9d7c60c25057425ca69e91e85691a580&scope.domain.id=default&role.id=76fc054ad9544460a7be1e2010c23642 => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:12:19.389741 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b976fdd-7515-4905-beb3-623454e23a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:19.390483 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b976fdd-7515-4905-beb3-623454e23a5a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:19.390773 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b976fdd-7515-4905-beb3-623454e23a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:19.391053 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b976fdd-7515-4905-beb3-623454e23a5a None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:19.391803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b976fdd-7515-4905-beb3-623454e23a5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:19.392115 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b976fdd-7515-4905-beb3-623454e23a5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:19.393566 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b976fdd-7515-4905-beb3-623454e23a5a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:19.413875 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 10/21] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:12:21.922770 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60af598-a036-44b0-9ab4-5cf5fbdb88de None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:21.923826 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60af598-a036-44b0-9ab4-5cf5fbdb88de None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:21.924328 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60af598-a036-44b0-9ab4-5cf5fbdb88de None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:21.925949 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 12/22] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:12:21.933066 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea621a-0547-499d-8f66-a497d96a8929 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:21.934116 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea621a-0547-499d-8f66-a497d96a8929 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:21.934603 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea621a-0547-499d-8f66-a497d96a8929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:21.963134 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-fcea621a-0547-499d-8f66-a497d96a8929 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:21.964680 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-fcea621a-0547-499d-8f66-a497d96a8929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:22.055530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 11/23] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 04:12:22.086544 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60af598-a036-44b0-9ab4-5cf5fbdb88de None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:22.106684 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d13def-42b5-419d-942e-28b101211de8 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:22.107006 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d13def-42b5-419d-942e-28b101211de8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:22.107261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d13def-42b5-419d-942e-28b101211de8 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:22.108769 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 12/24] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:12:22.114086 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9492a63-e9fc-4166-964f-185501071890 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:22.114388 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9492a63-e9fc-4166-964f-185501071890 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:22.114663 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9492a63-e9fc-4166-964f-185501071890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:22.144171 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-f9492a63-e9fc-4166-964f-185501071890 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:22.146009 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f9492a63-e9fc-4166-964f-185501071890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:22.234431 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:22.259800 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60af598-a036-44b0-9ab4-5cf5fbdb88de None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:22.282102 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 13/25] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 04:12:22.309476 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9492a63-e9fc-4166-964f-185501071890 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:22.313620 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de61860-fc24-41a1-befd-327e3c9cf6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:22.314468 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de61860-fc24-41a1-befd-327e3c9cf6ee None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:22.314754 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de61860-fc24-41a1-befd-327e3c9cf6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:22.315035 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de61860-fc24-41a1-befd-327e3c9cf6ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:22.326547 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de61860-fc24-41a1-befd-327e3c9cf6ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:12:22.334165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-4de61860-fc24-41a1-befd-327e3c9cf6ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:12:22.334165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:12:22.334165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:12:22.334165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:12:22.334165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:12:22.334165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:12:22.334165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:12:22.334165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:12:22.334165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:12:22.334165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:12:22.334165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:12:22.334165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:12:22.334165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:12:22.334165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:12:22.334165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:12:22.334165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:12:22.334998 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:12:22.334998 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:12:22.334998 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:12:22.334998 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:12:22.334998 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:12:22.334998 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:12:22.334998 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:12:22.334998 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:12:22.334998 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:12:22.334998 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:12:22.334998 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:12:22.334998 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:12:22.334998 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:12:22.334998 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:12:22.334998 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:12:22.334998 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:12:22.335847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:12:22.335847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:12:22.335847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:12:22.335847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:12:22.335847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:12:22.335847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:12:22.335847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:12:22.335847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:12:22.335847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:12:22.335847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:12:22.335847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:12:22.335847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:12:22.335847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 13/26] 10.222.0.32 () {56 vars in 1096 bytes} [Wed Jun 1 04:12:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:12:22.343135 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de61860-fc24-41a1-befd-327e3c9cf6ee None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:22.349985 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:22.495891 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de61860-fc24-41a1-befd-327e3c9cf6ee None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:22.535090 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959b7e4-db38-4636-9a3d-6f40cf718c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:22.536948 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959b7e4-db38-4636-9a3d-6f40cf718c2b None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:22.537409 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959b7e4-db38-4636-9a3d-6f40cf718c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:22.538804 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959b7e4-db38-4636-9a3d-6f40cf718c2b None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:22.541410 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959b7e4-db38-4636-9a3d-6f40cf718c2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:22.542867 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959b7e4-db38-4636-9a3d-6f40cf718c2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:22.545049 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959b7e4-db38-4636-9a3d-6f40cf718c2b None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:22.548591 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9492a63-e9fc-4166-964f-185501071890 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:22.564694 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 14/27] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:12:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:22.566644 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe8c22-ba82-4e5e-a797-5a6f87f8eec1 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:22.567212 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe8c22-ba82-4e5e-a797-5a6f87f8eec1 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:22.567702 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe8c22-ba82-4e5e-a797-5a6f87f8eec1 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:22.574345 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 15/28] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:12:22.575385 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe8c22-ba82-4e5e-a797-5a6f87f8eec1 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:22.613011 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f461f8c-9674-4b0a-ac59-9574d1a11223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:22.614165 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f461f8c-9674-4b0a-ac59-9574d1a11223 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:22.615461 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f461f8c-9674-4b0a-ac59-9574d1a11223 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:22.616685 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f461f8c-9674-4b0a-ac59-9574d1a11223 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:22.617654 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f461f8c-9674-4b0a-ac59-9574d1a11223 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:22.619566 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f461f8c-9674-4b0a-ac59-9574d1a11223 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:22.729575 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:22.792413 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 14/29] 10.222.0.32 () {60 vars in 1131 bytes} [Wed Jun 1 04:12:22 2022] POST /identity/v3/roles => generated 219 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:12:22.794438 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90ad6e-6497-4855-b966-673f5c570231 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:22.794940 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90ad6e-6497-4855-b966-673f5c570231 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:22.795422 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90ad6e-6497-4855-b966-673f5c570231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:22.815707 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe8c22-ba82-4e5e-a797-5a6f87f8eec1 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:22.826681 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-8b90ad6e-6497-4855-b966-673f5c570231 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:22.828613 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8b90ad6e-6497-4855-b966-673f5c570231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:22.888970 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:22.895569 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482736cc-fea3-4fba-bea6-e92d088ce57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:22.896743 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482736cc-fea3-4fba-bea6-e92d088ce57d None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:22.897372 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482736cc-fea3-4fba-bea6-e92d088ce57d None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:22.898063 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482736cc-fea3-4fba-bea6-e92d088ce57d None admin] PATH_INFO: `/v3/users/9d7c60c25057425ca69e91e85691a580` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:22.901464 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482736cc-fea3-4fba-bea6-e92d088ce57d None admin] RBAC: Authorizing `identity:get_user(user_id=9d7c60c25057425ca69e91e85691a580)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:22.903942 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482736cc-fea3-4fba-bea6-e92d088ce57d None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:22.910090 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 16/30] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:12:22 2022] GET /identity/v3/users/9d7c60c25057425ca69e91e85691a580 => generated 247 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:22.916748 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482736cc-fea3-4fba-bea6-e92d088ce57d None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:23.011691 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 15/31] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:12:23.059103 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482736cc-fea3-4fba-bea6-e92d088ce57d None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:23.064066 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b90ad6e-6497-4855-b966-673f5c570231 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:23.143614 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf24dc5-5648-4bcf-b6f5-0f817225d837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:23.149883 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf24dc5-5648-4bcf-b6f5-0f817225d837 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:23.150469 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf24dc5-5648-4bcf-b6f5-0f817225d837 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:23.150951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf24dc5-5648-4bcf-b6f5-0f817225d837 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:23.159525 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf24dc5-5648-4bcf-b6f5-0f817225d837 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:23.161246 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf24dc5-5648-4bcf-b6f5-0f817225d837 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:23.164109 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 17/32] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:12:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:12:23.175483 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf24dc5-5648-4bcf-b6f5-0f817225d837 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:23.180570 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:23.271789 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b90ad6e-6497-4855-b966-673f5c570231 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:23.312076 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf24dc5-5648-4bcf-b6f5-0f817225d837 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:23.319156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562cb0a2-06b4-45e3-9617-fd61fe02f160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:23.319968 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cb0a2-06b4-45e3-9617-fd61fe02f160 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:23.320255 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cb0a2-06b4-45e3-9617-fd61fe02f160 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:23.320536 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cb0a2-06b4-45e3-9617-fd61fe02f160 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:23.334248 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562cb0a2-06b4-45e3-9617-fd61fe02f160 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:23.336641 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562cb0a2-06b4-45e3-9617-fd61fe02f160 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:23.355660 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317aff6e-3ab8-4e24-b4ea-4248cf8daaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:23.356980 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317aff6e-3ab8-4e24-b4ea-4248cf8daaa0 None admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:23.357489 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317aff6e-3ab8-4e24-b4ea-4248cf8daaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:23.358083 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317aff6e-3ab8-4e24-b4ea-4248cf8daaa0 None admin] PATH_INFO: `/v3/domains/default/users/9d7c60c25057425ca69e91e85691a580/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:23.360964 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-562cb0a2-06b4-45e3-9617-fd61fe02f160 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:12:23.360964 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:12:23.360964 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:12:23.360964 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:12:23.360964 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:12:23.360964 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:12:23.360964 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:12:23.360964 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:12:23.360964 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:12:23.360964 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:12:23.360964 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:12:23.360964 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:12:23.360964 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:12:23.360964 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:12:23.360964 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:12:23.361803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:12:23.361803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:12:23.361803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:12:23.361803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:12:23.361803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:12:23.361803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:12:23.361803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:12:23.361803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:12:23.361803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:12:23.361803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:12:23.361803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:12:23.361803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:12:23.361803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:12:23.361803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:12:23.361803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:12:23.361803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:12:23.361803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:12:23.362648 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:12:23.362648 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:12:23.362648 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:12:23.362648 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:12:23.362648 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 16/33] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:12:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:12:23.363467 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317aff6e-3ab8-4e24-b4ea-4248cf8daaa0 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=9d7c60c25057425ca69e91e85691a580, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:23.363772 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf2e27-d543-4844-8808-f38bb29ad4a1 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:23.364068 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf2e27-d543-4844-8808-f38bb29ad4a1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:23.364352 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf2e27-d543-4844-8808-f38bb29ad4a1 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:23.365731 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 17/34] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:12:23.366127 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317aff6e-3ab8-4e24-b4ea-4248cf8daaa0 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:23.371086 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf2e27-d543-4844-8808-f38bb29ad4a1 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:23.396748 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:23.482015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf2e27-d543-4844-8808-f38bb29ad4a1 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:23.493143 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 18/35] 10.222.0.32 () {58 vars in 1361 bytes} [Wed Jun 1 04:12:23 2022] PUT /identity/v3/domains/default/users/9d7c60c25057425ca69e91e85691a580/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:12:23.495122 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cd26c-70f1-4efb-b6d6-bab966ab7993 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:23.495549 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cd26c-70f1-4efb-b6d6-bab966ab7993 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:23.495953 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cd26c-70f1-4efb-b6d6-bab966ab7993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:23.515542 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-920cd26c-70f1-4efb-b6d6-bab966ab7993 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:23.517508 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-920cd26c-70f1-4efb-b6d6-bab966ab7993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:23.518642 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3be59e-01b1-4f72-8cb4-e24a36229ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:23.519339 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3be59e-01b1-4f72-8cb4-e24a36229ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:23.519628 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3be59e-01b1-4f72-8cb4-e24a36229ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:23.519911 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3be59e-01b1-4f72-8cb4-e24a36229ff0 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:23.520698 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3be59e-01b1-4f72-8cb4-e24a36229ff0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:23.520975 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3be59e-01b1-4f72-8cb4-e24a36229ff0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:23.522834 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3be59e-01b1-4f72-8cb4-e24a36229ff0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:23.536076 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 18/36] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:23.537596 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26916c-d83e-4291-9e16-ce84baa65e48 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:23.537881 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26916c-d83e-4291-9e16-ce84baa65e48 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:23.538192 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26916c-d83e-4291-9e16-ce84baa65e48 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:23.539466 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 19/37] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:12:23.542646 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26916c-d83e-4291-9e16-ce84baa65e48 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:23.585965 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:23.598603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 19/38] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:12:23.600279 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa6f8a-603d-4170-bdca-7d17debf9089 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:23.600752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa6f8a-603d-4170-bdca-7d17debf9089 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:23.601233 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa6f8a-603d-4170-bdca-7d17debf9089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:23.627247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-9efa6f8a-603d-4170-bdca-7d17debf9089 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:23.628773 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-9efa6f8a-603d-4170-bdca-7d17debf9089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:23.663976 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:23.693918 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26916c-d83e-4291-9e16-ce84baa65e48 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:23.714616 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 20/39] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:12:23.715771 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa6f8a-603d-4170-bdca-7d17debf9089 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:23.737335 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64273b-b581-4504-9e70-74b2b7b58b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:23.737686 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64273b-b581-4504-9e70-74b2b7b58b7e None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:23.737963 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64273b-b581-4504-9e70-74b2b7b58b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:23.738285 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64273b-b581-4504-9e70-74b2b7b58b7e None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:23.739288 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64273b-b581-4504-9e70-74b2b7b58b7e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:23.740908 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64273b-b581-4504-9e70-74b2b7b58b7e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:23.771733 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 20/40] 10.222.0.32 () {60 vars in 1141 bytes} [Wed Jun 1 04:12:23 2022] POST /identity/v3/projects => generated 301 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:12:23.773111 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c3da2-dce2-4cf1-9184-d091e9aaaba8 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:23.773410 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c3da2-dce2-4cf1-9184-d091e9aaaba8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:23.773689 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c3da2-dce2-4cf1-9184-d091e9aaaba8 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:23.775723 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 21/41] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:12:23.776268 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c3da2-dce2-4cf1-9184-d091e9aaaba8 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:23.839393 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa6f8a-603d-4170-bdca-7d17debf9089 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:23.876730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:23.894113 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737a3e4-e56a-4857-b5b2-37a62be8343d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:23.895349 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737a3e4-e56a-4857-b5b2-37a62be8343d None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:23.895850 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737a3e4-e56a-4857-b5b2-37a62be8343d None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:23.896369 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737a3e4-e56a-4857-b5b2-37a62be8343d None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:23.897412 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737a3e4-e56a-4857-b5b2-37a62be8343d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:23.900356 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737a3e4-e56a-4857-b5b2-37a62be8343d None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:23.911928 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c3da2-dce2-4cf1-9184-d091e9aaaba8 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:23.924349 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 21/42] 10.222.0.32 () {60 vars in 1131 bytes} [Wed Jun 1 04:12:23 2022] POST /identity/v3/roles => generated 225 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:12:23.926398 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7deafb8-01eb-407e-8f89-02022cf5bc40 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:23.926935 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7deafb8-01eb-407e-8f89-02022cf5bc40 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:23.927545 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7deafb8-01eb-407e-8f89-02022cf5bc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:23.954449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:23.968369 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bfb59-41ac-48d1-bcbe-7289c48bf46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:23.969501 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bfb59-41ac-48d1-bcbe-7289c48bf46c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:23.969799 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bfb59-41ac-48d1-bcbe-7289c48bf46c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:23.971239 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-f7deafb8-01eb-407e-8f89-02022cf5bc40 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:23.971809 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bfb59-41ac-48d1-bcbe-7289c48bf46c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:23.973365 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f7deafb8-01eb-407e-8f89-02022cf5bc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:23.974656 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988bfb59-41ac-48d1-bcbe-7289c48bf46c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:23.979826 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988bfb59-41ac-48d1-bcbe-7289c48bf46c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:23.986184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 22/43] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:12:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:23.991922 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bfb59-41ac-48d1-bcbe-7289c48bf46c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:24.078154 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 22/44] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:12:24.111397 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7deafb8-01eb-407e-8f89-02022cf5bc40 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:24.122023 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bfb59-41ac-48d1-bcbe-7289c48bf46c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:24.175741 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537eacb-fa1a-45f0-9619-604ee59c894a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:24.176422 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537eacb-fa1a-45f0-9619-604ee59c894a None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:24.176709 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537eacb-fa1a-45f0-9619-604ee59c894a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:24.176986 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537eacb-fa1a-45f0-9619-604ee59c894a None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:24.177700 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537eacb-fa1a-45f0-9619-604ee59c894a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:24.179347 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537eacb-fa1a-45f0-9619-604ee59c894a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:24.209584 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 23/45] 10.222.0.32 () {60 vars in 1141 bytes} [Wed Jun 1 04:12:23 2022] POST /identity/v3/projects => generated 312 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:12:24.244153 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7deafb8-01eb-407e-8f89-02022cf5bc40 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:24.260798 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:24.287911 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53514f-7823-443e-8f68-e27e46d5b16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:24.288597 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53514f-7823-443e-8f68-e27e46d5b16b None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:24.288886 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53514f-7823-443e-8f68-e27e46d5b16b None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:24.289168 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53514f-7823-443e-8f68-e27e46d5b16b None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:24.289938 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53514f-7823-443e-8f68-e27e46d5b16b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:24.291417 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53514f-7823-443e-8f68-e27e46d5b16b None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:24.307122 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 23/46] 10.222.0.32 () {60 vars in 1131 bytes} [Wed Jun 1 04:12:24 2022] POST /identity/v3/roles => generated 223 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:12:25.888634 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a2167-dafc-49f4-8eb7-676773aa5e5c None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:25.889152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a2167-dafc-49f4-8eb7-676773aa5e5c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:25.889288 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a2167-dafc-49f4-8eb7-676773aa5e5c None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:25.890704 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 24/47] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:12:25.896109 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4cbd7-5a5a-4289-80af-d5792525ab0d None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:25.896523 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4cbd7-5a5a-4289-80af-d5792525ab0d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:25.896680 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4cbd7-5a5a-4289-80af-d5792525ab0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:25.913139 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-eab4cbd7-5a5a-4289-80af-d5792525ab0d None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:25.914551 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-eab4cbd7-5a5a-4289-80af-d5792525ab0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:25.981917 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 24/48] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:12:26.005183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a2167-dafc-49f4-8eb7-676773aa5e5c None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:26.055736 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:26.107786 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a2167-dafc-49f4-8eb7-676773aa5e5c None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:26.142663 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0566626-69db-4f79-8e01-7c6d34a25eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:26.143395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0566626-69db-4f79-8e01-7c6d34a25eec None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:26.143677 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0566626-69db-4f79-8e01-7c6d34a25eec None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:26.143949 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0566626-69db-4f79-8e01-7c6d34a25eec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:26.158728 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0566626-69db-4f79-8e01-7c6d34a25eec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:12:26.168151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-c0566626-69db-4f79-8e01-7c6d34a25eec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:12:26.168151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:12:26.168151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:12:26.168151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:12:26.168151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:12:26.168151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:12:26.168151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:12:26.168151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:12:26.168151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:12:26.168151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:12:26.168151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:12:26.168151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:12:26.168151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:12:26.168151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:12:26.168151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:12:26.168151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:12:26.168977 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:12:26.168977 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:12:26.168977 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:12:26.168977 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:12:26.168977 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:12:26.168977 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:12:26.168977 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:12:26.168977 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:12:26.168977 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:12:26.168977 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:12:26.168977 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:12:26.168977 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:12:26.168977 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:12:26.168977 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:12:26.168977 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:12:26.168977 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:12:26.169714 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:12:26.169714 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:12:26.169714 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:12:26.169714 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:12:26.169714 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:12:26.169714 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:12:26.169714 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:12:26.169714 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:12:26.169714 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:12:26.169714 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:12:26.169714 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:12:26.169714 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:12:26.169714 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 25/49] 10.222.0.32 () {56 vars in 1096 bytes} [Wed Jun 1 04:12:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:12:26.175073 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4cbd7-5a5a-4289-80af-d5792525ab0d None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:26.271375 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4cbd7-5a5a-4289-80af-d5792525ab0d None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:26.272890 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:26.307597 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8f002-894e-4466-8bac-f475c68460d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:26.308262 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8f002-894e-4466-8bac-f475c68460d7 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:26.308546 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8f002-894e-4466-8bac-f475c68460d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:26.308820 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8f002-894e-4466-8bac-f475c68460d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:26.309563 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8f002-894e-4466-8bac-f475c68460d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:26.309867 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8f002-894e-4466-8bac-f475c68460d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:26.311304 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8f002-894e-4466-8bac-f475c68460d7 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:26.319664 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 25/50] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:12:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:26.325548 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0566626-69db-4f79-8e01-7c6d34a25eec None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:26.424225 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0566626-69db-4f79-8e01-7c6d34a25eec None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:26.434221 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:26.452280 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b98f4-6856-459a-8538-b97366168ad3 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:26.452564 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b98f4-6856-459a-8538-b97366168ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:26.452843 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b98f4-6856-459a-8538-b97366168ad3 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:26.454250 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 26/51] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:12:26.459087 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292a6e8-38df-471c-9f5b-e5b785b2d150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:26.459215 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6da830-f055-430c-b855-b16a3d63ddfd None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:26.459466 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6da830-f055-430c-b855-b16a3d63ddfd None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:26.459756 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6da830-f055-430c-b855-b16a3d63ddfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:26.459967 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292a6e8-38df-471c-9f5b-e5b785b2d150 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:26.460254 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292a6e8-38df-471c-9f5b-e5b785b2d150 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:26.460531 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292a6e8-38df-471c-9f5b-e5b785b2d150 None admin] PATH_INFO: `/v3/users/9d7c60c25057425ca69e91e85691a580` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:26.462626 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292a6e8-38df-471c-9f5b-e5b785b2d150 None admin] RBAC: Authorizing `identity:get_user(user_id=9d7c60c25057425ca69e91e85691a580)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:26.464120 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292a6e8-38df-471c-9f5b-e5b785b2d150 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:26.465733 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 26/52] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:12:26 2022] GET /identity/v3/users/9d7c60c25057425ca69e91e85691a580 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:26.470876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292a6e8-38df-471c-9f5b-e5b785b2d150 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:26.478904 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-bd6da830-f055-430c-b855-b16a3d63ddfd None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:26.480079 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-bd6da830-f055-430c-b855-b16a3d63ddfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:26.546602 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 27/53] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 04:12:26.567029 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292a6e8-38df-471c-9f5b-e5b785b2d150 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:26.570489 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6da830-f055-430c-b855-b16a3d63ddfd None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:26.600862 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4d322-2ba0-472f-bdea-77c188e60287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:26.601655 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4d322-2ba0-472f-bdea-77c188e60287 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:26.601938 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4d322-2ba0-472f-bdea-77c188e60287 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:26.602242 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4d322-2ba0-472f-bdea-77c188e60287 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:26.603471 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4d322-2ba0-472f-bdea-77c188e60287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:26.604921 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4d322-2ba0-472f-bdea-77c188e60287 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:26.606536 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 27/54] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:12:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:12:26.612204 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4d322-2ba0-472f-bdea-77c188e60287 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:26.657051 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:26.662535 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:26.669890 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6da830-f055-430c-b855-b16a3d63ddfd None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:26.704634 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c632160-3e26-4064-a9bb-214b0d44bcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:26.705348 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c632160-3e26-4064-a9bb-214b0d44bcb9 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:26.705638 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c632160-3e26-4064-a9bb-214b0d44bcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:26.705918 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c632160-3e26-4064-a9bb-214b0d44bcb9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:26.707185 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c632160-3e26-4064-a9bb-214b0d44bcb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:26.708686 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c632160-3e26-4064-a9bb-214b0d44bcb9 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:26.710076 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4d322-2ba0-472f-bdea-77c188e60287 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:26.710333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 28/55] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:12:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:12:26.715804 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c632160-3e26-4064-a9bb-214b0d44bcb9 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:26.741786 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cd8e1-ecb7-48f5-9305-dfb70958a563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:26.742470 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cd8e1-ecb7-48f5-9305-dfb70958a563 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:26.742752 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cd8e1-ecb7-48f5-9305-dfb70958a563 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:26.743030 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cd8e1-ecb7-48f5-9305-dfb70958a563 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:26.744339 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5cd8e1-ecb7-48f5-9305-dfb70958a563 None admin] RBAC: Adding query filter params (role.id=76fc054ad9544460a7be1e2010c23642, scope.domain.id=default, user.id=9d7c60c25057425ca69e91e85691a580) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:26.744651 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5cd8e1-ecb7-48f5-9305-dfb70958a563 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:26.746116 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5cd8e1-ecb7-48f5-9305-dfb70958a563 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:26.755094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 28/56] 10.222.0.32 () {56 vars in 1322 bytes} [Wed Jun 1 04:12:26 2022] GET /identity/v3/role_assignments?user.id=9d7c60c25057425ca69e91e85691a580&scope.domain.id=default&role.id=76fc054ad9544460a7be1e2010c23642 => generated 530 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:12:26.817438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c632160-3e26-4064-a9bb-214b0d44bcb9 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:26.853966 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef20677-4f6f-44ec-9736-384e8b6bcf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:26.854664 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef20677-4f6f-44ec-9736-384e8b6bcf5c None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:26.854961 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef20677-4f6f-44ec-9736-384e8b6bcf5c None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:26.855241 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef20677-4f6f-44ec-9736-384e8b6bcf5c None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:26.855967 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef20677-4f6f-44ec-9736-384e8b6bcf5c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:26.857438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef20677-4f6f-44ec-9736-384e8b6bcf5c None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:26.887410 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 29/57] 10.222.0.32 () {60 vars in 1140 bytes} [Wed Jun 1 04:12:26 2022] POST /identity/v3/projects => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:12:29.099266 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ad3ec-8417-4a06-baeb-950d4bc06cdc None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:29.099824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ad3ec-8417-4a06-baeb-950d4bc06cdc None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:29.099824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ad3ec-8417-4a06-baeb-950d4bc06cdc None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:29.101186 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 29/58] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:12:29.106939 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470ee54-f7df-41f9-8837-62f95a8854d1 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:29.107358 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470ee54-f7df-41f9-8837-62f95a8854d1 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:29.107506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470ee54-f7df-41f9-8837-62f95a8854d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:29.123806 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-0470ee54-f7df-41f9-8837-62f95a8854d1 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:29.124963 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-0470ee54-f7df-41f9-8837-62f95a8854d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:29.133830 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:29.192629 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 30/59] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:12:29.217280 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ad3ec-8417-4a06-baeb-950d4bc06cdc None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:29.316534 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ad3ec-8417-4a06-baeb-950d4bc06cdc None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:29.327527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:29.350363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf665f1b-3051-422b-9c9a-6a8870d11ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:29.351090 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf665f1b-3051-422b-9c9a-6a8870d11ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:29.351374 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf665f1b-3051-422b-9c9a-6a8870d11ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:29.351653 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf665f1b-3051-422b-9c9a-6a8870d11ff1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:29.352845 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf665f1b-3051-422b-9c9a-6a8870d11ff1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:29.354326 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf665f1b-3051-422b-9c9a-6a8870d11ff1 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:29.355923 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 30/60] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:12:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:29.361388 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470ee54-f7df-41f9-8837-62f95a8854d1 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:29.457701 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470ee54-f7df-41f9-8837-62f95a8854d1 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:29.490775 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb87cf1-3a05-4873-9d5f-d86c74a0dc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:29.491437 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb87cf1-3a05-4873-9d5f-d86c74a0dc14 None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:29.491724 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb87cf1-3a05-4873-9d5f-d86c74a0dc14 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:29.492006 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb87cf1-3a05-4873-9d5f-d86c74a0dc14 None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:29.492708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb87cf1-3a05-4873-9d5f-d86c74a0dc14 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:29.494219 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb87cf1-3a05-4873-9d5f-d86c74a0dc14 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:29.515240 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:29.520205 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 31/61] 10.222.0.32 () {60 vars in 1132 bytes} [Wed Jun 1 04:12:29 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:12:32.845025 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691ad81-a71a-449d-bc6f-7b8cc8200713 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:32.846107 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691ad81-a71a-449d-bc6f-7b8cc8200713 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:32.846660 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691ad81-a71a-449d-bc6f-7b8cc8200713 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:32.848254 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 31/62] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:12:32.863605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3aa636-476f-4ce3-87f5-9efac7d96b0e None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:32.864532 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3aa636-476f-4ce3-87f5-9efac7d96b0e None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:32.865013 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3aa636-476f-4ce3-87f5-9efac7d96b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:32.886598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-9c3aa636-476f-4ce3-87f5-9efac7d96b0e None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:32.888144 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-9c3aa636-476f-4ce3-87f5-9efac7d96b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:32.959231 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 32/63] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:12:32.982737 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691ad81-a71a-449d-bc6f-7b8cc8200713 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:32.985414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d4324-bfdb-4635-9247-59fe19dd6ae6 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:32.985913 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d4324-bfdb-4635-9247-59fe19dd6ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:32.986456 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d4324-bfdb-4635-9247-59fe19dd6ae6 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:32.988048 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 33/64] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:12:32.997133 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e46c19-8e4f-459d-be30-3e3b93eecc28 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:32.997420 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e46c19-8e4f-459d-be30-3e3b93eecc28 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:32.997704 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e46c19-8e4f-459d-be30-3e3b93eecc28 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:32.999268 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 34/65] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:12:33.000184 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584aa941-3187-47fc-9b36-77fe28c3e9be None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:33.000467 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584aa941-3187-47fc-9b36-77fe28c3e9be None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:33.000744 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584aa941-3187-47fc-9b36-77fe28c3e9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:33.022198 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-584aa941-3187-47fc-9b36-77fe28c3e9be None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:33.023389 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-584aa941-3187-47fc-9b36-77fe28c3e9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:33.103104 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 35/66] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:12:33.104258 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf5df1-5728-4611-ba67-122140043e93 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:33.104546 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf5df1-5728-4611-ba67-122140043e93 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:33.104843 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf5df1-5728-4611-ba67-122140043e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:33.117197 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691ad81-a71a-449d-bc6f-7b8cc8200713 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:33.121659 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-97cf5df1-5728-4611-ba67-122140043e93 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:33.123773 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-97cf5df1-5728-4611-ba67-122140043e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:33.169837 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9604259-82bf-4374-ac36-14926d1c35d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:33.170891 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9604259-82bf-4374-ac36-14926d1c35d5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:33.171375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9604259-82bf-4374-ac36-14926d1c35d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:33.171823 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9604259-82bf-4374-ac36-14926d1c35d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:33.185132 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9604259-82bf-4374-ac36-14926d1c35d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:12:33.193803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-d9604259-82bf-4374-ac36-14926d1c35d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 01 04:12:33.193803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:12:33.193803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:12:33.193803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:12:33.193803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:12:33.193803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:12:33.193803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:12:33.193803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:12:33.193803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:12:33.193803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:12:33.193803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:12:33.193803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:12:33.193803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:12:33.193803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:12:33.193803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:12:33.193803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:12:33.194908 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:12:33.194908 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:12:33.194908 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:12:33.194908 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:12:33.194908 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:12:33.194908 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:12:33.194908 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:12:33.194908 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:12:33.194908 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:12:33.194908 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:12:33.194908 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:12:33.194908 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:12:33.194908 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:12:33.194908 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:12:33.194908 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:12:33.194908 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:12:33.195667 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:12:33.195667 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:12:33.195667 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:12:33.195667 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:12:33.195667 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:12:33.195667 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:12:33.195667 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:12:33.195667 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:12:33.195667 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:12:33.195667 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:12:33.195667 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 01 04:12:33.195667 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:12:33.199003 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 32/67] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:12:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:12:33.200174 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9604259-82bf-4374-ac36-14926d1c35d5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:33.206613 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:33.230004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 36/68] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:12:33.230004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf5df1-5728-4611-ba67-122140043e93 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:33.270221 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:33.350232 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9604259-82bf-4374-ac36-14926d1c35d5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:33.359814 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf5df1-5728-4611-ba67-122140043e93 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:33.395830 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe769cc-2ecb-4a97-8ef5-d4e016179d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:33.396605 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc4c4d-685d-4fb1-8c96-5408c53ae0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:33.397093 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe769cc-2ecb-4a97-8ef5-d4e016179d18 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:33.397412 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc4c4d-685d-4fb1-8c96-5408c53ae0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:33.397701 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc4c4d-685d-4fb1-8c96-5408c53ae0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:33.398014 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc4c4d-685d-4fb1-8c96-5408c53ae0b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:33.398113 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe769cc-2ecb-4a97-8ef5-d4e016179d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:33.398597 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe769cc-2ecb-4a97-8ef5-d4e016179d18 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:33.400175 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe769cc-2ecb-4a97-8ef5-d4e016179d18 None admin] RBAC: Adding query filter params (name=member) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:33.400683 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe769cc-2ecb-4a97-8ef5-d4e016179d18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:33.402281 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe769cc-2ecb-4a97-8ef5-d4e016179d18 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:33.410974 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc4c4d-685d-4fb1-8c96-5408c53ae0b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:12:33.411623 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 37/69] 10.222.0.32 () {56 vars in 1101 bytes} [Wed Jun 1 04:12:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:33.412699 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe769cc-2ecb-4a97-8ef5-d4e016179d18 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:33.420598 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-53bc4c4d-685d-4fb1-8c96-5408c53ae0b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:12:33.420598 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:12:33.420598 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:12:33.420598 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:12:33.420598 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:12:33.420598 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:12:33.420598 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:12:33.420598 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:12:33.420598 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:12:33.420598 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:12:33.420598 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:12:33.420598 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:12:33.420598 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:12:33.420598 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:12:33.420598 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:12:33.420598 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:12:33.421455 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:12:33.421455 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:12:33.421455 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:12:33.421455 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:12:33.421455 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:12:33.421455 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:12:33.421455 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:12:33.421455 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:12:33.421455 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:12:33.421455 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:12:33.421455 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:12:33.421455 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:12:33.421455 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:12:33.421455 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:12:33.421455 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:12:33.421455 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:12:33.422244 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:12:33.422244 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:12:33.422244 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:12:33.422244 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:12:33.422244 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:12:33.422244 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:12:33.422244 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:12:33.422244 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:12:33.422244 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:12:33.422244 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:12:33.422244 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:12:33.422244 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:12:33.426055 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 33/70] 10.222.0.32 () {56 vars in 1096 bytes} [Wed Jun 1 04:12:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:12:33.427125 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc4c4d-685d-4fb1-8c96-5408c53ae0b9 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:33.474989 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:33.527210 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe769cc-2ecb-4a97-8ef5-d4e016179d18 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:33.558482 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:33.562793 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc4c4d-685d-4fb1-8c96-5408c53ae0b9 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:33.564245 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157da7e-6ccf-49f9-87f6-a83279c3ce2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:33.565214 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157da7e-6ccf-49f9-87f6-a83279c3ce2e None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:33.565653 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157da7e-6ccf-49f9-87f6-a83279c3ce2e None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:33.565931 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157da7e-6ccf-49f9-87f6-a83279c3ce2e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:33.577368 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1157da7e-6ccf-49f9-87f6-a83279c3ce2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:12:33.585418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-1157da7e-6ccf-49f9-87f6-a83279c3ce2e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 04:12:33.585418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:12:33.585418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:12:33.585418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:12:33.585418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:12:33.585418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:12:33.585418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:12:33.585418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:12:33.585418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:12:33.585418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:12:33.585418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:12:33.585418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:12:33.585418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:12:33.585418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:12:33.585418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:12:33.585418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:12:33.586381 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:12:33.586381 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:12:33.586381 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:12:33.586381 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:12:33.586381 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:12:33.586381 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:12:33.586381 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:12:33.586381 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:12:33.586381 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:12:33.586381 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:12:33.586381 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:12:33.586381 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:12:33.586381 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:12:33.586381 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:12:33.586381 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:12:33.586381 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:12:33.587180 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:12:33.587180 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:12:33.587180 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:12:33.587180 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:12:33.587180 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:12:33.587180 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:12:33.587180 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:12:33.587180 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:12:33.587180 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:12:33.587180 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:12:33.587180 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 04:12:33.587180 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:12:33.590131 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 38/71] 10.222.0.32 () {56 vars in 1114 bytes} [Wed Jun 1 04:12:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:12:33.591292 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157da7e-6ccf-49f9-87f6-a83279c3ce2e None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:33.598881 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd6e29-2205-4032-88ad-94f3abe7ce36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:33.599765 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd6e29-2205-4032-88ad-94f3abe7ce36 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:33.600051 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd6e29-2205-4032-88ad-94f3abe7ce36 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:33.600333 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd6e29-2205-4032-88ad-94f3abe7ce36 None admin] PATH_INFO: `/v3/users/afb251a9af9a4e5b99e5cdd71c34f147` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:33.615133 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd6e29-2205-4032-88ad-94f3abe7ce36 None admin] RBAC: Authorizing `identity:get_user(user_id=afb251a9af9a4e5b99e5cdd71c34f147)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:33.616647 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd6e29-2205-4032-88ad-94f3abe7ce36 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:33.618909 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 34/72] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:12:33 2022] GET /identity/v3/users/afb251a9af9a4e5b99e5cdd71c34f147 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:33.620108 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98de1a-fbea-4d7b-8dd4-fb35b2b4f4bb None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:33.620392 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98de1a-fbea-4d7b-8dd4-fb35b2b4f4bb None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:33.620669 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98de1a-fbea-4d7b-8dd4-fb35b2b4f4bb None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:33.622066 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 35/73] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:12:33.626804 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bc46a-8448-4305-bf25-094b90b061af None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:33.627096 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bc46a-8448-4305-bf25-094b90b061af None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:33.627376 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bc46a-8448-4305-bf25-094b90b061af None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:33.628622 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 36/74] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:12:33.629317 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bc46a-8448-4305-bf25-094b90b061af None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:33.693319 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157da7e-6ccf-49f9-87f6-a83279c3ce2e None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:33.707415 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:33.728244 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fafdcc-dab4-45e9-b12b-beec10e51fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:33.728906 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fafdcc-dab4-45e9-b12b-beec10e51fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:33.729192 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fafdcc-dab4-45e9-b12b-beec10e51fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:33.729505 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fafdcc-dab4-45e9-b12b-beec10e51fd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:33.730142 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bc46a-8448-4305-bf25-094b90b061af None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:33.730255 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fafdcc-dab4-45e9-b12b-beec10e51fd2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:33.730541 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fafdcc-dab4-45e9-b12b-beec10e51fd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:33.731930 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fafdcc-dab4-45e9-b12b-beec10e51fd2 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:33.739794 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 39/75] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:12:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:33.740586 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fafdcc-dab4-45e9-b12b-beec10e51fd2 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:33.764255 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8119e-3c5e-4e72-8ded-5aef8c8b188e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:33.764915 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8119e-3c5e-4e72-8ded-5aef8c8b188e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:33.765199 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8119e-3c5e-4e72-8ded-5aef8c8b188e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:33.765474 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8119e-3c5e-4e72-8ded-5aef8c8b188e None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:33.766249 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb8119e-3c5e-4e72-8ded-5aef8c8b188e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:33.766551 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb8119e-3c5e-4e72-8ded-5aef8c8b188e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:33.767921 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb8119e-3c5e-4e72-8ded-5aef8c8b188e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:33.778816 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 37/76] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:12:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:33.780092 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c36a9-6261-4ad2-97db-d33323dc0760 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:33.780379 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c36a9-6261-4ad2-97db-d33323dc0760 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:33.780677 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c36a9-6261-4ad2-97db-d33323dc0760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:33.797516 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-354c36a9-6261-4ad2-97db-d33323dc0760 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:33.798717 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-354c36a9-6261-4ad2-97db-d33323dc0760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:33.811832 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:33.843052 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fafdcc-dab4-45e9-b12b-beec10e51fd2 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:33.866468 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 38/77] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:12:33.867574 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf65bb9-d792-4edc-8cb7-6c28859de63a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:33.868499 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf65bb9-d792-4edc-8cb7-6c28859de63a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:33.868790 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf65bb9-d792-4edc-8cb7-6c28859de63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:33.877534 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d173b-7d44-41ef-bd77-536f80351f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:33.878200 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d173b-7d44-41ef-bd77-536f80351f7f None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:33.878481 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d173b-7d44-41ef-bd77-536f80351f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:33.878759 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d173b-7d44-41ef-bd77-536f80351f7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:33.898642 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2bf65bb9-d792-4edc-8cb7-6c28859de63a None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:33.899853 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2bf65bb9-d792-4edc-8cb7-6c28859de63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:33.921702 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:33.947949 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d173b-7d44-41ef-bd77-536f80351f7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:33.949456 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d173b-7d44-41ef-bd77-536f80351f7f None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:33.965983 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 39/78] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:12:33.966851 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf65bb9-d792-4edc-8cb7-6c28859de63a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:34.045308 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:34.056118 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 40/79] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:12:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 04:12:34.056963 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d173b-7d44-41ef-bd77-536f80351f7f None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:34.072474 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf65bb9-d792-4edc-8cb7-6c28859de63a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:34.106162 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d6155-88b9-48c1-8a32-8aeb134a1c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:34.107033 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d6155-88b9-48c1-8a32-8aeb134a1c26 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:34.107320 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d6155-88b9-48c1-8a32-8aeb134a1c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:34.107601 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d6155-88b9-48c1-8a32-8aeb134a1c26 None admin] PATH_INFO: `/v3/users/9d7c60c25057425ca69e91e85691a580` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:34.108839 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d6155-88b9-48c1-8a32-8aeb134a1c26 None admin] RBAC: Authorizing `identity:get_user(user_id=9d7c60c25057425ca69e91e85691a580)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:34.110333 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d6155-88b9-48c1-8a32-8aeb134a1c26 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:34.116206 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 40/80] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:12:33 2022] GET /identity/v3/users/9d7c60c25057425ca69e91e85691a580 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:34.116206 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d6155-88b9-48c1-8a32-8aeb134a1c26 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:34.131587 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:34.159866 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d173b-7d44-41ef-bd77-536f80351f7f None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:34.194837 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004c3ad-f8f5-47c2-8127-d29b43e413e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:34.195711 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004c3ad-f8f5-47c2-8127-d29b43e413e7 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:34.196029 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004c3ad-f8f5-47c2-8127-d29b43e413e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:34.196309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004c3ad-f8f5-47c2-8127-d29b43e413e7 None admin] PATH_INFO: `/v3/users/afb251a9af9a4e5b99e5cdd71c34f147` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:34.197516 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e004c3ad-f8f5-47c2-8127-d29b43e413e7 None admin] RBAC: Authorizing `identity:get_user(user_id=afb251a9af9a4e5b99e5cdd71c34f147)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:34.198987 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e004c3ad-f8f5-47c2-8127-d29b43e413e7 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:34.200623 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 41/81] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:12:34 2022] GET /identity/v3/users/afb251a9af9a4e5b99e5cdd71c34f147 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:34.201400 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004c3ad-f8f5-47c2-8127-d29b43e413e7 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:34.215789 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d6155-88b9-48c1-8a32-8aeb134a1c26 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:34.250926 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0c171-69cd-4eb8-9aa1-def510cee955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:34.251743 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0c171-69cd-4eb8-9aa1-def510cee955 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:34.252004 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0c171-69cd-4eb8-9aa1-def510cee955 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:34.252279 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0c171-69cd-4eb8-9aa1-def510cee955 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:34.262229 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0c171-69cd-4eb8-9aa1-def510cee955 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:12:34.269821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-66c0c171-69cd-4eb8-9aa1-def510cee955 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 01 04:12:34.269821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:12:34.269821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:12:34.269821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:12:34.269821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:12:34.269821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:12:34.269821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:12:34.269821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:12:34.269821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:12:34.269821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:12:34.269821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:12:34.269821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:12:34.269821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:12:34.269821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:12:34.269821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:12:34.269821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:12:34.270729 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:12:34.270729 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:12:34.270729 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:12:34.270729 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:12:34.270729 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:12:34.270729 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:12:34.270729 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:12:34.270729 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:12:34.270729 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:12:34.270729 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:12:34.270729 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:12:34.270729 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:12:34.270729 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:12:34.270729 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:12:34.270729 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:12:34.270729 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:12:34.271470 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:12:34.271470 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:12:34.271470 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:12:34.271470 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:12:34.271470 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:12:34.271470 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:12:34.271470 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:12:34.271470 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:12:34.271470 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:12:34.271470 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:12:34.271470 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 01 04:12:34.271470 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:12:34.271470 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 41/82] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:12:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:12:34.272113 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0c171-69cd-4eb8-9aa1-def510cee955 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:34.284651 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:34.301846 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004c3ad-f8f5-47c2-8127-d29b43e413e7 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:34.334834 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984fb78-1f6c-44b6-96f7-905f7d3167c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:34.335625 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984fb78-1f6c-44b6-96f7-905f7d3167c9 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:34.335909 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984fb78-1f6c-44b6-96f7-905f7d3167c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:34.336185 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984fb78-1f6c-44b6-96f7-905f7d3167c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:34.337870 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2984fb78-1f6c-44b6-96f7-905f7d3167c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:34.339321 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2984fb78-1f6c-44b6-96f7-905f7d3167c9 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:34.340929 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 42/83] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:12:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:34.341684 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984fb78-1f6c-44b6-96f7-905f7d3167c9 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:34.354012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:34.378882 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0c171-69cd-4eb8-9aa1-def510cee955 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:34.412744 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c50e1-a7a2-445e-a638-150fc1c4f292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:34.413534 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c50e1-a7a2-445e-a638-150fc1c4f292 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:34.413828 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c50e1-a7a2-445e-a638-150fc1c4f292 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:34.414157 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c50e1-a7a2-445e-a638-150fc1c4f292 None admin] PATH_INFO: `/v3/projects/51115e4840444ed8aa7f060448c5cc92` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:34.415883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c50e1-a7a2-445e-a638-150fc1c4f292 None admin] RBAC: Authorizing `identity:get_project(project_id=51115e4840444ed8aa7f060448c5cc92)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:34.417335 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c50e1-a7a2-445e-a638-150fc1c4f292 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:34.419300 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 42/84] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:12:34 2022] GET /identity/v3/projects/51115e4840444ed8aa7f060448c5cc92 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:34.420066 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c50e1-a7a2-445e-a638-150fc1c4f292 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:34.442085 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984fb78-1f6c-44b6-96f7-905f7d3167c9 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:34.476917 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa8d1ac-099a-4403-bd4c-a07ae4a80c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:34.478167 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8d1ac-099a-4403-bd4c-a07ae4a80c9e None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:34.478457 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8d1ac-099a-4403-bd4c-a07ae4a80c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:34.478749 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8d1ac-099a-4403-bd4c-a07ae4a80c9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:34.497486 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:34.521826 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c50e1-a7a2-445e-a638-150fc1c4f292 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:34.545204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa8d1ac-099a-4403-bd4c-a07ae4a80c9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:34.546752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa8d1ac-099a-4403-bd4c-a07ae4a80c9e None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:34.555383 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc0c131-e702-42c0-8e34-2e90a7f019bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:34.556042 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0c131-e702-42c0-8e34-2e90a7f019bc None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:34.556326 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0c131-e702-42c0-8e34-2e90a7f019bc None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:34.556607 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0c131-e702-42c0-8e34-2e90a7f019bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:34.557435 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:34.623881 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc0c131-e702-42c0-8e34-2e90a7f019bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:34.625372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc0c131-e702-42c0-8e34-2e90a7f019bc None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:34.643585 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 43/85] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:12:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 04:12:34.644702 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa8d1ac-099a-4403-bd4c-a07ae4a80c9e None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:34.697258 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:34.723058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 43/86] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:12:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 04:12:34.724939 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc0c131-e702-42c0-8e34-2e90a7f019bc None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:34.745297 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa8d1ac-099a-4403-bd4c-a07ae4a80c9e None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:34.755699 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:34.779837 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195fca44-fc9f-4cc7-ae6c-a16eaacb268e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:34.780561 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fca44-fc9f-4cc7-ae6c-a16eaacb268e None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:34.780842 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fca44-fc9f-4cc7-ae6c-a16eaacb268e None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:34.781120 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fca44-fc9f-4cc7-ae6c-a16eaacb268e None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:34.781861 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195fca44-fc9f-4cc7-ae6c-a16eaacb268e None admin] RBAC: Adding query filter params (name=member) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:34.782195 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195fca44-fc9f-4cc7-ae6c-a16eaacb268e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:34.783575 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195fca44-fc9f-4cc7-ae6c-a16eaacb268e None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:34.791523 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 44/87] 10.222.0.32 () {56 vars in 1101 bytes} [Wed Jun 1 04:12:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:34.792316 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195fca44-fc9f-4cc7-ae6c-a16eaacb268e None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:34.821421 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc0c131-e702-42c0-8e34-2e90a7f019bc None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:34.854873 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226830cf-1f08-482f-b034-9420edd28ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:34.855539 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226830cf-1f08-482f-b034-9420edd28ebf None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:34.855838 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226830cf-1f08-482f-b034-9420edd28ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:34.856104 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226830cf-1f08-482f-b034-9420edd28ebf None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:34.856808 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226830cf-1f08-482f-b034-9420edd28ebf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:34.858291 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226830cf-1f08-482f-b034-9420edd28ebf None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:34.882893 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 44/88] 10.222.0.32 () {60 vars in 1132 bytes} [Wed Jun 1 04:12:34 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:12:34.884490 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226830cf-1f08-482f-b034-9420edd28ebf None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:34.907419 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195fca44-fc9f-4cc7-ae6c-a16eaacb268e None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:34.923175 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:34.952467 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24951b4-5ecc-49c0-bc24-e52fb9e31be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:34.953060 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24951b4-5ecc-49c0-bc24-e52fb9e31be3 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:34.953348 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24951b4-5ecc-49c0-bc24-e52fb9e31be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:34.953625 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24951b4-5ecc-49c0-bc24-e52fb9e31be3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:34.954544 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24951b4-5ecc-49c0-bc24-e52fb9e31be3 None admin] RBAC: Adding query filter params (role.id=3f08ec4046094d04a533ba522f71ba9a, scope.project.id=51115e4840444ed8aa7f060448c5cc92, user.id=afb251a9af9a4e5b99e5cdd71c34f147) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:34.954861 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24951b4-5ecc-49c0-bc24-e52fb9e31be3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:34.956373 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24951b4-5ecc-49c0-bc24-e52fb9e31be3 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:34.974018 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 45/89] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:12:34 2022] GET /identity/v3/role_assignments?user.id=afb251a9af9a4e5b99e5cdd71c34f147&scope.project.id=51115e4840444ed8aa7f060448c5cc92&role.id=3f08ec4046094d04a533ba522f71ba9a => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:34.974018 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24951b4-5ecc-49c0-bc24-e52fb9e31be3 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:35.024889 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:35.026610 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226830cf-1f08-482f-b034-9420edd28ebf None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:35.072399 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d17c9-f321-4b3e-9537-e5cc3289917e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:35.073520 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d17c9-f321-4b3e-9537-e5cc3289917e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:35.073880 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d17c9-f321-4b3e-9537-e5cc3289917e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:35.074255 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d17c9-f321-4b3e-9537-e5cc3289917e None admin] PATH_INFO: `/v3/projects/51115e4840444ed8aa7f060448c5cc92` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:35.075685 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d17c9-f321-4b3e-9537-e5cc3289917e None admin] RBAC: Authorizing `identity:get_project(project_id=51115e4840444ed8aa7f060448c5cc92)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:35.077290 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d17c9-f321-4b3e-9537-e5cc3289917e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:35.079426 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 45/90] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:12:34 2022] GET /identity/v3/projects/51115e4840444ed8aa7f060448c5cc92 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:35.080541 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d17c9-f321-4b3e-9537-e5cc3289917e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:35.123656 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24951b4-5ecc-49c0-bc24-e52fb9e31be3 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:35.176540 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b82ba-88b7-4420-894c-a8531056bf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:35.176764 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b82ba-88b7-4420-894c-a8531056bf69 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:35.176994 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b82ba-88b7-4420-894c-a8531056bf69 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:35.177631 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b82ba-88b7-4420-894c-a8531056bf69 None admin] PATH_INFO: `/v3/projects/51115e4840444ed8aa7f060448c5cc92` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:35.178922 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b82ba-88b7-4420-894c-a8531056bf69 None admin] RBAC: Authorizing `identity:get_project(project_id=51115e4840444ed8aa7f060448c5cc92)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:35.180669 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b82ba-88b7-4420-894c-a8531056bf69 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:35.182854 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 46/91] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:12:34 2022] GET /identity/v3/projects/51115e4840444ed8aa7f060448c5cc92 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:35.183894 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b82ba-88b7-4420-894c-a8531056bf69 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:35.214437 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:35.222253 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d17c9-f321-4b3e-9537-e5cc3289917e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:35.271747 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa771606-09d7-4d5d-8914-ea73173450d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:35.272949 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa771606-09d7-4d5d-8914-ea73173450d4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:35.273241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa771606-09d7-4d5d-8914-ea73173450d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:35.273788 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa771606-09d7-4d5d-8914-ea73173450d4 None admin] PATH_INFO: `/v3/users/afb251a9af9a4e5b99e5cdd71c34f147` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:35.275752 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa771606-09d7-4d5d-8914-ea73173450d4 None admin] RBAC: Authorizing `identity:get_user(user_id=afb251a9af9a4e5b99e5cdd71c34f147)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:35.277551 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa771606-09d7-4d5d-8914-ea73173450d4 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:35.279564 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 46/92] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:12:35 2022] GET /identity/v3/users/afb251a9af9a4e5b99e5cdd71c34f147 => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:35.280418 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa771606-09d7-4d5d-8914-ea73173450d4 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:35.327590 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b82ba-88b7-4420-894c-a8531056bf69 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:35.331401 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:35.373724 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b7da0-0c2f-4515-85e8-1fa0f33fc5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:35.374787 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b7da0-0c2f-4515-85e8-1fa0f33fc5f7 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:35.375285 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b7da0-0c2f-4515-85e8-1fa0f33fc5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:35.375758 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b7da0-0c2f-4515-85e8-1fa0f33fc5f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:35.376800 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b7da0-0c2f-4515-85e8-1fa0f33fc5f7 None admin] RBAC: Adding query filter params (role.id=76fc054ad9544460a7be1e2010c23642, scope.project.id=51115e4840444ed8aa7f060448c5cc92, user.id=9d7c60c25057425ca69e91e85691a580) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:35.377789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b7da0-0c2f-4515-85e8-1fa0f33fc5f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:35.379483 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b7da0-0c2f-4515-85e8-1fa0f33fc5f7 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:35.388791 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 47/93] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:12:35 2022] GET /identity/v3/role_assignments?user.id=9d7c60c25057425ca69e91e85691a580&scope.project.id=51115e4840444ed8aa7f060448c5cc92&role.id=76fc054ad9544460a7be1e2010c23642 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:35.390310 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b7da0-0c2f-4515-85e8-1fa0f33fc5f7 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:35.411630 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa771606-09d7-4d5d-8914-ea73173450d4 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:35.463544 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697d635-7f31-4bd7-ae68-cad27def4820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:35.464640 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697d635-7f31-4bd7-ae68-cad27def4820 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:35.465137 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697d635-7f31-4bd7-ae68-cad27def4820 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:35.465610 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697d635-7f31-4bd7-ae68-cad27def4820 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:35.467551 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697d635-7f31-4bd7-ae68-cad27def4820 None admin] RBAC: Adding query filter params (role.id=71e70e8fe1344699a131764a348d51d6, scope.project.id=51115e4840444ed8aa7f060448c5cc92, user.id=afb251a9af9a4e5b99e5cdd71c34f147) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:35.468111 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697d635-7f31-4bd7-ae68-cad27def4820 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:35.471721 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697d635-7f31-4bd7-ae68-cad27def4820 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:35.479459 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 47/94] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:12:35 2022] GET /identity/v3/role_assignments?user.id=afb251a9af9a4e5b99e5cdd71c34f147&scope.project.id=51115e4840444ed8aa7f060448c5cc92&role.id=71e70e8fe1344699a131764a348d51d6 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:35.529267 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b7da0-0c2f-4515-85e8-1fa0f33fc5f7 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:35.591444 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b992c-a48d-4655-8683-3f449919c8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:35.592121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b992c-a48d-4655-8683-3f449919c8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:35.592426 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b992c-a48d-4655-8683-3f449919c8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:35.592687 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b992c-a48d-4655-8683-3f449919c8f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:35.647400 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:35.696802 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b992c-a48d-4655-8683-3f449919c8f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:35.698362 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b992c-a48d-4655-8683-3f449919c8f0 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:35.830633 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 48/95] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:12:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 04:12:35.836924 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697d635-7f31-4bd7-ae68-cad27def4820 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:35.874902 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:35.958542 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697d635-7f31-4bd7-ae68-cad27def4820 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:35.992083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54168316-e978-4411-9a0f-0c5d3027d229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:35.993484 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54168316-e978-4411-9a0f-0c5d3027d229 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:35.993769 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54168316-e978-4411-9a0f-0c5d3027d229 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:35.994075 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54168316-e978-4411-9a0f-0c5d3027d229 None admin] PATH_INFO: `/v3/projects/5ea64b356593434d818d39850efe108a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:35.995262 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54168316-e978-4411-9a0f-0c5d3027d229 None admin] RBAC: Authorizing `identity:get_project(project_id=5ea64b356593434d818d39850efe108a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:35.996727 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54168316-e978-4411-9a0f-0c5d3027d229 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:35.998454 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 48/96] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:12:35 2022] GET /identity/v3/projects/5ea64b356593434d818d39850efe108a => generated 312 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:36.004451 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b992c-a48d-4655-8683-3f449919c8f0 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:36.091910 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:36.132694 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b992c-a48d-4655-8683-3f449919c8f0 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:36.186739 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d01f6-d656-4bc6-a505-d47469407a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:36.187402 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d01f6-d656-4bc6-a505-d47469407a45 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:36.187689 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d01f6-d656-4bc6-a505-d47469407a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:36.187968 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d01f6-d656-4bc6-a505-d47469407a45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:36.188794 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882d01f6-d656-4bc6-a505-d47469407a45 None admin] RBAC: Adding query filter params (role.id=3f08ec4046094d04a533ba522f71ba9a, scope.project.id=5ea64b356593434d818d39850efe108a, user.id=afb251a9af9a4e5b99e5cdd71c34f147) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:36.189106 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882d01f6-d656-4bc6-a505-d47469407a45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:36.190598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882d01f6-d656-4bc6-a505-d47469407a45 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:36.200836 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 49/97] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:12:36 2022] GET /identity/v3/role_assignments?user.id=afb251a9af9a4e5b99e5cdd71c34f147&scope.project.id=5ea64b356593434d818d39850efe108a&role.id=3f08ec4046094d04a533ba522f71ba9a => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:38.261139 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf644497-0a6e-4b02-8cc8-d8e5dba06274 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:38.261694 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf644497-0a6e-4b02-8cc8-d8e5dba06274 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:38.261694 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf644497-0a6e-4b02-8cc8-d8e5dba06274 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:38.263232 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 49/98] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:12:38.268654 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6fca7-807a-4b3d-8c58-bb6413ca8246 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:38.269086 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6fca7-807a-4b3d-8c58-bb6413ca8246 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:38.269218 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6fca7-807a-4b3d-8c58-bb6413ca8246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:38.290559 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-81d6fca7-807a-4b3d-8c58-bb6413ca8246 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:38.292087 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-81d6fca7-807a-4b3d-8c58-bb6413ca8246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:38.377714 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 50/99] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:12:38.411143 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf644497-0a6e-4b02-8cc8-d8e5dba06274 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:38.435916 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcc8ac-b02e-4f1f-ad67-ed93756d01ff None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:38.436561 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcc8ac-b02e-4f1f-ad67-ed93756d01ff None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:38.437045 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcc8ac-b02e-4f1f-ad67-ed93756d01ff None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:38.438752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 51/100] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:12:38.452139 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cfd94-cdd0-4a89-b1c9-93d9e91ac6a2 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:38.452777 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cfd94-cdd0-4a89-b1c9-93d9e91ac6a2 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:38.453260 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cfd94-cdd0-4a89-b1c9-93d9e91ac6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:38.483281 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-8e8cfd94-cdd0-4a89-b1c9-93d9e91ac6a2 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:38.485884 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-8e8cfd94-cdd0-4a89-b1c9-93d9e91ac6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:38.582989 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:38.596196 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:38.606633 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf644497-0a6e-4b02-8cc8-d8e5dba06274 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:38.608367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 52/101] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 04:12:38.610161 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae75a1-7b11-487f-b4ab-735f97a6aadc None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:38.610665 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae75a1-7b11-487f-b4ab-735f97a6aadc None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:38.611143 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae75a1-7b11-487f-b4ab-735f97a6aadc None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:38.612890 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 53/102] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:12:38.651510 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d8ad1-2221-4ea5-8dbc-9c8e5310d20a None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:38.652153 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d8ad1-2221-4ea5-8dbc-9c8e5310d20a None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:38.652637 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d8ad1-2221-4ea5-8dbc-9c8e5310d20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:38.665506 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a9c55-688e-43e1-97f1-82f425727996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:38.666310 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a9c55-688e-43e1-97f1-82f425727996 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:38.666597 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a9c55-688e-43e1-97f1-82f425727996 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:38.666871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a9c55-688e-43e1-97f1-82f425727996 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:38.682336 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171a9c55-688e-43e1-97f1-82f425727996 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:12:38.686413 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-1e7d8ad1-2221-4ea5-8dbc-9c8e5310d20a None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:38.687692 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-1e7d8ad1-2221-4ea5-8dbc-9c8e5310d20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:38.690673 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-171a9c55-688e-43e1-97f1-82f425727996 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 01 04:12:38.690673 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:12:38.690673 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:12:38.690673 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:12:38.690673 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:12:38.690673 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:12:38.690673 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:12:38.690673 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:12:38.690673 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:12:38.690673 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:12:38.690673 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:12:38.690673 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:12:38.690673 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:12:38.690673 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:12:38.690673 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:12:38.690673 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:12:38.691544 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:12:38.691544 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:12:38.691544 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:12:38.691544 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:12:38.691544 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:12:38.691544 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:12:38.691544 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:12:38.691544 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:12:38.691544 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:12:38.691544 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:12:38.691544 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:12:38.691544 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:12:38.691544 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:12:38.691544 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:12:38.691544 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:12:38.691544 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:12:38.692321 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:12:38.692321 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:12:38.692321 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:12:38.692321 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:12:38.692321 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:12:38.692321 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:12:38.692321 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:12:38.692321 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:12:38.692321 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:12:38.692321 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:12:38.692321 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 01 04:12:38.692321 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:12:38.696631 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 50/103] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:12:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:12:38.697571 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a9c55-688e-43e1-97f1-82f425727996 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:38.806920 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a9c55-688e-43e1-97f1-82f425727996 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:38.832802 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 54/104] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:12:38.834179 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d8ad1-2221-4ea5-8dbc-9c8e5310d20a None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:38.854579 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58494d5-bc99-4ba1-8de4-f71b3048d8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:38.855771 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58494d5-bc99-4ba1-8de4-f71b3048d8de None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:38.856905 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58494d5-bc99-4ba1-8de4-f71b3048d8de None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:38.857502 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58494d5-bc99-4ba1-8de4-f71b3048d8de None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:38.871923 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58494d5-bc99-4ba1-8de4-f71b3048d8de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:12:38.882305 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-e58494d5-bc99-4ba1-8de4-f71b3048d8de None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 01 04:12:38.882305 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:12:38.882305 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:12:38.882305 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:12:38.882305 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:12:38.882305 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:12:38.882305 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:12:38.882305 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:12:38.882305 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:12:38.882305 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:12:38.882305 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:12:38.882305 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:12:38.882305 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:12:38.882305 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:12:38.882305 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:12:38.882305 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:12:38.883254 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:12:38.883254 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:12:38.883254 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:12:38.883254 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:12:38.883254 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:12:38.883254 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:12:38.883254 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:12:38.883254 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:12:38.883254 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:12:38.883254 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:12:38.883254 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:12:38.883254 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:12:38.883254 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:12:38.883254 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:12:38.883254 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:12:38.883254 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:12:38.884564 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:12:38.884564 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:12:38.884564 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:12:38.884564 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:12:38.884564 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:12:38.884564 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:12:38.884564 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:12:38.884564 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:12:38.884564 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:12:38.884564 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:12:38.884564 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 01 04:12:38.884564 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:12:38.887660 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 51/105] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:12:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:12:38.892866 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81b6cc-050a-4e74-964f-d2b195a8eb2d None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:38.892866 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81b6cc-050a-4e74-964f-d2b195a8eb2d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:38.892866 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81b6cc-050a-4e74-964f-d2b195a8eb2d None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:38.892866 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 52/106] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:12:38.894548 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d81b6cc-050a-4e74-964f-d2b195a8eb2d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:38.928248 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:38.990951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d8ad1-2221-4ea5-8dbc-9c8e5310d20a None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:39.022011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:39.035838 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d81b6cc-050a-4e74-964f-d2b195a8eb2d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:39.037452 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146e973-c071-4e68-8c2d-7209ef2181f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:39.038461 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146e973-c071-4e68-8c2d-7209ef2181f3 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:39.038752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146e973-c071-4e68-8c2d-7209ef2181f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:39.039085 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146e973-c071-4e68-8c2d-7209ef2181f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:39.041291 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146e973-c071-4e68-8c2d-7209ef2181f3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:39.041609 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146e973-c071-4e68-8c2d-7209ef2181f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:39.043222 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146e973-c071-4e68-8c2d-7209ef2181f3 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:39.058575 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 55/107] 10.222.0.32 () {56 vars in 1101 bytes} [Wed Jun 1 04:12:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:39.058575 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146e973-c071-4e68-8c2d-7209ef2181f3 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:39.084623 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56279cab-83d8-47e9-8855-f5ef08738468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:39.086184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56279cab-83d8-47e9-8855-f5ef08738468 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:39.086910 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56279cab-83d8-47e9-8855-f5ef08738468 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:39.087367 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56279cab-83d8-47e9-8855-f5ef08738468 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:39.089212 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56279cab-83d8-47e9-8855-f5ef08738468 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:39.091323 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56279cab-83d8-47e9-8855-f5ef08738468 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:39.098280 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 53/108] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:12:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:39.100344 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd3659-8ca2-46b9-83ce-01bee38437e6 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:39.100636 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd3659-8ca2-46b9-83ce-01bee38437e6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:39.101041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd3659-8ca2-46b9-83ce-01bee38437e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:39.119219 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-39fd3659-8ca2-46b9-83ce-01bee38437e6 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:39.120471 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-39fd3659-8ca2-46b9-83ce-01bee38437e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:39.180179 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146e973-c071-4e68-8c2d-7209ef2181f3 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:39.206355 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 54/109] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:12:39.207309 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd3659-8ca2-46b9-83ce-01bee38437e6 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:39.216987 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1378de-f17d-4ce1-8a5a-0824f66ef810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:39.218026 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1378de-f17d-4ce1-8a5a-0824f66ef810 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:39.218594 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1378de-f17d-4ce1-8a5a-0824f66ef810 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:39.219076 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1378de-f17d-4ce1-8a5a-0824f66ef810 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:39.220040 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1378de-f17d-4ce1-8a5a-0824f66ef810 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:39.220556 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1378de-f17d-4ce1-8a5a-0824f66ef810 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:39.222246 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1378de-f17d-4ce1-8a5a-0824f66ef810 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:39.231907 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 56/110] 10.222.0.32 () {56 vars in 1101 bytes} [Wed Jun 1 04:12:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:39.232130 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:39.233229 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1378de-f17d-4ce1-8a5a-0824f66ef810 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:39.281994 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:39.324925 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd3659-8ca2-46b9-83ce-01bee38437e6 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:39.335398 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1378de-f17d-4ce1-8a5a-0824f66ef810 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:39.358293 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00888132-647a-4794-ad89-5d99f20332f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:39.359247 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00888132-647a-4794-ad89-5d99f20332f3 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:39.359532 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00888132-647a-4794-ad89-5d99f20332f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:39.359812 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00888132-647a-4794-ad89-5d99f20332f3 None admin] PATH_INFO: `/v3/users/afb251a9af9a4e5b99e5cdd71c34f147` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:39.361006 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00888132-647a-4794-ad89-5d99f20332f3 None admin] RBAC: Authorizing `identity:get_user(user_id=afb251a9af9a4e5b99e5cdd71c34f147)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:39.362487 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00888132-647a-4794-ad89-5d99f20332f3 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:39.364116 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 55/111] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:12:39 2022] GET /identity/v3/users/afb251a9af9a4e5b99e5cdd71c34f147 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:39.369461 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00888132-647a-4794-ad89-5d99f20332f3 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:39.370285 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aff506-354b-4758-a3fc-3c9d8add80ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:39.370955 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aff506-354b-4758-a3fc-3c9d8add80ff None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:39.371245 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aff506-354b-4758-a3fc-3c9d8add80ff None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:39.371527 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aff506-354b-4758-a3fc-3c9d8add80ff None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:39.372238 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aff506-354b-4758-a3fc-3c9d8add80ff None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:39.373675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aff506-354b-4758-a3fc-3c9d8add80ff None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:39.404839 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 57/112] 10.222.0.32 () {60 vars in 1141 bytes} [Wed Jun 1 04:12:39 2022] POST /identity/v3/projects => generated 302 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:12:39.404839 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6136c90-e406-4a8c-85e1-97799ed9c45f None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:39.404839 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6136c90-e406-4a8c-85e1-97799ed9c45f None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:39.404839 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6136c90-e406-4a8c-85e1-97799ed9c45f None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:39.404839 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 58/113] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:12:39.404839 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8893e-f639-4b0b-b217-2628ab9c5e79 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:39.404839 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8893e-f639-4b0b-b217-2628ab9c5e79 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:39.405418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8893e-f639-4b0b-b217-2628ab9c5e79 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:39.406314 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 59/114] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:12:39.407107 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8893e-f639-4b0b-b217-2628ab9c5e79 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:39.466368 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:39.485229 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00888132-647a-4794-ad89-5d99f20332f3 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:39.526317 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd537764-4ae2-466c-a539-a02860483169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:39.527212 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd537764-4ae2-466c-a539-a02860483169 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:39.527502 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd537764-4ae2-466c-a539-a02860483169 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:39.527784 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd537764-4ae2-466c-a539-a02860483169 None admin] PATH_INFO: `/v3/users/653d6b8edb364971ad27e90fc59177ac` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:39.543601 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd537764-4ae2-466c-a539-a02860483169 None admin] RBAC: Authorizing `identity:get_user(user_id=653d6b8edb364971ad27e90fc59177ac)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:39.545322 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd537764-4ae2-466c-a539-a02860483169 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:39.547367 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 56/115] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:12:39 2022] GET /identity/v3/users/653d6b8edb364971ad27e90fc59177ac => generated 289 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:39.547991 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd537764-4ae2-466c-a539-a02860483169 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:39.553077 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:39.558828 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8893e-f639-4b0b-b217-2628ab9c5e79 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:39.607188 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febfd0b-eaca-46dd-917b-35b27f907cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:39.607983 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febfd0b-eaca-46dd-917b-35b27f907cbf None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:39.608268 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febfd0b-eaca-46dd-917b-35b27f907cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:39.608542 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febfd0b-eaca-46dd-917b-35b27f907cbf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:39.621331 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9febfd0b-eaca-46dd-917b-35b27f907cbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:12:39.629020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-9febfd0b-eaca-46dd-917b-35b27f907cbf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:12:39.629020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:12:39.629020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:12:39.629020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:12:39.629020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:12:39.629020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:12:39.629020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:12:39.629020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:12:39.629020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:12:39.629020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:12:39.629020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:12:39.629020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:12:39.629020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:12:39.629020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:12:39.629020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:12:39.629020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:12:39.630030 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:12:39.630030 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:12:39.630030 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:12:39.630030 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:12:39.630030 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:12:39.630030 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:12:39.630030 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:12:39.630030 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:12:39.630030 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:12:39.630030 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:12:39.630030 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:12:39.630030 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:12:39.630030 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:12:39.630030 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:12:39.630030 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:12:39.630030 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:12:39.630802 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:12:39.630802 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:12:39.630802 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:12:39.630802 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:12:39.630802 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:12:39.630802 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:12:39.630802 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:12:39.630802 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:12:39.630802 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:12:39.630802 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:12:39.630802 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:12:39.630802 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:12:39.631396 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 60/116] 10.222.0.32 () {56 vars in 1096 bytes} [Wed Jun 1 04:12:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:12:39.632031 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2febe95-b595-4ce8-8397-c5659f4186f3 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:39.632315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2febe95-b595-4ce8-8397-c5659f4186f3 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:39.632597 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2febe95-b595-4ce8-8397-c5659f4186f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:39.658270 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-f2febe95-b595-4ce8-8397-c5659f4186f3 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:39.659584 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f2febe95-b595-4ce8-8397-c5659f4186f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:39.674076 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd537764-4ae2-466c-a539-a02860483169 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:39.712982 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc85485-f56e-4b92-8647-a80f70cc2874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:39.713851 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc85485-f56e-4b92-8647-a80f70cc2874 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:39.714220 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc85485-f56e-4b92-8647-a80f70cc2874 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:39.714502 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc85485-f56e-4b92-8647-a80f70cc2874 None admin] PATH_INFO: `/v3/projects/51115e4840444ed8aa7f060448c5cc92` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:39.715626 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc85485-f56e-4b92-8647-a80f70cc2874 None admin] RBAC: Authorizing `identity:get_project(project_id=51115e4840444ed8aa7f060448c5cc92)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:39.717132 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc85485-f56e-4b92-8647-a80f70cc2874 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:39.723485 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 57/117] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:12:39 2022] GET /identity/v3/projects/51115e4840444ed8aa7f060448c5cc92 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:39.723485 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f27087-54af-421c-9035-13675a6ed71c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:39.723485 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f27087-54af-421c-9035-13675a6ed71c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:39.723485 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f27087-54af-421c-9035-13675a6ed71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:39.739687 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-05f27087-54af-421c-9035-13675a6ed71c None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:39.740945 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-05f27087-54af-421c-9035-13675a6ed71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:39.742984 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 61/118] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:12:39.743700 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2febe95-b595-4ce8-8397-c5659f4186f3 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:39.751048 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:39.826324 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 58/119] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:12:39.827183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f27087-54af-421c-9035-13675a6ed71c None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:39.854720 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:39.864323 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2febe95-b595-4ce8-8397-c5659f4186f3 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:39.901113 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9bbec-9cac-4ed8-a068-707237e41dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:39.901772 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9bbec-9cac-4ed8-a068-707237e41dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:39.902090 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9bbec-9cac-4ed8-a068-707237e41dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:39.902377 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9bbec-9cac-4ed8-a068-707237e41dc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:39.939582 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f27087-54af-421c-9035-13675a6ed71c None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:39.975955 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4449c-babb-4fc9-849b-a7ab50da0053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:39.976548 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4449c-babb-4fc9-849b-a7ab50da0053 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:39.976842 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4449c-babb-4fc9-849b-a7ab50da0053 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:39.977169 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4449c-babb-4fc9-849b-a7ab50da0053 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:39.977613 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9bbec-9cac-4ed8-a068-707237e41dc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:39.977924 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f4449c-babb-4fc9-849b-a7ab50da0053 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:39.978265 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f4449c-babb-4fc9-849b-a7ab50da0053 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:39.979115 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9bbec-9cac-4ed8-a068-707237e41dc0 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:39.979703 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f4449c-babb-4fc9-849b-a7ab50da0053 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:39.988444 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 59/120] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:12:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:39.989050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4449c-babb-4fc9-849b-a7ab50da0053 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:39.991879 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:40.075520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:40.095114 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 62/121] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:12:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 04:12:40.095114 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9bbec-9cac-4ed8-a068-707237e41dc0 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:40.109410 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4449c-babb-4fc9-849b-a7ab50da0053 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:40.145442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd274b2-1707-453c-bc01-1317668f55c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:40.146381 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd274b2-1707-453c-bc01-1317668f55c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:40.146676 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd274b2-1707-453c-bc01-1317668f55c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:40.146958 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd274b2-1707-453c-bc01-1317668f55c3 None admin] PATH_INFO: `/v3/projects/51115e4840444ed8aa7f060448c5cc92/users/afb251a9af9a4e5b99e5cdd71c34f147/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:40.149589 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd274b2-1707-453c-bc01-1317668f55c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=51115e4840444ed8aa7f060448c5cc92, user_id=afb251a9af9a4e5b99e5cdd71c34f147, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:40.151111 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd274b2-1707-453c-bc01-1317668f55c3 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:40.166082 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 60/122] 10.222.0.32 () {58 vars in 1439 bytes} [Wed Jun 1 04:12:39 2022] PUT /identity/v3/projects/51115e4840444ed8aa7f060448c5cc92/users/afb251a9af9a4e5b99e5cdd71c34f147/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:12:40.166912 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd274b2-1707-453c-bc01-1317668f55c3 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:40.235051 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9bbec-9cac-4ed8-a068-707237e41dc0 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:40.243776 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:40.288254 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e12a0-ae7f-47be-bf64-d6ab26d2105c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:40.290434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e12a0-ae7f-47be-bf64-d6ab26d2105c None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:40.290904 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e12a0-ae7f-47be-bf64-d6ab26d2105c None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:40.291329 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e12a0-ae7f-47be-bf64-d6ab26d2105c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:40.292339 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd274b2-1707-453c-bc01-1317668f55c3 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:40.307135 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e12a0-ae7f-47be-bf64-d6ab26d2105c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:12:40.318217 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-eb6e12a0-ae7f-47be-bf64-d6ab26d2105c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 01 04:12:40.318217 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:12:40.318217 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:12:40.318217 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:12:40.318217 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:12:40.318217 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:12:40.318217 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:12:40.318217 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:12:40.318217 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:12:40.318217 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:12:40.318217 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:12:40.318217 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:12:40.318217 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:12:40.318217 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:12:40.318217 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:12:40.318217 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:12:40.319605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:12:40.319605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:12:40.319605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:12:40.319605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:12:40.319605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:12:40.319605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:12:40.319605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:12:40.319605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:12:40.319605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:12:40.319605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:12:40.319605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:12:40.319605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:12:40.319605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:12:40.319605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:12:40.319605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:12:40.319605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:12:40.320544 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:12:40.320544 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:12:40.320544 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:12:40.320544 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:12:40.320544 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:12:40.320544 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:12:40.320544 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:12:40.320544 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:12:40.320544 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:12:40.320544 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:12:40.320544 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 01 04:12:40.320544 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:12:40.324196 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 63/123] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:12:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:12:40.325555 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e12a0-ae7f-47be-bf64-d6ab26d2105c None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:40.335861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e641ee5-3d93-405a-b0cd-4e3122d1ff3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:40.337433 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e641ee5-3d93-405a-b0cd-4e3122d1ff3f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:40.337824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e641ee5-3d93-405a-b0cd-4e3122d1ff3f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:40.338256 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e641ee5-3d93-405a-b0cd-4e3122d1ff3f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:40.351365 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e641ee5-3d93-405a-b0cd-4e3122d1ff3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:12:40.360601 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-4e641ee5-3d93-405a-b0cd-4e3122d1ff3f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 04:12:40.360601 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:12:40.360601 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:12:40.360601 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:12:40.360601 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:12:40.360601 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:12:40.360601 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:12:40.360601 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:12:40.360601 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:12:40.360601 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:12:40.360601 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:12:40.360601 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:12:40.360601 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:12:40.360601 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:12:40.360601 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:12:40.360601 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:12:40.361744 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:12:40.361744 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:12:40.361744 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:12:40.361744 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:12:40.361744 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:12:40.361744 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:12:40.361744 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:12:40.361744 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:12:40.361744 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:12:40.361744 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:12:40.361744 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:12:40.361744 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:12:40.361744 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:12:40.361744 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:12:40.361744 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:12:40.361744 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:12:40.362750 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:12:40.362750 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:12:40.362750 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:12:40.362750 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:12:40.362750 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:12:40.362750 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:12:40.362750 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:12:40.362750 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:12:40.362750 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:12:40.362750 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:12:40.362750 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 04:12:40.362750 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:12:40.364584 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 61/124] 10.222.0.32 () {56 vars in 1114 bytes} [Wed Jun 1 04:12:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:12:40.365386 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e641ee5-3d93-405a-b0cd-4e3122d1ff3f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:40.410387 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:40.456010 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e12a0-ae7f-47be-bf64-d6ab26d2105c None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:40.491449 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281beb4d-b846-436b-a9c7-72044806bb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:40.492347 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281beb4d-b846-436b-a9c7-72044806bb45 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:40.493179 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281beb4d-b846-436b-a9c7-72044806bb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:40.493470 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281beb4d-b846-436b-a9c7-72044806bb45 None admin] PATH_INFO: `/v3/users/9d7c60c25057425ca69e91e85691a580` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:40.494724 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281beb4d-b846-436b-a9c7-72044806bb45 None admin] RBAC: Authorizing `identity:get_user(user_id=9d7c60c25057425ca69e91e85691a580)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:40.496275 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281beb4d-b846-436b-a9c7-72044806bb45 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:40.498413 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 64/125] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:12:40 2022] GET /identity/v3/users/9d7c60c25057425ca69e91e85691a580 => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:40.499331 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281beb4d-b846-436b-a9c7-72044806bb45 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:40.502055 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e641ee5-3d93-405a-b0cd-4e3122d1ff3f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:40.532050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:40.547258 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba034432-8df5-4a65-a6dc-b7373057bccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:40.548301 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba034432-8df5-4a65-a6dc-b7373057bccd None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:40.548589 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba034432-8df5-4a65-a6dc-b7373057bccd None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:40.549244 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba034432-8df5-4a65-a6dc-b7373057bccd None admin] PATH_INFO: `/v3/projects/51115e4840444ed8aa7f060448c5cc92` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:40.550789 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba034432-8df5-4a65-a6dc-b7373057bccd None admin] RBAC: Authorizing `identity:get_project(project_id=51115e4840444ed8aa7f060448c5cc92)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:40.552695 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba034432-8df5-4a65-a6dc-b7373057bccd None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:40.554433 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 62/126] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:12:40 2022] GET /identity/v3/projects/51115e4840444ed8aa7f060448c5cc92 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:40.555245 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba034432-8df5-4a65-a6dc-b7373057bccd None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:40.609752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281beb4d-b846-436b-a9c7-72044806bb45 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:40.627249 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:40.657408 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2dfa9-88e9-49f1-b2c7-a229aabdfc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:40.658119 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2dfa9-88e9-49f1-b2c7-a229aabdfc9a None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:40.658411 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2dfa9-88e9-49f1-b2c7-a229aabdfc9a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:40.658698 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2dfa9-88e9-49f1-b2c7-a229aabdfc9a None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:40.659460 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2dfa9-88e9-49f1-b2c7-a229aabdfc9a None admin] RBAC: Adding query filter params (name=member) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:40.659773 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2dfa9-88e9-49f1-b2c7-a229aabdfc9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:40.661166 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2dfa9-88e9-49f1-b2c7-a229aabdfc9a None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:40.678629 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 65/127] 10.222.0.32 () {56 vars in 1101 bytes} [Wed Jun 1 04:12:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:40.679568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2dfa9-88e9-49f1-b2c7-a229aabdfc9a None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:40.691526 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba034432-8df5-4a65-a6dc-b7373057bccd None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:40.729473 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae880bf-dec9-40d1-a0a2-80e5620d2346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:40.730346 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae880bf-dec9-40d1-a0a2-80e5620d2346 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:40.730738 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae880bf-dec9-40d1-a0a2-80e5620d2346 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:40.731157 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae880bf-dec9-40d1-a0a2-80e5620d2346 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:40.732094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae880bf-dec9-40d1-a0a2-80e5620d2346 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:40.732509 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae880bf-dec9-40d1-a0a2-80e5620d2346 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:40.734091 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae880bf-dec9-40d1-a0a2-80e5620d2346 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:40.743105 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 63/128] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:12:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:40.744039 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae880bf-dec9-40d1-a0a2-80e5620d2346 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:40.802158 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:40.820652 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2dfa9-88e9-49f1-b2c7-a229aabdfc9a None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:40.857628 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae880bf-dec9-40d1-a0a2-80e5620d2346 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:40.866784 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03daca-0624-405b-8207-774dd819e3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:40.868158 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03daca-0624-405b-8207-774dd819e3b6 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:40.868448 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03daca-0624-405b-8207-774dd819e3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:40.868735 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03daca-0624-405b-8207-774dd819e3b6 None admin] PATH_INFO: `/v3/projects/51115e4840444ed8aa7f060448c5cc92` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:40.870651 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a03daca-0624-405b-8207-774dd819e3b6 None admin] RBAC: Authorizing `identity:get_project(project_id=51115e4840444ed8aa7f060448c5cc92)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:40.872386 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a03daca-0624-405b-8207-774dd819e3b6 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:40.874864 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 66/129] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:12:40 2022] GET /identity/v3/projects/51115e4840444ed8aa7f060448c5cc92 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:40.875948 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03daca-0624-405b-8207-774dd819e3b6 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:40.896473 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df98ee-9ae6-4aa1-b80e-c50db4eade06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:40.897139 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df98ee-9ae6-4aa1-b80e-c50db4eade06 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:40.897431 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df98ee-9ae6-4aa1-b80e-c50db4eade06 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:40.897714 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df98ee-9ae6-4aa1-b80e-c50db4eade06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:40.898705 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df98ee-9ae6-4aa1-b80e-c50db4eade06 None admin] RBAC: Adding query filter params (role.id=7b78e36083484a9a810a37da3f18974b, scope.project.id=51115e4840444ed8aa7f060448c5cc92, user.id=653d6b8edb364971ad27e90fc59177ac) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:40.899138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df98ee-9ae6-4aa1-b80e-c50db4eade06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:40.900703 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df98ee-9ae6-4aa1-b80e-c50db4eade06 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:40.906935 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 64/130] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:12:40 2022] GET /identity/v3/role_assignments?user.id=653d6b8edb364971ad27e90fc59177ac&scope.project.id=51115e4840444ed8aa7f060448c5cc92&role.id=7b78e36083484a9a810a37da3f18974b => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:40.907878 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df98ee-9ae6-4aa1-b80e-c50db4eade06 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:40.938632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:41.018974 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03daca-0624-405b-8207-774dd819e3b6 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:41.024948 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df98ee-9ae6-4aa1-b80e-c50db4eade06 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:41.043922 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:41.070457 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22336b9-5660-46b4-9ceb-b80f596e7b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:41.071538 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22336b9-5660-46b4-9ceb-b80f596e7b32 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:41.071892 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22336b9-5660-46b4-9ceb-b80f596e7b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:41.072245 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22336b9-5660-46b4-9ceb-b80f596e7b32 None admin] PATH_INFO: `/v3/users/afb251a9af9a4e5b99e5cdd71c34f147` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:41.075284 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22336b9-5660-46b4-9ceb-b80f596e7b32 None admin] RBAC: Authorizing `identity:get_user(user_id=afb251a9af9a4e5b99e5cdd71c34f147)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:41.076709 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22336b9-5660-46b4-9ceb-b80f596e7b32 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:41.079001 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 65/131] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:12:40 2022] GET /identity/v3/users/afb251a9af9a4e5b99e5cdd71c34f147 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:41.080498 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22336b9-5660-46b4-9ceb-b80f596e7b32 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:41.083547 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19defcf5-c778-43c4-a7c8-3ed023a35638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:41.084686 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19defcf5-c778-43c4-a7c8-3ed023a35638 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:41.084969 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19defcf5-c778-43c4-a7c8-3ed023a35638 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:41.085248 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19defcf5-c778-43c4-a7c8-3ed023a35638 None admin] PATH_INFO: `/v3/users/afb251a9af9a4e5b99e5cdd71c34f147` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:41.090934 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19defcf5-c778-43c4-a7c8-3ed023a35638 None admin] RBAC: Authorizing `identity:get_user(user_id=afb251a9af9a4e5b99e5cdd71c34f147)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:41.092463 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19defcf5-c778-43c4-a7c8-3ed023a35638 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:41.094532 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 67/132] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:12:40 2022] GET /identity/v3/users/afb251a9af9a4e5b99e5cdd71c34f147 => generated 275 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:41.095161 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19defcf5-c778-43c4-a7c8-3ed023a35638 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:41.245697 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19defcf5-c778-43c4-a7c8-3ed023a35638 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:41.262041 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:41.292847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774f29d-cb1c-448d-a264-bf6cdc350154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:41.293650 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774f29d-cb1c-448d-a264-bf6cdc350154 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:41.293937 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774f29d-cb1c-448d-a264-bf6cdc350154 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:41.294694 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774f29d-cb1c-448d-a264-bf6cdc350154 None admin] PATH_INFO: `/v3/projects/51115e4840444ed8aa7f060448c5cc92` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:41.295930 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774f29d-cb1c-448d-a264-bf6cdc350154 None admin] RBAC: Authorizing `identity:get_project(project_id=51115e4840444ed8aa7f060448c5cc92)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:41.297805 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774f29d-cb1c-448d-a264-bf6cdc350154 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:41.300077 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 68/133] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:12:41 2022] GET /identity/v3/projects/51115e4840444ed8aa7f060448c5cc92 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:41.301014 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774f29d-cb1c-448d-a264-bf6cdc350154 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:41.303619 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22336b9-5660-46b4-9ceb-b80f596e7b32 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:41.390803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116a003-4256-4562-9600-4124b0b5a695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:41.392992 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116a003-4256-4562-9600-4124b0b5a695 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:41.394066 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116a003-4256-4562-9600-4124b0b5a695 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:41.396020 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116a003-4256-4562-9600-4124b0b5a695 None admin] PATH_INFO: `/v3/projects/51115e4840444ed8aa7f060448c5cc92/users/9d7c60c25057425ca69e91e85691a580/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:41.401346 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116a003-4256-4562-9600-4124b0b5a695 None admin] RBAC: Authorizing `identity:create_grant(project_id=51115e4840444ed8aa7f060448c5cc92, user_id=9d7c60c25057425ca69e91e85691a580, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:41.403423 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116a003-4256-4562-9600-4124b0b5a695 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:41.431595 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 66/134] 10.222.0.32 () {58 vars in 1439 bytes} [Wed Jun 1 04:12:41 2022] PUT /identity/v3/projects/51115e4840444ed8aa7f060448c5cc92/users/9d7c60c25057425ca69e91e85691a580/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:12:41.432800 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116a003-4256-4562-9600-4124b0b5a695 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:41.504197 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:41.517549 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774f29d-cb1c-448d-a264-bf6cdc350154 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:41.580712 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116a003-4256-4562-9600-4124b0b5a695 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:41.621691 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6fc95-fac0-4abe-a532-b2668ec21a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:41.622642 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6fc95-fac0-4abe-a532-b2668ec21a67 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:41.622931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6fc95-fac0-4abe-a532-b2668ec21a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:41.623239 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6fc95-fac0-4abe-a532-b2668ec21a67 None admin] PATH_INFO: `/v3/projects/51115e4840444ed8aa7f060448c5cc92/users/afb251a9af9a4e5b99e5cdd71c34f147/roles/71e70e8fe1344699a131764a348d51d6` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:41.625836 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6fc95-fac0-4abe-a532-b2668ec21a67 None admin] RBAC: Authorizing `identity:create_grant(project_id=51115e4840444ed8aa7f060448c5cc92, user_id=afb251a9af9a4e5b99e5cdd71c34f147, role_id=71e70e8fe1344699a131764a348d51d6)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:41.627776 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6fc95-fac0-4abe-a532-b2668ec21a67 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:41.634701 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b781b03-177f-4d86-a6b6-6aee2198c0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:41.635866 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b781b03-177f-4d86-a6b6-6aee2198c0fb None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:41.636346 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b781b03-177f-4d86-a6b6-6aee2198c0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:41.636810 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b781b03-177f-4d86-a6b6-6aee2198c0fb None admin] PATH_INFO: `/v3/projects/5ea64b356593434d818d39850efe108a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:41.638328 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b781b03-177f-4d86-a6b6-6aee2198c0fb None admin] RBAC: Authorizing `identity:get_project(project_id=5ea64b356593434d818d39850efe108a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:41.639956 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b781b03-177f-4d86-a6b6-6aee2198c0fb None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:41.641906 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 69/135] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:12:41 2022] GET /identity/v3/projects/5ea64b356593434d818d39850efe108a => generated 312 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:41.648751 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 67/136] 10.222.0.32 () {58 vars in 1439 bytes} [Wed Jun 1 04:12:41 2022] PUT /identity/v3/projects/51115e4840444ed8aa7f060448c5cc92/users/afb251a9af9a4e5b99e5cdd71c34f147/roles/71e70e8fe1344699a131764a348d51d6 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:12:41.652202 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b781b03-177f-4d86-a6b6-6aee2198c0fb None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:41.739408 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:41.803512 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b781b03-177f-4d86-a6b6-6aee2198c0fb None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:41.852342 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32774462-a831-47eb-9f76-f6230505afb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:41.853667 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32774462-a831-47eb-9f76-f6230505afb9 None admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:41.854177 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32774462-a831-47eb-9f76-f6230505afb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:41.854650 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32774462-a831-47eb-9f76-f6230505afb9 None admin] PATH_INFO: `/v3/projects/5ea64b356593434d818d39850efe108a/users/afb251a9af9a4e5b99e5cdd71c34f147/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:41.862936 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32774462-a831-47eb-9f76-f6230505afb9 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ea64b356593434d818d39850efe108a, user_id=afb251a9af9a4e5b99e5cdd71c34f147, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:41.864771 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32774462-a831-47eb-9f76-f6230505afb9 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:41.885917 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 70/137] 10.222.0.32 () {58 vars in 1439 bytes} [Wed Jun 1 04:12:41 2022] PUT /identity/v3/projects/5ea64b356593434d818d39850efe108a/users/afb251a9af9a4e5b99e5cdd71c34f147/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:12:42.185052 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c174080-8022-4ac3-89d6-7c596d1936e4 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:42.185362 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c174080-8022-4ac3-89d6-7c596d1936e4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:42.185622 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c174080-8022-4ac3-89d6-7c596d1936e4 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:42.187182 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 68/138] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:12:42.192816 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138abad-1453-476e-80e8-63c619d0444c None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:42.193356 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138abad-1453-476e-80e8-63c619d0444c None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:42.194132 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138abad-1453-476e-80e8-63c619d0444c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:42.223506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-6138abad-1453-476e-80e8-63c619d0444c None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:42.225030 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6138abad-1453-476e-80e8-63c619d0444c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:42.317073 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 71/139] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 04:12:42.355114 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c174080-8022-4ac3-89d6-7c596d1936e4 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:42.491543 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c174080-8022-4ac3-89d6-7c596d1936e4 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:42.499105 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:42.545629 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41409ae-5e68-420b-8570-96fa923a6cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:42.546479 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41409ae-5e68-420b-8570-96fa923a6cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:42.546770 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41409ae-5e68-420b-8570-96fa923a6cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:42.547051 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41409ae-5e68-420b-8570-96fa923a6cf2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:42.550725 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41409ae-5e68-420b-8570-96fa923a6cf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:42.552241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41409ae-5e68-420b-8570-96fa923a6cf2 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:42.553914 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 69/140] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:12:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:42.559576 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138abad-1453-476e-80e8-63c619d0444c None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:42.623410 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:42.704917 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138abad-1453-476e-80e8-63c619d0444c None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:42.752270 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7f23d-990e-4ad5-a1b8-d22f869ba544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:42.753308 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7f23d-990e-4ad5-a1b8-d22f869ba544 None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:42.753781 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7f23d-990e-4ad5-a1b8-d22f869ba544 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:42.754374 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7f23d-990e-4ad5-a1b8-d22f869ba544 None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:42.755414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7f23d-990e-4ad5-a1b8-d22f869ba544 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:42.757074 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7f23d-990e-4ad5-a1b8-d22f869ba544 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:42.781324 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 72/141] 10.222.0.32 () {60 vars in 1132 bytes} [Wed Jun 1 04:12:42 2022] POST /identity/v3/users => generated 283 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:12:43.222517 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ab924-fd13-43c3-b752-79c057874043 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:43.222998 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ab924-fd13-43c3-b752-79c057874043 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:43.223289 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ab924-fd13-43c3-b752-79c057874043 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:43.224683 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 70/142] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:12:43.238352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b522ae2-0933-42e9-9f17-f7928868b9ef None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:43.238929 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b522ae2-0933-42e9-9f17-f7928868b9ef None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:43.239407 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b522ae2-0933-42e9-9f17-f7928868b9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:43.263031 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-7b522ae2-0933-42e9-9f17-f7928868b9ef None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:43.264541 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7b522ae2-0933-42e9-9f17-f7928868b9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:43.343304 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 73/143] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:12:43.370655 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ab924-fd13-43c3-b752-79c057874043 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:43.510137 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ab924-fd13-43c3-b752-79c057874043 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:43.558265 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1892e4-6f08-43e2-bb87-14c085e2e23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:43.559453 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1892e4-6f08-43e2-bb87-14c085e2e23a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:43.559928 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1892e4-6f08-43e2-bb87-14c085e2e23a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:43.560390 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1892e4-6f08-43e2-bb87-14c085e2e23a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:43.576821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1892e4-6f08-43e2-bb87-14c085e2e23a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:12:43.584949 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-df1892e4-6f08-43e2-bb87-14c085e2e23a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 01 04:12:43.584949 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:12:43.584949 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:12:43.584949 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:12:43.584949 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:12:43.584949 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:12:43.584949 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:12:43.584949 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:12:43.584949 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:12:43.584949 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:12:43.584949 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:12:43.584949 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:12:43.584949 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:12:43.584949 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:12:43.584949 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:12:43.584949 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:12:43.585884 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:12:43.585884 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:12:43.585884 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:12:43.585884 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:12:43.585884 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:12:43.585884 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:12:43.585884 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:12:43.585884 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:12:43.585884 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:12:43.585884 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:12:43.585884 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:12:43.585884 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:12:43.585884 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:12:43.585884 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:12:43.585884 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:12:43.585884 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:12:43.587289 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:12:43.587289 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:12:43.587289 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:12:43.587289 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:12:43.587289 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:12:43.587289 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:12:43.587289 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:12:43.587289 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:12:43.587289 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:12:43.587289 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:12:43.587289 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 01 04:12:43.587289 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:12:43.589903 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 71/144] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:12:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:12:43.596551 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b522ae2-0933-42e9-9f17-f7928868b9ef None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:43.630708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:43.712383 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b522ae2-0933-42e9-9f17-f7928868b9ef None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:43.752012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce371c-caca-4b34-81b0-42008182a2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:43.752679 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce371c-caca-4b34-81b0-42008182a2fe None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:43.752958 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce371c-caca-4b34-81b0-42008182a2fe None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:43.753231 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce371c-caca-4b34-81b0-42008182a2fe None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:43.753993 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce371c-caca-4b34-81b0-42008182a2fe None admin] RBAC: Adding query filter params (name=member) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:43.754296 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce371c-caca-4b34-81b0-42008182a2fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:43.755678 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce371c-caca-4b34-81b0-42008182a2fe None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:43.769710 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 74/145] 10.222.0.32 () {56 vars in 1101 bytes} [Wed Jun 1 04:12:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:43.776102 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1892e4-6f08-43e2-bb87-14c085e2e23a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:43.810800 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:43.887823 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1892e4-6f08-43e2-bb87-14c085e2e23a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:43.929662 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072db69a-39f1-456f-a070-d4cbc64e4978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:43.931121 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072db69a-39f1-456f-a070-d4cbc64e4978 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:43.931409 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072db69a-39f1-456f-a070-d4cbc64e4978 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:43.931683 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072db69a-39f1-456f-a070-d4cbc64e4978 None admin] PATH_INFO: `/v3/users/afb251a9af9a4e5b99e5cdd71c34f147` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:43.932946 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072db69a-39f1-456f-a070-d4cbc64e4978 None admin] RBAC: Authorizing `identity:get_user(user_id=afb251a9af9a4e5b99e5cdd71c34f147)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:43.934578 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072db69a-39f1-456f-a070-d4cbc64e4978 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:43.936235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 72/146] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:12:43 2022] GET /identity/v3/users/afb251a9af9a4e5b99e5cdd71c34f147 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:43.941731 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce371c-caca-4b34-81b0-42008182a2fe None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:44.004533 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98e6c8-89bd-4561-a0ab-770011daf38b None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:44.004836 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98e6c8-89bd-4561-a0ab-770011daf38b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:44.005093 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98e6c8-89bd-4561-a0ab-770011daf38b None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:44.006479 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 73/147] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:12:44.014988 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5886a3e-c5b2-4513-84cd-5472eec3bb2e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:44.015273 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5886a3e-c5b2-4513-84cd-5472eec3bb2e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:44.015548 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5886a3e-c5b2-4513-84cd-5472eec3bb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:44.036864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b5886a3e-c5b2-4513-84cd-5472eec3bb2e None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:44.037985 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b5886a3e-c5b2-4513-84cd-5472eec3bb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:44.073685 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:44.097172 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce371c-caca-4b34-81b0-42008182a2fe None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:44.173876 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2068a79f-152e-4d44-90a4-a5286d1b386e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:44.174626 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068a79f-152e-4d44-90a4-a5286d1b386e None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:44.174914 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068a79f-152e-4d44-90a4-a5286d1b386e None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:44.175188 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068a79f-152e-4d44-90a4-a5286d1b386e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:44.177004 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 74/148] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 04:12:44.214753 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5886a3e-c5b2-4513-84cd-5472eec3bb2e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:44.268228 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2068a79f-152e-4d44-90a4-a5286d1b386e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:44.269710 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2068a79f-152e-4d44-90a4-a5286d1b386e None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:44.276517 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:44.401257 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5886a3e-c5b2-4513-84cd-5472eec3bb2e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:44.434799 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:44.455917 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 75/149] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:12:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 04:12:44.463257 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2068a79f-152e-4d44-90a4-a5286d1b386e None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:44.465826 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdbd97-068f-460f-a0d6-ffd8f9b626ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:44.466673 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdbd97-068f-460f-a0d6-ffd8f9b626ef None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:44.466959 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdbd97-068f-460f-a0d6-ffd8f9b626ef None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:44.467236 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdbd97-068f-460f-a0d6-ffd8f9b626ef None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:44.487673 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebdbd97-068f-460f-a0d6-ffd8f9b626ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:12:44.495715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-2ebdbd97-068f-460f-a0d6-ffd8f9b626ef None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 01 04:12:44.495715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:12:44.495715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:12:44.495715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:12:44.495715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:12:44.495715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:12:44.495715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:12:44.495715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:12:44.495715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:12:44.495715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:12:44.495715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:12:44.495715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:12:44.495715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:12:44.495715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:12:44.495715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:12:44.495715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:12:44.496586 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:12:44.496586 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:12:44.496586 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:12:44.496586 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:12:44.496586 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:12:44.496586 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:12:44.496586 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:12:44.496586 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:12:44.496586 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:12:44.496586 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:12:44.496586 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:12:44.496586 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:12:44.496586 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:12:44.496586 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:12:44.496586 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:12:44.496586 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:12:44.497338 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:12:44.497338 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:12:44.497338 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:12:44.497338 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:12:44.497338 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:12:44.497338 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:12:44.497338 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:12:44.497338 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:12:44.497338 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:12:44.497338 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:12:44.497338 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 01 04:12:44.497338 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:12:44.497338 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 75/150] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:12:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:12:44.502833 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdbd97-068f-460f-a0d6-ffd8f9b626ef None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:44.618179 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:44.630707 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdbd97-068f-460f-a0d6-ffd8f9b626ef None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:44.676871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a98e4-c30d-4b12-91a7-7e379a0afdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:44.677536 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a98e4-c30d-4b12-91a7-7e379a0afdc0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:44.677829 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a98e4-c30d-4b12-91a7-7e379a0afdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:44.678152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a98e4-c30d-4b12-91a7-7e379a0afdc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:44.678974 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a98e4-c30d-4b12-91a7-7e379a0afdc0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:44.679290 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a98e4-c30d-4b12-91a7-7e379a0afdc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:44.682270 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a98e4-c30d-4b12-91a7-7e379a0afdc0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:44.684398 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2068a79f-152e-4d44-90a4-a5286d1b386e None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:44.696137 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 76/151] 10.222.0.32 () {56 vars in 1101 bytes} [Wed Jun 1 04:12:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:12:44.702322 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a98e4-c30d-4b12-91a7-7e379a0afdc0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:44.766831 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55635589-4200-4054-ab79-0a1d24cd089f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:44.767727 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55635589-4200-4054-ab79-0a1d24cd089f None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:44.768015 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55635589-4200-4054-ab79-0a1d24cd089f None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:44.768299 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55635589-4200-4054-ab79-0a1d24cd089f None admin] PATH_INFO: `/v3/projects/51115e4840444ed8aa7f060448c5cc92` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:44.769602 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55635589-4200-4054-ab79-0a1d24cd089f None admin] RBAC: Authorizing `identity:get_project(project_id=51115e4840444ed8aa7f060448c5cc92)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:44.771080 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55635589-4200-4054-ab79-0a1d24cd089f None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:44.773154 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 76/152] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:12:44 2022] GET /identity/v3/projects/51115e4840444ed8aa7f060448c5cc92 => generated 298 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:44.783557 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55635589-4200-4054-ab79-0a1d24cd089f None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:44.886310 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a98e4-c30d-4b12-91a7-7e379a0afdc0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:44.920752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:44.954912 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074929c-6b4f-46ed-89ee-096980870bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:44.955733 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074929c-6b4f-46ed-89ee-096980870bde None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:44.956025 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074929c-6b4f-46ed-89ee-096980870bde None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:44.956306 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074929c-6b4f-46ed-89ee-096980870bde None admin] PATH_INFO: `/v3/users/653d6b8edb364971ad27e90fc59177ac` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:44.957570 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074929c-6b4f-46ed-89ee-096980870bde None admin] RBAC: Authorizing `identity:get_user(user_id=653d6b8edb364971ad27e90fc59177ac)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:44.959074 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074929c-6b4f-46ed-89ee-096980870bde None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:44.960730 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 77/153] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:12:44 2022] GET /identity/v3/users/653d6b8edb364971ad27e90fc59177ac => generated 289 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:12:44.967925 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074929c-6b4f-46ed-89ee-096980870bde None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:45.018339 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:45.043990 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55635589-4200-4054-ab79-0a1d24cd089f None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:45.150758 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf7bba-faa8-466a-94cb-2d0132e5fa96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:45.151432 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf7bba-faa8-466a-94cb-2d0132e5fa96 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:45.151717 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf7bba-faa8-466a-94cb-2d0132e5fa96 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:45.151994 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf7bba-faa8-466a-94cb-2d0132e5fa96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:45.152836 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf7bba-faa8-466a-94cb-2d0132e5fa96 None admin] RBAC: Adding query filter params (role.id=3f08ec4046094d04a533ba522f71ba9a, scope.project.id=51115e4840444ed8aa7f060448c5cc92, user.id=afb251a9af9a4e5b99e5cdd71c34f147) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:45.153150 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf7bba-faa8-466a-94cb-2d0132e5fa96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:45.155968 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf7bba-faa8-466a-94cb-2d0132e5fa96 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:45.172036 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 77/154] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:12:44 2022] GET /identity/v3/role_assignments?user.id=afb251a9af9a4e5b99e5cdd71c34f147&scope.project.id=51115e4840444ed8aa7f060448c5cc92&role.id=3f08ec4046094d04a533ba522f71ba9a => generated 608 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:12:45.181708 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074929c-6b4f-46ed-89ee-096980870bde None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:45.226308 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637fb40-5502-46a6-84c8-e89af31f83e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:45.227149 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637fb40-5502-46a6-84c8-e89af31f83e0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:45.227433 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637fb40-5502-46a6-84c8-e89af31f83e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:45.227708 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637fb40-5502-46a6-84c8-e89af31f83e0 None admin] PATH_INFO: `/v3/projects/51115e4840444ed8aa7f060448c5cc92` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:45.228909 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637fb40-5502-46a6-84c8-e89af31f83e0 None admin] RBAC: Authorizing `identity:get_project(project_id=51115e4840444ed8aa7f060448c5cc92)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:45.230388 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637fb40-5502-46a6-84c8-e89af31f83e0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:45.236640 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 78/155] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:12:44 2022] GET /identity/v3/projects/51115e4840444ed8aa7f060448c5cc92 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:12:45.237630 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf7bba-faa8-466a-94cb-2d0132e5fa96 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:45.375403 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf7bba-faa8-466a-94cb-2d0132e5fa96 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:45.402974 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:45.419494 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76140e-afe2-4808-99ff-033a3549a605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:45.420403 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76140e-afe2-4808-99ff-033a3549a605 None admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:45.420682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76140e-afe2-4808-99ff-033a3549a605 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:45.420960 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76140e-afe2-4808-99ff-033a3549a605 None admin] PATH_INFO: `/v3/projects/51115e4840444ed8aa7f060448c5cc92/users/653d6b8edb364971ad27e90fc59177ac/roles/7b78e36083484a9a810a37da3f18974b` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:45.425318 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef76140e-afe2-4808-99ff-033a3549a605 None admin] RBAC: Authorizing `identity:create_grant(project_id=51115e4840444ed8aa7f060448c5cc92, user_id=653d6b8edb364971ad27e90fc59177ac, role_id=7b78e36083484a9a810a37da3f18974b)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:45.426846 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef76140e-afe2-4808-99ff-033a3549a605 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:45.446722 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 78/156] 10.222.0.32 () {58 vars in 1439 bytes} [Wed Jun 1 04:12:45 2022] PUT /identity/v3/projects/51115e4840444ed8aa7f060448c5cc92/users/653d6b8edb364971ad27e90fc59177ac/roles/7b78e36083484a9a810a37da3f18974b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:12:45.498085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c9e97-86f9-4dcd-9a05-11c10a5203d2 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:45.498423 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c9e97-86f9-4dcd-9a05-11c10a5203d2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:45.498654 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c9e97-86f9-4dcd-9a05-11c10a5203d2 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:45.500572 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 79/157] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:12:45.506038 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f8695-0627-4cd3-bae8-85d448ef4927 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:45.506336 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f8695-0627-4cd3-bae8-85d448ef4927 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:45.506621 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f8695-0627-4cd3-bae8-85d448ef4927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:45.527095 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-0e0f8695-0627-4cd3-bae8-85d448ef4927 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:45.528419 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-0e0f8695-0627-4cd3-bae8-85d448ef4927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:45.604223 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 79/158] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:12:45.628662 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c9e97-86f9-4dcd-9a05-11c10a5203d2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:45.740633 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:45.760162 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c9e97-86f9-4dcd-9a05-11c10a5203d2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:45.798530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e21729-ff4b-4ab9-a017-663471274f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:45.799392 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e21729-ff4b-4ab9-a017-663471274f88 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:45.799683 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e21729-ff4b-4ab9-a017-663471274f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:45.799960 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e21729-ff4b-4ab9-a017-663471274f88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:45.815135 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e21729-ff4b-4ab9-a017-663471274f88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:12:45.823999 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-d4e21729-ff4b-4ab9-a017-663471274f88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:12:45.823999 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:12:45.823999 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:12:45.823999 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:12:45.823999 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:12:45.823999 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:12:45.823999 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:12:45.823999 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:12:45.823999 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:12:45.823999 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:12:45.823999 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:12:45.823999 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:12:45.823999 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:12:45.823999 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:12:45.823999 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:12:45.823999 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:12:45.824944 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:12:45.824944 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:12:45.824944 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:12:45.824944 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:12:45.824944 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:12:45.824944 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:12:45.824944 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:12:45.824944 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:12:45.824944 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:12:45.824944 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:12:45.824944 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:12:45.824944 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:12:45.824944 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:12:45.824944 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:12:45.824944 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:12:45.824944 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:12:45.825742 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:12:45.825742 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:12:45.825742 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:12:45.825742 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:12:45.825742 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:12:45.825742 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:12:45.825742 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:12:45.825742 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:12:45.825742 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:12:45.825742 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:12:45.825742 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:12:45.825742 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:12:45.825742 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 80/159] 10.222.0.32 () {56 vars in 1096 bytes} [Wed Jun 1 04:12:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:12:45.833095 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f8695-0627-4cd3-bae8-85d448ef4927 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:45.934308 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61598b3-a9fb-49ea-8507-26f2c96019ba None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:45.934640 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61598b3-a9fb-49ea-8507-26f2c96019ba None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:45.934869 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61598b3-a9fb-49ea-8507-26f2c96019ba None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:45.936651 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 81/160] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:12:45.948430 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dedc54e-1f3b-4d1b-9a35-dfabecfd1614 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:45.948771 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dedc54e-1f3b-4d1b-9a35-dfabecfd1614 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:45.948981 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dedc54e-1f3b-4d1b-9a35-dfabecfd1614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:45.973880 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f8695-0627-4cd3-bae8-85d448ef4927 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:45.975783 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-1dedc54e-1f3b-4d1b-9a35-dfabecfd1614 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:45.977051 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1dedc54e-1f3b-4d1b-9a35-dfabecfd1614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:45.998300 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:46.044536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026b1ab-20a4-491b-8bb8-d4f5b9267ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:46.045135 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026b1ab-20a4-491b-8bb8-d4f5b9267ebf None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:46.045416 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026b1ab-20a4-491b-8bb8-d4f5b9267ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:46.045693 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026b1ab-20a4-491b-8bb8-d4f5b9267ebf None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:46.046479 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b026b1ab-20a4-491b-8bb8-d4f5b9267ebf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:46.047246 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b026b1ab-20a4-491b-8bb8-d4f5b9267ebf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:46.050643 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b026b1ab-20a4-491b-8bb8-d4f5b9267ebf None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:46.068165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 80/161] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:12:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:46.074842 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026b1ab-20a4-491b-8bb8-d4f5b9267ebf None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:46.136159 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 82/162] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 04:12:46.192092 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dedc54e-1f3b-4d1b-9a35-dfabecfd1614 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:46.202736 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026b1ab-20a4-491b-8bb8-d4f5b9267ebf None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:46.285415 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f2604d-6322-4f4e-8cc2-c62b0cc17ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:46.286325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2604d-6322-4f4e-8cc2-c62b0cc17ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:46.286611 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2604d-6322-4f4e-8cc2-c62b0cc17ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:46.286890 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2604d-6322-4f4e-8cc2-c62b0cc17ed2 None admin] PATH_INFO: `/v3/users/9d7c60c25057425ca69e91e85691a580` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:46.288099 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f2604d-6322-4f4e-8cc2-c62b0cc17ed2 None admin] RBAC: Authorizing `identity:get_user(user_id=9d7c60c25057425ca69e91e85691a580)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:46.289586 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f2604d-6322-4f4e-8cc2-c62b0cc17ed2 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:46.291261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 81/163] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:12:46 2022] GET /identity/v3/users/9d7c60c25057425ca69e91e85691a580 => generated 247 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:46.292435 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e611ad-1924-4297-b4c7-ad955759359b None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:46.292719 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e611ad-1924-4297-b4c7-ad955759359b None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:46.293005 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e611ad-1924-4297-b4c7-ad955759359b None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:46.302652 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 82/164] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:46 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:12:46.303387 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e611ad-1924-4297-b4c7-ad955759359b None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:46.394328 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:46.412610 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:46.439909 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dedc54e-1f3b-4d1b-9a35-dfabecfd1614 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:46.519475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaed13b-b335-4f87-aa4d-1e9450867af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:46.520188 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaed13b-b335-4f87-aa4d-1e9450867af0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:46.520476 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaed13b-b335-4f87-aa4d-1e9450867af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:46.520754 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaed13b-b335-4f87-aa4d-1e9450867af0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:46.546173 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaed13b-b335-4f87-aa4d-1e9450867af0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:12:46.554050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-fbaed13b-b335-4f87-aa4d-1e9450867af0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 01 04:12:46.554050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:12:46.554050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:12:46.554050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:12:46.554050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:12:46.554050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:12:46.554050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:12:46.554050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:12:46.554050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:12:46.554050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:12:46.554050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:12:46.554050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:12:46.554050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:12:46.554050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:12:46.554050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:12:46.554050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:12:46.555475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:12:46.555475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:12:46.555475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:12:46.555475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:12:46.555475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:12:46.555475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:12:46.555475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:12:46.555475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:12:46.555475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:12:46.555475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:12:46.555475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:12:46.555475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:12:46.555475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:12:46.555475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:12:46.555475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:12:46.555475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:12:46.556237 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:12:46.556237 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:12:46.556237 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:12:46.556237 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:12:46.556237 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:12:46.556237 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:12:46.556237 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:12:46.556237 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:12:46.556237 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:12:46.556237 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:12:46.556237 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 01 04:12:46.556237 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:12:46.567022 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 83/165] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:12:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:12:46.568325 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f89f8-cb48-4c12-877c-85e8f8eb0f94 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:46.568869 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f89f8-cb48-4c12-877c-85e8f8eb0f94 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:46.569151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f89f8-cb48-4c12-877c-85e8f8eb0f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:46.579591 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e611ad-1924-4297-b4c7-ad955759359b None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:46.611220 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2a8f89f8-cb48-4c12-877c-85e8f8eb0f94 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:46.612908 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2a8f89f8-cb48-4c12-877c-85e8f8eb0f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:46.684904 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4a97c-200d-4059-928b-ef23b5ff6fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:46.685585 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4a97c-200d-4059-928b-ef23b5ff6fdd None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:46.685875 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4a97c-200d-4059-928b-ef23b5ff6fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:46.686190 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4a97c-200d-4059-928b-ef23b5ff6fdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:46.723404 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 84/166] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:12:46.724354 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f89f8-cb48-4c12-877c-85e8f8eb0f94 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:46.854344 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4a97c-200d-4059-928b-ef23b5ff6fdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:46.856221 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4a97c-200d-4059-928b-ef23b5ff6fdd None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:46.915065 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:46.926361 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:47.008148 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f89f8-cb48-4c12-877c-85e8f8eb0f94 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:47.041839 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 83/167] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:12:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 739 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 04:12:47.043019 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4a97c-200d-4059-928b-ef23b5ff6fdd None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:47.103864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d27faf-6fc9-4a86-ba6e-b795dab64de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:47.104595 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d27faf-6fc9-4a86-ba6e-b795dab64de0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:47.104822 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d27faf-6fc9-4a86-ba6e-b795dab64de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:47.105099 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d27faf-6fc9-4a86-ba6e-b795dab64de0 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:47.105850 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d27faf-6fc9-4a86-ba6e-b795dab64de0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:47.106177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d27faf-6fc9-4a86-ba6e-b795dab64de0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:47.107564 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d27faf-6fc9-4a86-ba6e-b795dab64de0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:47.132101 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 85/168] 10.222.0.32 () {56 vars in 1101 bytes} [Wed Jun 1 04:12:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:47.132795 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d27faf-6fc9-4a86-ba6e-b795dab64de0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:47.229318 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4a97c-200d-4059-928b-ef23b5ff6fdd None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:47.296619 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154e498-6cab-4a02-94f5-0e72b7939e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:47.297466 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154e498-6cab-4a02-94f5-0e72b7939e8c None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:47.297741 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154e498-6cab-4a02-94f5-0e72b7939e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:47.298028 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154e498-6cab-4a02-94f5-0e72b7939e8c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:47.324278 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:47.329562 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154e498-6cab-4a02-94f5-0e72b7939e8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:12:47.343668 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d27faf-6fc9-4a86-ba6e-b795dab64de0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:47.344315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-1154e498-6cab-4a02-94f5-0e72b7939e8c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 04:12:47.344315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:12:47.344315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:12:47.344315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:12:47.344315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:12:47.344315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:12:47.344315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:12:47.344315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:12:47.344315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:12:47.344315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:12:47.344315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:12:47.344315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:12:47.344315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:12:47.344315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:12:47.344315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:12:47.344315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:12:47.345288 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:12:47.345288 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:12:47.345288 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:12:47.345288 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:12:47.345288 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:12:47.345288 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:12:47.345288 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:12:47.345288 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:12:47.345288 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:12:47.345288 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:12:47.345288 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:12:47.345288 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:12:47.345288 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:12:47.345288 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:12:47.345288 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:12:47.345288 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:12:47.346105 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:12:47.346105 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:12:47.346105 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:12:47.346105 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:12:47.346105 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:12:47.346105 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:12:47.346105 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:12:47.346105 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:12:47.346105 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:12:47.346105 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:12:47.346105 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 04:12:47.346105 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:12:47.346105 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 84/169] 10.222.0.32 () {56 vars in 1114 bytes} [Wed Jun 1 04:12:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:12:47.354535 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154e498-6cab-4a02-94f5-0e72b7939e8c None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:47.385253 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:47.399257 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b3234-4aba-468b-859a-19b3ba218335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:47.400147 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b3234-4aba-468b-859a-19b3ba218335 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:47.400431 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b3234-4aba-468b-859a-19b3ba218335 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:47.400705 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b3234-4aba-468b-859a-19b3ba218335 None admin] PATH_INFO: `/v3/projects/51115e4840444ed8aa7f060448c5cc92` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:47.401991 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b3234-4aba-468b-859a-19b3ba218335 None admin] RBAC: Authorizing `identity:get_project(project_id=51115e4840444ed8aa7f060448c5cc92)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:47.403440 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b3234-4aba-468b-859a-19b3ba218335 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:47.405140 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 86/170] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:12:47 2022] GET /identity/v3/projects/51115e4840444ed8aa7f060448c5cc92 => generated 298 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:47.405904 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b3234-4aba-468b-859a-19b3ba218335 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:47.527389 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154e498-6cab-4a02-94f5-0e72b7939e8c None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:47.582759 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b3234-4aba-468b-859a-19b3ba218335 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:47.585242 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b718bb56-d1c0-40b6-9143-2b2e8fb18e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:47.586691 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718bb56-d1c0-40b6-9143-2b2e8fb18e9d None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:47.586975 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718bb56-d1c0-40b6-9143-2b2e8fb18e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:47.587249 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718bb56-d1c0-40b6-9143-2b2e8fb18e9d None admin] PATH_INFO: `/v3/users/afb251a9af9a4e5b99e5cdd71c34f147` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:47.588561 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b718bb56-d1c0-40b6-9143-2b2e8fb18e9d None admin] RBAC: Authorizing `identity:get_user(user_id=afb251a9af9a4e5b99e5cdd71c34f147)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:47.590011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b718bb56-d1c0-40b6-9143-2b2e8fb18e9d None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:47.591648 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 85/171] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:12:47 2022] GET /identity/v3/users/afb251a9af9a4e5b99e5cdd71c34f147 => generated 275 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:47.592397 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b718bb56-d1c0-40b6-9143-2b2e8fb18e9d None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:47.654802 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d90e9d-c82b-4f27-8eaa-b534e27bdacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:47.655416 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d90e9d-c82b-4f27-8eaa-b534e27bdacb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:47.655702 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d90e9d-c82b-4f27-8eaa-b534e27bdacb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:47.655984 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d90e9d-c82b-4f27-8eaa-b534e27bdacb None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:47.656755 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d90e9d-c82b-4f27-8eaa-b534e27bdacb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:47.657065 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d90e9d-c82b-4f27-8eaa-b534e27bdacb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:47.658495 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d90e9d-c82b-4f27-8eaa-b534e27bdacb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:47.667146 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 87/172] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:12:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:47.668503 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e75ab2-4da1-460c-9220-4c956379fa77 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:47.668789 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e75ab2-4da1-460c-9220-4c956379fa77 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:47.669066 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e75ab2-4da1-460c-9220-4c956379fa77 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:47.670573 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 88/173] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:12:47.671282 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e75ab2-4da1-460c-9220-4c956379fa77 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:47.711578 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:47.776693 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b718bb56-d1c0-40b6-9143-2b2e8fb18e9d None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:47.802475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:47.844332 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ae10d-fbae-4afe-bda7-fb25a67cc5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:47.845339 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ae10d-fbae-4afe-bda7-fb25a67cc5e2 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:47.845824 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ae10d-fbae-4afe-bda7-fb25a67cc5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:47.846329 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ae10d-fbae-4afe-bda7-fb25a67cc5e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:47.847541 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ae10d-fbae-4afe-bda7-fb25a67cc5e2 None admin] RBAC: Adding query filter params (role.id=76fc054ad9544460a7be1e2010c23642, scope.project.id=51115e4840444ed8aa7f060448c5cc92, user.id=9d7c60c25057425ca69e91e85691a580) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:47.849300 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ae10d-fbae-4afe-bda7-fb25a67cc5e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:47.851379 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ae10d-fbae-4afe-bda7-fb25a67cc5e2 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:47.854506 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e75ab2-4da1-460c-9220-4c956379fa77 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:47.865834 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 86/174] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:12:47 2022] GET /identity/v3/role_assignments?user.id=9d7c60c25057425ca69e91e85691a580&scope.project.id=51115e4840444ed8aa7f060448c5cc92&role.id=76fc054ad9544460a7be1e2010c23642 => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:47.867935 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f16e4e-edd1-4d1a-8d02-d9d8cb79d2ba None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:47.868480 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f16e4e-edd1-4d1a-8d02-d9d8cb79d2ba None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:47.868957 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f16e4e-edd1-4d1a-8d02-d9d8cb79d2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:47.891034 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-15f16e4e-edd1-4d1a-8d02-d9d8cb79d2ba None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:47.892717 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-15f16e4e-edd1-4d1a-8d02-d9d8cb79d2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:47.920727 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819f0d7-8ac4-43ff-b241-e5058f7d754b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:47.922720 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819f0d7-8ac4-43ff-b241-e5058f7d754b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:47.923214 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819f0d7-8ac4-43ff-b241-e5058f7d754b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:47.923979 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819f0d7-8ac4-43ff-b241-e5058f7d754b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:48.050150 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 87/175] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:12:48.051372 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f16e4e-edd1-4d1a-8d02-d9d8cb79d2ba None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:48.080812 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819f0d7-8ac4-43ff-b241-e5058f7d754b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:48.082718 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819f0d7-8ac4-43ff-b241-e5058f7d754b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:48.169139 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:48.176974 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:48.214404 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f16e4e-edd1-4d1a-8d02-d9d8cb79d2ba None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:48.224463 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 89/176] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:12:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 04:12:48.225741 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819f0d7-8ac4-43ff-b241-e5058f7d754b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:48.255556 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de98bb-6b8e-490e-a6a1-c995a0c3d320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:48.256920 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de98bb-6b8e-490e-a6a1-c995a0c3d320 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:48.257214 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de98bb-6b8e-490e-a6a1-c995a0c3d320 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:48.257496 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de98bb-6b8e-490e-a6a1-c995a0c3d320 None admin] PATH_INFO: `/v3/users/afb251a9af9a4e5b99e5cdd71c34f147` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:48.259075 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de98bb-6b8e-490e-a6a1-c995a0c3d320 None admin] RBAC: Authorizing `identity:get_user(user_id=afb251a9af9a4e5b99e5cdd71c34f147)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:48.261236 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de98bb-6b8e-490e-a6a1-c995a0c3d320 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:48.263251 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 88/177] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:12:48 2022] GET /identity/v3/users/afb251a9af9a4e5b99e5cdd71c34f147 => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:48.270012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffff35-5947-4a3c-8fc8-4dae01a6b25e None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:48.270012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffff35-5947-4a3c-8fc8-4dae01a6b25e None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:48.270012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffff35-5947-4a3c-8fc8-4dae01a6b25e None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:48.270012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 89/178] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:12:48.270012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffff35-5947-4a3c-8fc8-4dae01a6b25e None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:48.353078 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819f0d7-8ac4-43ff-b241-e5058f7d754b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:48.401886 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149751f9-620b-4f7a-bbe1-1a0c56d00285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:48.403337 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149751f9-620b-4f7a-bbe1-1a0c56d00285 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:48.403815 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149751f9-620b-4f7a-bbe1-1a0c56d00285 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:48.404340 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149751f9-620b-4f7a-bbe1-1a0c56d00285 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:48.410616 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffff35-5947-4a3c-8fc8-4dae01a6b25e None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:48.424367 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149751f9-620b-4f7a-bbe1-1a0c56d00285 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:12:48.434937 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-149751f9-620b-4f7a-bbe1-1a0c56d00285 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:12:48.434937 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:12:48.434937 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:12:48.434937 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:12:48.434937 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:12:48.434937 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:12:48.434937 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:12:48.434937 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:12:48.434937 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:12:48.434937 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:12:48.434937 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:12:48.434937 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:12:48.434937 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:12:48.434937 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:12:48.434937 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:12:48.434937 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:12:48.435824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:12:48.435824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:12:48.435824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:12:48.435824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:12:48.435824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:12:48.435824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:12:48.435824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:12:48.435824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:12:48.435824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:12:48.435824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:12:48.435824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:12:48.435824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:12:48.435824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:12:48.435824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:12:48.435824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:12:48.435824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:12:48.436603 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:12:48.436603 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:12:48.436603 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:12:48.436603 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:12:48.436603 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:12:48.436603 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:12:48.436603 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:12:48.436603 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:12:48.436603 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:12:48.436603 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:12:48.436603 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:12:48.436603 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:12:48.436603 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 90/179] 10.222.0.32 () {56 vars in 1096 bytes} [Wed Jun 1 04:12:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:12:48.437264 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149751f9-620b-4f7a-bbe1-1a0c56d00285 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:48.453131 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:48.461903 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929c125-1e62-4c9c-8a82-cf7b2cf77aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:48.463280 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929c125-1e62-4c9c-8a82-cf7b2cf77aed None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:48.463714 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929c125-1e62-4c9c-8a82-cf7b2cf77aed None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:48.464395 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929c125-1e62-4c9c-8a82-cf7b2cf77aed None admin] PATH_INFO: `/v3/projects/5ea64b356593434d818d39850efe108a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:48.466200 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2929c125-1e62-4c9c-8a82-cf7b2cf77aed None admin] RBAC: Authorizing `identity:get_project(project_id=5ea64b356593434d818d39850efe108a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:48.468529 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:48.468790 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2929c125-1e62-4c9c-8a82-cf7b2cf77aed None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:48.472083 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 90/180] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:12:48 2022] GET /identity/v3/projects/5ea64b356593434d818d39850efe108a => generated 312 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:48.473650 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036a360-38c1-4d77-bf69-bb8bc2c335af None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:48.474147 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036a360-38c1-4d77-bf69-bb8bc2c335af None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:48.474436 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036a360-38c1-4d77-bf69-bb8bc2c335af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:48.494221 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-b036a360-38c1-4d77-bf69-bb8bc2c335af None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:48.495467 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-b036a360-38c1-4d77-bf69-bb8bc2c335af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:48.560033 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149751f9-620b-4f7a-bbe1-1a0c56d00285 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:48.566169 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 91/181] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:12:48.567500 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036a360-38c1-4d77-bf69-bb8bc2c335af None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:48.596620 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709b73c-837f-4b6a-b5ba-1e8d351f37a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:48.597273 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709b73c-837f-4b6a-b5ba-1e8d351f37a2 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:48.597557 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709b73c-837f-4b6a-b5ba-1e8d351f37a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:48.597833 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709b73c-837f-4b6a-b5ba-1e8d351f37a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:48.663556 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709b73c-837f-4b6a-b5ba-1e8d351f37a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:48.665580 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709b73c-837f-4b6a-b5ba-1e8d351f37a2 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:48.666351 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036a360-38c1-4d77-bf69-bb8bc2c335af None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:48.685313 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:48.693921 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:48.702182 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd1212-2175-4a2b-ab12-2eec9ecee357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:48.702861 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd1212-2175-4a2b-ab12-2eec9ecee357 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:48.703146 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd1212-2175-4a2b-ab12-2eec9ecee357 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:48.703419 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd1212-2175-4a2b-ab12-2eec9ecee357 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:48.704160 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd1212-2175-4a2b-ab12-2eec9ecee357 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:48.704461 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd1212-2175-4a2b-ab12-2eec9ecee357 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:48.705820 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd1212-2175-4a2b-ab12-2eec9ecee357 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:48.715062 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 92/182] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:12:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:48.715062 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67c968-f474-4444-8105-0e46ffe5cac4 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:48.715062 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67c968-f474-4444-8105-0e46ffe5cac4 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:48.715062 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67c968-f474-4444-8105-0e46ffe5cac4 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:48.715062 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 93/183] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:12:48.715062 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67c968-f474-4444-8105-0e46ffe5cac4 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:48.767069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 91/184] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:12:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 04:12:48.768648 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cfa0a-03b7-411e-9fd4-3cb8ec22543b None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:48.768944 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cfa0a-03b7-411e-9fd4-3cb8ec22543b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:48.769226 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cfa0a-03b7-411e-9fd4-3cb8ec22543b None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:48.770512 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 92/185] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:12:48.774769 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cfa0a-03b7-411e-9fd4-3cb8ec22543b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:48.837843 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67c968-f474-4444-8105-0e46ffe5cac4 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:48.883669 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa337cc6-39a4-4266-8092-9faeea137af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:48.884560 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa337cc6-39a4-4266-8092-9faeea137af6 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:48.885011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa337cc6-39a4-4266-8092-9faeea137af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:48.885705 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa337cc6-39a4-4266-8092-9faeea137af6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:48.887354 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa337cc6-39a4-4266-8092-9faeea137af6 None admin] RBAC: Adding query filter params (role.id=3f08ec4046094d04a533ba522f71ba9a, scope.project.id=5ea64b356593434d818d39850efe108a, user.id=afb251a9af9a4e5b99e5cdd71c34f147) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:48.887957 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa337cc6-39a4-4266-8092-9faeea137af6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:48.890779 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa337cc6-39a4-4266-8092-9faeea137af6 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:48.901102 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 94/186] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:12:48 2022] GET /identity/v3/role_assignments?user.id=afb251a9af9a4e5b99e5cdd71c34f147&scope.project.id=5ea64b356593434d818d39850efe108a&role.id=3f08ec4046094d04a533ba522f71ba9a => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:48.902161 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa337cc6-39a4-4266-8092-9faeea137af6 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:48.922632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cfa0a-03b7-411e-9fd4-3cb8ec22543b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:48.949105 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:48.964692 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358387a-7f87-48e6-a78a-7bae9328d1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:48.965556 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358387a-7f87-48e6-a78a-7bae9328d1ed None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:48.965838 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358387a-7f87-48e6-a78a-7bae9328d1ed None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:48.966144 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358387a-7f87-48e6-a78a-7bae9328d1ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:48.967049 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:48.978398 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e358387a-7f87-48e6-a78a-7bae9328d1ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:12:48.986710 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-e358387a-7f87-48e6-a78a-7bae9328d1ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 04:12:48.986710 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:12:48.986710 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:12:48.986710 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:12:48.986710 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:12:48.986710 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:12:48.986710 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:12:48.986710 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:12:48.986710 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:12:48.986710 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:12:48.986710 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:12:48.986710 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:12:48.986710 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:12:48.986710 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:12:48.986710 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:12:48.986710 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:12:48.987692 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:12:48.987692 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:12:48.987692 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:12:48.987692 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:12:48.987692 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:12:48.987692 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:12:48.987692 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:12:48.987692 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:12:48.987692 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:12:48.987692 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:12:48.987692 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:12:48.987692 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:12:48.987692 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:12:48.987692 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:12:48.987692 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:12:48.987692 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:12:48.994442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:12:48.994442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:12:48.994442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:12:48.994442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:12:48.994442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:12:48.994442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:12:48.994442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:12:48.994442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:12:48.994442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:12:48.994442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:12:48.994442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 04:12:48.994442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:12:48.994442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 93/187] 10.222.0.32 () {56 vars in 1114 bytes} [Wed Jun 1 04:12:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:12:48.994442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d4dc8-17c3-498f-b720-6f962c88fe68 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:48.995353 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d4dc8-17c3-498f-b720-6f962c88fe68 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:48.995353 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d4dc8-17c3-498f-b720-6f962c88fe68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:49.011865 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d87d4dc8-17c3-498f-b720-6f962c88fe68 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:49.013247 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d87d4dc8-17c3-498f-b720-6f962c88fe68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:49.021529 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa337cc6-39a4-4266-8092-9faeea137af6 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:49.060162 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba57037-383c-4966-96ff-e7b7954277c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:49.061051 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba57037-383c-4966-96ff-e7b7954277c6 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:49.061331 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba57037-383c-4966-96ff-e7b7954277c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:49.061604 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba57037-383c-4966-96ff-e7b7954277c6 None admin] PATH_INFO: `/v3/users/ff8ba619394c458fb8578d98a778789b` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:49.078271 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba57037-383c-4966-96ff-e7b7954277c6 None admin] RBAC: Authorizing `identity:get_user(user_id=ff8ba619394c458fb8578d98a778789b)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:49.079751 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba57037-383c-4966-96ff-e7b7954277c6 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:49.081534 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 95/188] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:12:48 2022] GET /identity/v3/users/ff8ba619394c458fb8578d98a778789b => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:49.082429 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba57037-383c-4966-96ff-e7b7954277c6 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:49.091068 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 94/189] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:12:49.092348 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea818a-4ba2-4eaa-9978-dc34c66ee6ae None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:49.092735 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea818a-4ba2-4eaa-9978-dc34c66ee6ae None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:49.093108 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea818a-4ba2-4eaa-9978-dc34c66ee6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:49.111717 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-54ea818a-4ba2-4eaa-9978-dc34c66ee6ae None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:49.113201 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-54ea818a-4ba2-4eaa-9978-dc34c66ee6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:49.198722 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 95/190] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:12:49.199630 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea818a-4ba2-4eaa-9978-dc34c66ee6ae None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:49.215193 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba57037-383c-4966-96ff-e7b7954277c6 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:49.228867 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:49.247604 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:49.250730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e792a9b-8ae2-4108-a10c-0fcec73b2b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:49.251596 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e792a9b-8ae2-4108-a10c-0fcec73b2b82 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:49.251880 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e792a9b-8ae2-4108-a10c-0fcec73b2b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:49.252156 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e792a9b-8ae2-4108-a10c-0fcec73b2b82 None admin] PATH_INFO: `/v3/projects/51115e4840444ed8aa7f060448c5cc92` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:49.253349 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e792a9b-8ae2-4108-a10c-0fcec73b2b82 None admin] RBAC: Authorizing `identity:get_project(project_id=51115e4840444ed8aa7f060448c5cc92)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:49.254840 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e792a9b-8ae2-4108-a10c-0fcec73b2b82 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:49.256543 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 96/191] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:12:49 2022] GET /identity/v3/projects/51115e4840444ed8aa7f060448c5cc92 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:49.257303 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e792a9b-8ae2-4108-a10c-0fcec73b2b82 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:49.311271 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea818a-4ba2-4eaa-9978-dc34c66ee6ae None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:49.345741 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3aaf8e-2261-475c-92d0-e06452c70ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:49.346446 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3aaf8e-2261-475c-92d0-e06452c70ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:49.346730 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3aaf8e-2261-475c-92d0-e06452c70ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:49.347006 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3aaf8e-2261-475c-92d0-e06452c70ff0 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:49.347747 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3aaf8e-2261-475c-92d0-e06452c70ff0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:49.348056 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3aaf8e-2261-475c-92d0-e06452c70ff0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:49.349433 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3aaf8e-2261-475c-92d0-e06452c70ff0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:49.354420 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e792a9b-8ae2-4108-a10c-0fcec73b2b82 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:49.357128 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 96/192] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:12:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:49.357897 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3aaf8e-2261-475c-92d0-e06452c70ff0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:49.388735 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b2518-c6b9-4dd8-97f6-f59d298d4882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:49.389371 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b2518-c6b9-4dd8-97f6-f59d298d4882 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:49.389652 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b2518-c6b9-4dd8-97f6-f59d298d4882 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:49.389924 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b2518-c6b9-4dd8-97f6-f59d298d4882 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:49.438169 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:49.459145 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9b2518-c6b9-4dd8-97f6-f59d298d4882 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:49.459373 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3aaf8e-2261-475c-92d0-e06452c70ff0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:49.460609 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9b2518-c6b9-4dd8-97f6-f59d298d4882 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:49.460991 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:49.493968 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518d101-b06b-4b74-ae29-4868e7dc0c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:49.494788 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518d101-b06b-4b74-ae29-4868e7dc0c1b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:49.495074 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518d101-b06b-4b74-ae29-4868e7dc0c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:49.495352 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518d101-b06b-4b74-ae29-4868e7dc0c1b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:49.505489 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d518d101-b06b-4b74-ae29-4868e7dc0c1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:12:49.513711 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-d518d101-b06b-4b74-ae29-4868e7dc0c1b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 01 04:12:49.513711 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:12:49.513711 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:12:49.513711 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:12:49.513711 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:12:49.513711 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:12:49.513711 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:12:49.513711 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:12:49.513711 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:12:49.513711 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:12:49.513711 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:12:49.513711 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:12:49.513711 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:12:49.513711 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:12:49.513711 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:12:49.513711 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:12:49.514701 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:12:49.514701 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:12:49.514701 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:12:49.514701 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:12:49.514701 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:12:49.514701 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:12:49.514701 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:12:49.514701 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:12:49.514701 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:12:49.514701 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:12:49.514701 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:12:49.514701 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:12:49.514701 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:12:49.514701 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:12:49.514701 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:12:49.514701 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:12:49.515510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:12:49.515510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:12:49.515510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:12:49.515510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:12:49.515510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:12:49.515510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:12:49.515510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:12:49.515510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:12:49.515510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:12:49.515510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:12:49.515510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 01 04:12:49.515510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:12:49.515510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 97/193] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:12:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:12:49.516158 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518d101-b06b-4b74-ae29-4868e7dc0c1b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:49.560846 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 97/194] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:12:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 04:12:49.561689 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b2518-c6b9-4dd8-97f6-f59d298d4882 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:49.617052 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518d101-b06b-4b74-ae29-4868e7dc0c1b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:49.638952 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:49.649752 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b1a15-9ea6-4462-a38c-8987254ce009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:49.650570 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b1a15-9ea6-4462-a38c-8987254ce009 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:49.650847 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b1a15-9ea6-4462-a38c-8987254ce009 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:49.651129 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b1a15-9ea6-4462-a38c-8987254ce009 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:49.652284 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b1a15-9ea6-4462-a38c-8987254ce009 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:49.653731 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b1a15-9ea6-4462-a38c-8987254ce009 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:49.655456 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 98/195] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:12:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:49.658626 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b2518-c6b9-4dd8-97f6-f59d298d4882 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:49.658831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b1a15-9ea6-4462-a38c-8987254ce009 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:49.688347 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:49.694611 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d91b80-7df1-49fc-ade2-99267a0ff07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:49.695267 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d91b80-7df1-49fc-ade2-99267a0ff07a None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:49.695552 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d91b80-7df1-49fc-ade2-99267a0ff07a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:49.695828 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d91b80-7df1-49fc-ade2-99267a0ff07a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:49.696660 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d91b80-7df1-49fc-ade2-99267a0ff07a None admin] RBAC: Adding query filter params (role.id=71e70e8fe1344699a131764a348d51d6, scope.project.id=51115e4840444ed8aa7f060448c5cc92, user.id=afb251a9af9a4e5b99e5cdd71c34f147) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:49.696993 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d91b80-7df1-49fc-ade2-99267a0ff07a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:49.698457 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d91b80-7df1-49fc-ade2-99267a0ff07a None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:49.704834 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 98/196] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:12:49 2022] GET /identity/v3/role_assignments?user.id=afb251a9af9a4e5b99e5cdd71c34f147&scope.project.id=51115e4840444ed8aa7f060448c5cc92&role.id=71e70e8fe1344699a131764a348d51d6 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:49.705612 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d91b80-7df1-49fc-ade2-99267a0ff07a None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:49.777340 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b1a15-9ea6-4462-a38c-8987254ce009 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:49.816088 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17699e-8226-41bc-818d-4d5960fc2c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:49.817015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17699e-8226-41bc-818d-4d5960fc2c5f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:49.817303 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17699e-8226-41bc-818d-4d5960fc2c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:49.817582 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17699e-8226-41bc-818d-4d5960fc2c5f None admin] PATH_INFO: `/v3/users/ff8ba619394c458fb8578d98a778789b` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:49.818804 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d91b80-7df1-49fc-ade2-99267a0ff07a None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:49.819106 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17699e-8226-41bc-818d-4d5960fc2c5f None admin] RBAC: Authorizing `identity:get_user(user_id=ff8ba619394c458fb8578d98a778789b)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:49.820627 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17699e-8226-41bc-818d-4d5960fc2c5f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:49.826969 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 99/197] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:12:49 2022] GET /identity/v3/users/ff8ba619394c458fb8578d98a778789b => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:49.826969 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17699e-8226-41bc-818d-4d5960fc2c5f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:49.862999 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6d63f-b5e6-46ce-866a-e88b9b4664e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:49.862999 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6d63f-b5e6-46ce-866a-e88b9b4664e3 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:49.863479 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6d63f-b5e6-46ce-866a-e88b9b4664e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:49.863859 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6d63f-b5e6-46ce-866a-e88b9b4664e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:49.864728 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6d63f-b5e6-46ce-866a-e88b9b4664e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:49.865141 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6d63f-b5e6-46ce-866a-e88b9b4664e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:49.866706 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6d63f-b5e6-46ce-866a-e88b9b4664e3 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:49.876711 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 99/198] 10.222.0.32 () {56 vars in 1101 bytes} [Wed Jun 1 04:12:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:49.877828 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6d63f-b5e6-46ce-866a-e88b9b4664e3 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:49.887330 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:49.946293 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:49.950840 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17699e-8226-41bc-818d-4d5960fc2c5f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:49.987889 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c5c7b-609f-42e8-bdd3-bb52cb3d88a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:49.988852 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c5c7b-609f-42e8-bdd3-bb52cb3d88a7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:49.989209 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c5c7b-609f-42e8-bdd3-bb52cb3d88a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:49.989562 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c5c7b-609f-42e8-bdd3-bb52cb3d88a7 None admin] PATH_INFO: `/v3/projects/047a5e1b44994e5690d32519e9f95eff` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:49.990761 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c5c7b-609f-42e8-bdd3-bb52cb3d88a7 None admin] RBAC: Authorizing `identity:get_project(project_id=047a5e1b44994e5690d32519e9f95eff)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:49.992235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c5c7b-609f-42e8-bdd3-bb52cb3d88a7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:49.993241 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6d63f-b5e6-46ce-866a-e88b9b4664e3 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:49.993921 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 100/199] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:12:49 2022] GET /identity/v3/projects/047a5e1b44994e5690d32519e9f95eff => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:49.994702 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c5c7b-609f-42e8-bdd3-bb52cb3d88a7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:50.031352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e402092-0f0a-480b-a9e9-a8af5efb940e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:50.031943 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e402092-0f0a-480b-a9e9-a8af5efb940e None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:50.032230 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e402092-0f0a-480b-a9e9-a8af5efb940e None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:50.032513 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e402092-0f0a-480b-a9e9-a8af5efb940e None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:50.033216 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e402092-0f0a-480b-a9e9-a8af5efb940e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:50.034749 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e402092-0f0a-480b-a9e9-a8af5efb940e None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:50.054436 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 100/200] 10.222.0.32 () {60 vars in 1132 bytes} [Wed Jun 1 04:12:49 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:12:50.055320 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e402092-0f0a-480b-a9e9-a8af5efb940e None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:50.122379 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c5c7b-609f-42e8-bdd3-bb52cb3d88a7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:50.126378 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:50.172140 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142beaf4-8d65-48a6-afba-0eb095d3b626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:50.172980 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142beaf4-8d65-48a6-afba-0eb095d3b626 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:50.173362 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142beaf4-8d65-48a6-afba-0eb095d3b626 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:50.173727 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142beaf4-8d65-48a6-afba-0eb095d3b626 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:50.179069 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e402092-0f0a-480b-a9e9-a8af5efb940e None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:50.214825 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:50.220230 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7216f28-6595-4267-97b5-bdba7bd138d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:50.221275 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7216f28-6595-4267-97b5-bdba7bd138d9 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:50.221668 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7216f28-6595-4267-97b5-bdba7bd138d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:50.222184 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7216f28-6595-4267-97b5-bdba7bd138d9 None admin] PATH_INFO: `/v3/users/653d6b8edb364971ad27e90fc59177ac` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:50.223592 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7216f28-6595-4267-97b5-bdba7bd138d9 None admin] RBAC: Authorizing `identity:get_user(user_id=653d6b8edb364971ad27e90fc59177ac)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:50.225164 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7216f28-6595-4267-97b5-bdba7bd138d9 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:50.227613 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 101/201] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:12:50 2022] GET /identity/v3/users/653d6b8edb364971ad27e90fc59177ac => generated 289 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:50.232302 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7216f28-6595-4267-97b5-bdba7bd138d9 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:50.256202 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142beaf4-8d65-48a6-afba-0eb095d3b626 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:50.257624 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142beaf4-8d65-48a6-afba-0eb095d3b626 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:50.361561 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7216f28-6595-4267-97b5-bdba7bd138d9 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:50.387939 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 101/202] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:12:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 04:12:50.389116 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142beaf4-8d65-48a6-afba-0eb095d3b626 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:50.397843 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:50.405834 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b0e61-8223-4fa7-aecb-877dbb3c01fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:50.406528 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b0e61-8223-4fa7-aecb-877dbb3c01fc None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:50.406830 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b0e61-8223-4fa7-aecb-877dbb3c01fc None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:50.407093 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b0e61-8223-4fa7-aecb-877dbb3c01fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:50.407922 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b0e61-8223-4fa7-aecb-877dbb3c01fc None admin] RBAC: Adding query filter params (role.id=76fc054ad9544460a7be1e2010c23642, scope.project.id=047a5e1b44994e5690d32519e9f95eff, user.id=ff8ba619394c458fb8578d98a778789b) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:50.408231 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b0e61-8223-4fa7-aecb-877dbb3c01fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:50.409812 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b0e61-8223-4fa7-aecb-877dbb3c01fc None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:50.416330 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 102/203] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:12:50 2022] GET /identity/v3/role_assignments?user.id=ff8ba619394c458fb8578d98a778789b&scope.project.id=047a5e1b44994e5690d32519e9f95eff&role.id=76fc054ad9544460a7be1e2010c23642 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:50.417154 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b0e61-8223-4fa7-aecb-877dbb3c01fc None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:50.481034 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:50.532633 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142beaf4-8d65-48a6-afba-0eb095d3b626 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:50.538756 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b0e61-8223-4fa7-aecb-877dbb3c01fc None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:50.575164 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daadeac-8ccf-48c5-94d5-d3d6bc557c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:50.576603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daadeac-8ccf-48c5-94d5-d3d6bc557c38 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:50.577066 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daadeac-8ccf-48c5-94d5-d3d6bc557c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:50.577519 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daadeac-8ccf-48c5-94d5-d3d6bc557c38 None admin] PATH_INFO: `/v3/projects/047a5e1b44994e5690d32519e9f95eff` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:50.578728 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9663a-66be-4489-ad01-983cd2f96aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:50.579331 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daadeac-8ccf-48c5-94d5-d3d6bc557c38 None admin] RBAC: Authorizing `identity:get_project(project_id=047a5e1b44994e5690d32519e9f95eff)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:50.579436 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9663a-66be-4489-ad01-983cd2f96aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:50.579651 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9663a-66be-4489-ad01-983cd2f96aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:50.579925 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9663a-66be-4489-ad01-983cd2f96aa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:50.582310 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daadeac-8ccf-48c5-94d5-d3d6bc557c38 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:50.584310 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 103/204] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:12:50 2022] GET /identity/v3/projects/047a5e1b44994e5690d32519e9f95eff => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:50.590963 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daadeac-8ccf-48c5-94d5-d3d6bc557c38 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:50.678459 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:50.722685 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9663a-66be-4489-ad01-983cd2f96aa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:50.724709 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9663a-66be-4489-ad01-983cd2f96aa6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:50.743684 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daadeac-8ccf-48c5-94d5-d3d6bc557c38 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:50.815621 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbd708-2266-4d5e-8139-9e30a3ee191d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:50.816647 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbd708-2266-4d5e-8139-9e30a3ee191d None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:50.817134 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbd708-2266-4d5e-8139-9e30a3ee191d None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:50.817671 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbd708-2266-4d5e-8139-9e30a3ee191d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:50.818998 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dbd708-2266-4d5e-8139-9e30a3ee191d None admin] RBAC: Adding query filter params (role.id=71e70e8fe1344699a131764a348d51d6, scope.project.id=047a5e1b44994e5690d32519e9f95eff, user.id=ff8ba619394c458fb8578d98a778789b) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:50.819535 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dbd708-2266-4d5e-8139-9e30a3ee191d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:50.821207 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dbd708-2266-4d5e-8139-9e30a3ee191d None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:50.827649 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 104/205] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:12:50 2022] GET /identity/v3/role_assignments?user.id=ff8ba619394c458fb8578d98a778789b&scope.project.id=047a5e1b44994e5690d32519e9f95eff&role.id=71e70e8fe1344699a131764a348d51d6 => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:50.834353 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:50.873464 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 102/206] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:12:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 04:12:50.879195 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbd708-2266-4d5e-8139-9e30a3ee191d None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:51.013314 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbd708-2266-4d5e-8139-9e30a3ee191d None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:51.046815 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:51.056689 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a1bc4-a8e3-4250-9b81-61b12f3bacde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:51.057551 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a1bc4-a8e3-4250-9b81-61b12f3bacde None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:51.057835 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a1bc4-a8e3-4250-9b81-61b12f3bacde None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:51.058135 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a1bc4-a8e3-4250-9b81-61b12f3bacde None admin] PATH_INFO: `/v3/projects/51115e4840444ed8aa7f060448c5cc92` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:51.059355 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a1bc4-a8e3-4250-9b81-61b12f3bacde None admin] RBAC: Authorizing `identity:get_project(project_id=51115e4840444ed8aa7f060448c5cc92)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:51.060811 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a1bc4-a8e3-4250-9b81-61b12f3bacde None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:51.062566 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 105/207] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:12:50 2022] GET /identity/v3/projects/51115e4840444ed8aa7f060448c5cc92 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:51.068303 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9663a-66be-4489-ad01-983cd2f96aa6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:51.194402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9663a-66be-4489-ad01-983cd2f96aa6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:51.248163 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b993f-27a2-49e5-a6de-b79265f8201e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:51.248831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b993f-27a2-49e5-a6de-b79265f8201e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:51.249115 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b993f-27a2-49e5-a6de-b79265f8201e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:51.249390 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b993f-27a2-49e5-a6de-b79265f8201e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:51.250252 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896b993f-27a2-49e5-a6de-b79265f8201e None admin] RBAC: Adding query filter params (role.id=7b78e36083484a9a810a37da3f18974b, scope.project.id=51115e4840444ed8aa7f060448c5cc92, user.id=653d6b8edb364971ad27e90fc59177ac) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:51.250564 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896b993f-27a2-49e5-a6de-b79265f8201e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:51.252006 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896b993f-27a2-49e5-a6de-b79265f8201e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:51.259428 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 103/208] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:12:51 2022] GET /identity/v3/role_assignments?user.id=653d6b8edb364971ad27e90fc59177ac&scope.project.id=51115e4840444ed8aa7f060448c5cc92&role.id=7b78e36083484a9a810a37da3f18974b => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:52.769821 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd186f8-9f15-4917-8fdd-1526b41b6993 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:52.770364 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd186f8-9f15-4917-8fdd-1526b41b6993 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:52.770477 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd186f8-9f15-4917-8fdd-1526b41b6993 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:52.772029 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 106/209] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:12:52.777791 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906742f4-1ff1-4aa1-9f3b-1641a9c62597 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:52.778243 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906742f4-1ff1-4aa1-9f3b-1641a9c62597 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:52.778417 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906742f4-1ff1-4aa1-9f3b-1641a9c62597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:52.795398 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-906742f4-1ff1-4aa1-9f3b-1641a9c62597 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:52.796587 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-906742f4-1ff1-4aa1-9f3b-1641a9c62597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:52.816435 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d289419-e7c5-4935-910f-da554dc662f8 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:52.816739 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d289419-e7c5-4935-910f-da554dc662f8 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:52.816999 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d289419-e7c5-4935-910f-da554dc662f8 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:52.819070 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 107/210] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:12:52.822922 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:52.825320 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d68d75-6a9d-4852-aa2c-7e75f773218b None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:52.825596 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d68d75-6a9d-4852-aa2c-7e75f773218b None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:52.825881 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d68d75-6a9d-4852-aa2c-7e75f773218b None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:52.827366 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 108/211] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:12:52.828342 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73653b58-d2ca-400a-afbb-7491bc61135c None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:52.828630 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73653b58-d2ca-400a-afbb-7491bc61135c None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:52.828966 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73653b58-d2ca-400a-afbb-7491bc61135c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:52.847947 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-73653b58-d2ca-400a-afbb-7491bc61135c None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:52.849136 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-73653b58-d2ca-400a-afbb-7491bc61135c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:52.870818 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 104/212] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:12:52.872562 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c95ea-86ea-4f73-950e-08589dd28cc7 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:52.873001 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c95ea-86ea-4f73-950e-08589dd28cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:52.873424 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c95ea-86ea-4f73-950e-08589dd28cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:52.895012 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-5e9c95ea-86ea-4f73-950e-08589dd28cc7 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:52.896448 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5e9c95ea-86ea-4f73-950e-08589dd28cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:52.926783 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 109/213] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:12:52.927632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73653b58-d2ca-400a-afbb-7491bc61135c None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:52.978504 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 105/214] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:12:52.979266 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c95ea-86ea-4f73-950e-08589dd28cc7 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:53.046943 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73653b58-d2ca-400a-afbb-7491bc61135c None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:53.072280 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:53.084233 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5454312-1315-452d-a3d9-11ca576924d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:53.085113 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5454312-1315-452d-a3d9-11ca576924d2 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:53.085364 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5454312-1315-452d-a3d9-11ca576924d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:53.085657 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5454312-1315-452d-a3d9-11ca576924d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:53.086963 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5454312-1315-452d-a3d9-11ca576924d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:53.088434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5454312-1315-452d-a3d9-11ca576924d2 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:53.090747 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 110/215] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:12:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:53.091354 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5454312-1315-452d-a3d9-11ca576924d2 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:53.095349 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:53.106351 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c95ea-86ea-4f73-950e-08589dd28cc7 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:53.144479 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae86cb-0055-4ece-b911-7f6e0bbe3300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:53.145285 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae86cb-0055-4ece-b911-7f6e0bbe3300 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:53.145571 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae86cb-0055-4ece-b911-7f6e0bbe3300 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:53.145850 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae86cb-0055-4ece-b911-7f6e0bbe3300 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:53.157732 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae86cb-0055-4ece-b911-7f6e0bbe3300 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:12:53.164985 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-43ae86cb-0055-4ece-b911-7f6e0bbe3300 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:12:53.164985 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:12:53.164985 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:12:53.164985 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:12:53.164985 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:12:53.164985 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:12:53.164985 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:12:53.164985 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:12:53.164985 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:12:53.164985 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:12:53.164985 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:12:53.164985 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:12:53.164985 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:12:53.164985 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:12:53.164985 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:12:53.164985 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:12:53.165856 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:12:53.165856 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:12:53.165856 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:12:53.165856 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:12:53.165856 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:12:53.165856 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:12:53.165856 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:12:53.165856 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:12:53.165856 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:12:53.165856 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:12:53.165856 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:12:53.165856 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:12:53.165856 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:12:53.165856 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:12:53.165856 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:12:53.165856 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:12:53.171979 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:12:53.171979 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:12:53.171979 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:12:53.171979 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:12:53.171979 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:12:53.171979 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:12:53.171979 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:12:53.171979 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:12:53.171979 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:12:53.171979 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:12:53.171979 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:12:53.171979 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:12:53.171979 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 106/216] 10.222.0.32 () {56 vars in 1096 bytes} [Wed Jun 1 04:12:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:12:53.171979 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae86cb-0055-4ece-b911-7f6e0bbe3300 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:53.216700 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5454312-1315-452d-a3d9-11ca576924d2 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:53.253235 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4f972-6e5c-401e-b425-b3d510992ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:53.254054 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4f972-6e5c-401e-b425-b3d510992ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:53.254343 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4f972-6e5c-401e-b425-b3d510992ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:53.254620 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4f972-6e5c-401e-b425-b3d510992ad5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:53.266387 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4f972-6e5c-401e-b425-b3d510992ad5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:12:53.274120 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-c9b4f972-6e5c-401e-b425-b3d510992ad5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 01 04:12:53.274120 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:12:53.274120 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:12:53.274120 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:12:53.274120 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:12:53.274120 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:12:53.274120 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:12:53.274120 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:12:53.274120 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:12:53.274120 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:12:53.274120 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:12:53.274120 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:12:53.274120 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:12:53.274120 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:12:53.274120 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:12:53.274120 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:12:53.275274 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:12:53.275274 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:12:53.275274 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:12:53.275274 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:12:53.275274 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:12:53.275274 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:12:53.275274 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:12:53.275274 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:12:53.275274 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:12:53.275274 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:12:53.275274 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:12:53.275274 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:12:53.275274 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:12:53.275274 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:12:53.275274 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:12:53.275274 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:12:53.276069 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:12:53.276069 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:12:53.276069 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:12:53.276069 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:12:53.276069 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:12:53.276069 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:12:53.276069 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:12:53.276069 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:12:53.276069 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:12:53.276069 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:12:53.276069 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 01 04:12:53.276069 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:12:53.276069 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 111/217] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:12:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:12:53.276713 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4f972-6e5c-401e-b425-b3d510992ad5 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:53.277053 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae86cb-0055-4ece-b911-7f6e0bbe3300 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:53.314592 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833ef1c-5d3d-4a34-bfcd-2a30c5d818fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:53.315267 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833ef1c-5d3d-4a34-bfcd-2a30c5d818fa None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:53.316242 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833ef1c-5d3d-4a34-bfcd-2a30c5d818fa None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:53.316242 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833ef1c-5d3d-4a34-bfcd-2a30c5d818fa None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:53.316579 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833ef1c-5d3d-4a34-bfcd-2a30c5d818fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:53.318067 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833ef1c-5d3d-4a34-bfcd-2a30c5d818fa None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:53.336187 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:53.339877 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 107/218] 10.222.0.32 () {60 vars in 1132 bytes} [Wed Jun 1 04:12:53 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:12:53.340702 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833ef1c-5d3d-4a34-bfcd-2a30c5d818fa None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:53.349911 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:53.397682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4f972-6e5c-401e-b425-b3d510992ad5 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:53.437858 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34584b15-7b99-4316-8b55-f37bcd619e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:53.438580 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34584b15-7b99-4316-8b55-f37bcd619e8f None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:53.438878 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34584b15-7b99-4316-8b55-f37bcd619e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:53.439147 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34584b15-7b99-4316-8b55-f37bcd619e8f None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:53.439918 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34584b15-7b99-4316-8b55-f37bcd619e8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:53.440230 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34584b15-7b99-4316-8b55-f37bcd619e8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:53.441670 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34584b15-7b99-4316-8b55-f37bcd619e8f None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:53.455989 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 112/219] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:12:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:53.455989 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2100a-52ac-435d-ae82-8928bc59b9a9 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:53.455989 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2100a-52ac-435d-ae82-8928bc59b9a9 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:53.455989 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2100a-52ac-435d-ae82-8928bc59b9a9 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:53.455989 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 113/220] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:12:53.456911 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2100a-52ac-435d-ae82-8928bc59b9a9 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:53.465727 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833ef1c-5d3d-4a34-bfcd-2a30c5d818fa None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:53.512479 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b79873-7bcf-42cc-8c98-eb4c12b241d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:53.513232 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b79873-7bcf-42cc-8c98-eb4c12b241d6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:53.513522 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b79873-7bcf-42cc-8c98-eb4c12b241d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:53.513803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b79873-7bcf-42cc-8c98-eb4c12b241d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:53.514662 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b79873-7bcf-42cc-8c98-eb4c12b241d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:53.514972 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b79873-7bcf-42cc-8c98-eb4c12b241d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:53.516390 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b79873-7bcf-42cc-8c98-eb4c12b241d6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:53.530751 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 108/221] 10.222.0.32 () {56 vars in 1101 bytes} [Wed Jun 1 04:12:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:53.530751 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d7398-c5bb-45a6-9e06-b95da41dddef None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:53.530751 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d7398-c5bb-45a6-9e06-b95da41dddef None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:53.530751 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d7398-c5bb-45a6-9e06-b95da41dddef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:53.545319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-172d7398-c5bb-45a6-9e06-b95da41dddef None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:53.546574 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-172d7398-c5bb-45a6-9e06-b95da41dddef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:53.585454 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2100a-52ac-435d-ae82-8928bc59b9a9 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:53.599491 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:53.624257 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:53.626511 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffee431-5d48-408f-897a-e0391ba576dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:53.628110 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffee431-5d48-408f-897a-e0391ba576dd None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:53.628398 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffee431-5d48-408f-897a-e0391ba576dd None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:53.628691 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffee431-5d48-408f-897a-e0391ba576dd None admin] PATH_INFO: `/v3/users/ff8ba619394c458fb8578d98a778789b` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:53.629896 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffee431-5d48-408f-897a-e0391ba576dd None admin] RBAC: Authorizing `identity:get_user(user_id=ff8ba619394c458fb8578d98a778789b)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:53.631416 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 109/222] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:12:53.631638 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffee431-5d48-408f-897a-e0391ba576dd None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:53.633266 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d7398-c5bb-45a6-9e06-b95da41dddef None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:53.633841 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 114/223] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:12:53 2022] GET /identity/v3/users/ff8ba619394c458fb8578d98a778789b => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:53.639374 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffee431-5d48-408f-897a-e0391ba576dd None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:53.765124 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d7398-c5bb-45a6-9e06-b95da41dddef None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:53.769050 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffee431-5d48-408f-897a-e0391ba576dd None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:53.806066 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ea402-5f4a-4666-8a8e-4ca6c0549e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:53.806954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ea402-5f4a-4666-8a8e-4ca6c0549e93 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:53.807286 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ea402-5f4a-4666-8a8e-4ca6c0549e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:53.807566 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ea402-5f4a-4666-8a8e-4ca6c0549e93 None admin] PATH_INFO: `/v3/users/65a591927e53434abfe929d4a4bad802` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:53.814356 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d20aa5-01c2-4d66-90b9-2a114d30c718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:53.815216 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d20aa5-01c2-4d66-90b9-2a114d30c718 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:53.815505 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d20aa5-01c2-4d66-90b9-2a114d30c718 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:53.816302 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d20aa5-01c2-4d66-90b9-2a114d30c718 None admin] PATH_INFO: `/v3/projects/047a5e1b44994e5690d32519e9f95eff` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:53.817518 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d20aa5-01c2-4d66-90b9-2a114d30c718 None admin] RBAC: Authorizing `identity:get_project(project_id=047a5e1b44994e5690d32519e9f95eff)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:53.819788 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d20aa5-01c2-4d66-90b9-2a114d30c718 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:53.823171 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 115/224] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:12:53 2022] GET /identity/v3/projects/047a5e1b44994e5690d32519e9f95eff => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:12:53.823284 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ea402-5f4a-4666-8a8e-4ca6c0549e93 None admin] RBAC: Authorizing `identity:get_user(user_id=65a591927e53434abfe929d4a4bad802)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:53.823956 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d20aa5-01c2-4d66-90b9-2a114d30c718 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:53.829425 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ea402-5f4a-4666-8a8e-4ca6c0549e93 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:53.831356 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 110/225] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:12:53 2022] GET /identity/v3/users/65a591927e53434abfe929d4a4bad802 => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:53.831981 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ea402-5f4a-4666-8a8e-4ca6c0549e93 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:53.894684 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:53.895947 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:53.944882 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ea402-5f4a-4666-8a8e-4ca6c0549e93 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:53.966183 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d20aa5-01c2-4d66-90b9-2a114d30c718 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:53.981728 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2e307-a166-4d4d-8a52-814c68b6bde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:53.982729 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2e307-a166-4d4d-8a52-814c68b6bde2 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:53.983018 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2e307-a166-4d4d-8a52-814c68b6bde2 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:53.983298 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2e307-a166-4d4d-8a52-814c68b6bde2 None admin] PATH_INFO: `/v3/projects/047a5e1b44994e5690d32519e9f95eff/users/ff8ba619394c458fb8578d98a778789b/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:53.985502 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2e307-a166-4d4d-8a52-814c68b6bde2 None admin] RBAC: Authorizing `identity:create_grant(project_id=047a5e1b44994e5690d32519e9f95eff, user_id=ff8ba619394c458fb8578d98a778789b, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:53.986808 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2e307-a166-4d4d-8a52-814c68b6bde2 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:54.009505 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 111/226] 10.222.0.32 () {58 vars in 1439 bytes} [Wed Jun 1 04:12:53 2022] PUT /identity/v3/projects/047a5e1b44994e5690d32519e9f95eff/users/ff8ba619394c458fb8578d98a778789b/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:12:54.011122 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2e307-a166-4d4d-8a52-814c68b6bde2 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:54.014482 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1194d-5f16-4878-8c8f-d14989a17c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:54.015313 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1194d-5f16-4878-8c8f-d14989a17c45 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:54.015596 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1194d-5f16-4878-8c8f-d14989a17c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:54.016806 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1194d-5f16-4878-8c8f-d14989a17c45 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:54.028784 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1194d-5f16-4878-8c8f-d14989a17c45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:12:54.040539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-edd1194d-5f16-4878-8c8f-d14989a17c45 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 04:12:54.040539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:12:54.040539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:12:54.040539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:12:54.040539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:12:54.040539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:12:54.040539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:12:54.040539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:12:54.040539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:12:54.040539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:12:54.040539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:12:54.040539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:12:54.040539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:12:54.040539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:12:54.040539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:12:54.040539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:12:54.041697 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:12:54.041697 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:12:54.041697 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:12:54.041697 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:12:54.041697 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:12:54.041697 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:12:54.041697 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:12:54.041697 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:12:54.041697 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:12:54.041697 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:12:54.041697 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:12:54.041697 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:12:54.041697 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:12:54.041697 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:12:54.041697 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:12:54.041697 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:12:54.042581 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:12:54.042581 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:12:54.042581 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:12:54.042581 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:12:54.042581 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:12:54.042581 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:12:54.042581 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:12:54.042581 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:12:54.042581 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:12:54.042581 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:12:54.042581 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 04:12:54.042581 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:12:54.042581 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 116/227] 10.222.0.32 () {56 vars in 1114 bytes} [Wed Jun 1 04:12:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:12:54.057837 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1194d-5f16-4878-8c8f-d14989a17c45 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:54.148910 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2e307-a166-4d4d-8a52-814c68b6bde2 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:54.170615 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:54.193942 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d592b-3101-47ca-bf6b-63a0a09e8b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:54.194998 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d592b-3101-47ca-bf6b-63a0a09e8b79 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:54.195564 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d592b-3101-47ca-bf6b-63a0a09e8b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:54.196177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d592b-3101-47ca-bf6b-63a0a09e8b79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:54.261451 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1194d-5f16-4878-8c8f-d14989a17c45 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:54.271236 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d592b-3101-47ca-bf6b-63a0a09e8b79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:54.272379 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:54.274246 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d592b-3101-47ca-bf6b-63a0a09e8b79 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:54.299599 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee259b45-34bf-4cfb-851b-5a126f592c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:54.301517 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee259b45-34bf-4cfb-851b-5a126f592c64 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:54.301517 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee259b45-34bf-4cfb-851b-5a126f592c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:54.301517 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee259b45-34bf-4cfb-851b-5a126f592c64 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:54.302079 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee259b45-34bf-4cfb-851b-5a126f592c64 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:54.302398 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee259b45-34bf-4cfb-851b-5a126f592c64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:54.304119 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee259b45-34bf-4cfb-851b-5a126f592c64 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:54.318011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 117/228] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:12:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:54.323357 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee259b45-34bf-4cfb-851b-5a126f592c64 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:54.396457 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 112/229] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:12:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 04:12:54.403906 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d592b-3101-47ca-bf6b-63a0a09e8b79 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:54.443254 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:54.488722 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee259b45-34bf-4cfb-851b-5a126f592c64 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:54.530857 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0fcec-52ca-4899-8d9d-af28b9963222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:54.531757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0fcec-52ca-4899-8d9d-af28b9963222 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:54.532037 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0fcec-52ca-4899-8d9d-af28b9963222 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:54.532313 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0fcec-52ca-4899-8d9d-af28b9963222 None admin] PATH_INFO: `/v3/users/ff8ba619394c458fb8578d98a778789b` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:54.533521 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0fcec-52ca-4899-8d9d-af28b9963222 None admin] RBAC: Authorizing `identity:get_user(user_id=ff8ba619394c458fb8578d98a778789b)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:54.539776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0fcec-52ca-4899-8d9d-af28b9963222 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:54.541434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 118/230] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:12:54 2022] GET /identity/v3/users/ff8ba619394c458fb8578d98a778789b => generated 283 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:54.546958 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0fcec-52ca-4899-8d9d-af28b9963222 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:54.577629 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d592b-3101-47ca-bf6b-63a0a09e8b79 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:54.618409 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:54.619671 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da06a41-68b5-4190-b608-d28ffaa5b6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:54.620548 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da06a41-68b5-4190-b608-d28ffaa5b6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:54.620833 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da06a41-68b5-4190-b608-d28ffaa5b6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:54.621218 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da06a41-68b5-4190-b608-d28ffaa5b6f9 None admin] PATH_INFO: `/v3/projects/047a5e1b44994e5690d32519e9f95eff` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:54.622515 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da06a41-68b5-4190-b608-d28ffaa5b6f9 None admin] RBAC: Authorizing `identity:get_project(project_id=047a5e1b44994e5690d32519e9f95eff)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:54.624078 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da06a41-68b5-4190-b608-d28ffaa5b6f9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:54.627241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 113/231] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:12:54 2022] GET /identity/v3/projects/047a5e1b44994e5690d32519e9f95eff => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:54.635157 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da06a41-68b5-4190-b608-d28ffaa5b6f9 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:54.735124 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:54.747639 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0fcec-52ca-4899-8d9d-af28b9963222 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:54.752816 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da06a41-68b5-4190-b608-d28ffaa5b6f9 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:54.790706 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8cd78-023d-4eb7-933b-bc5cb079b865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:54.791363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8cd78-023d-4eb7-933b-bc5cb079b865 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:54.791643 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8cd78-023d-4eb7-933b-bc5cb079b865 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:54.791917 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8cd78-023d-4eb7-933b-bc5cb079b865 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:54.792748 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a8cd78-023d-4eb7-933b-bc5cb079b865 None admin] RBAC: Adding query filter params (role.id=3f08ec4046094d04a533ba522f71ba9a, scope.project.id=047a5e1b44994e5690d32519e9f95eff, user.id=65a591927e53434abfe929d4a4bad802) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:54.793056 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a8cd78-023d-4eb7-933b-bc5cb079b865 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:54.794531 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a8cd78-023d-4eb7-933b-bc5cb079b865 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:54.805756 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 114/232] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:12:54 2022] GET /identity/v3/role_assignments?user.id=65a591927e53434abfe929d4a4bad802&scope.project.id=047a5e1b44994e5690d32519e9f95eff&role.id=3f08ec4046094d04a533ba522f71ba9a => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:54.817378 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa5291-7352-4354-89af-4d5315495b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:54.818291 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa5291-7352-4354-89af-4d5315495b45 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:54.818831 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa5291-7352-4354-89af-4d5315495b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:54.819103 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa5291-7352-4354-89af-4d5315495b45 None admin] PATH_INFO: `/v3/projects/047a5e1b44994e5690d32519e9f95eff` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:54.820956 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa5291-7352-4354-89af-4d5315495b45 None admin] RBAC: Authorizing `identity:get_project(project_id=047a5e1b44994e5690d32519e9f95eff)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:54.822507 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa5291-7352-4354-89af-4d5315495b45 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:54.824367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 119/233] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:12:54 2022] GET /identity/v3/projects/047a5e1b44994e5690d32519e9f95eff => generated 302 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:12:54.830504 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8cd78-023d-4eb7-933b-bc5cb079b865 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:54.975204 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8cd78-023d-4eb7-933b-bc5cb079b865 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:55.017634 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f924fc-c01b-4fec-a069-10122adfec57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:55.018594 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f924fc-c01b-4fec-a069-10122adfec57 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:55.018885 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f924fc-c01b-4fec-a069-10122adfec57 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:55.019162 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f924fc-c01b-4fec-a069-10122adfec57 None admin] PATH_INFO: `/v3/projects/047a5e1b44994e5690d32519e9f95eff/users/ff8ba619394c458fb8578d98a778789b/roles/71e70e8fe1344699a131764a348d51d6` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:55.021482 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f924fc-c01b-4fec-a069-10122adfec57 None admin] RBAC: Authorizing `identity:create_grant(project_id=047a5e1b44994e5690d32519e9f95eff, user_id=ff8ba619394c458fb8578d98a778789b, role_id=71e70e8fe1344699a131764a348d51d6)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:55.023015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f924fc-c01b-4fec-a069-10122adfec57 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:55.047421 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 115/234] 10.222.0.32 () {58 vars in 1439 bytes} [Wed Jun 1 04:12:54 2022] PUT /identity/v3/projects/047a5e1b44994e5690d32519e9f95eff/users/ff8ba619394c458fb8578d98a778789b/roles/71e70e8fe1344699a131764a348d51d6 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:12:56.001568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f43789-ffac-4e35-a9cf-0e88a17b2c0c None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:56.002606 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f43789-ffac-4e35-a9cf-0e88a17b2c0c None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:56.003125 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f43789-ffac-4e35-a9cf-0e88a17b2c0c None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:56.004982 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 120/235] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:12:56.010027 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4feab5-99a8-431f-8e9a-04290922e157 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:56.010824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4feab5-99a8-431f-8e9a-04290922e157 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:56.011306 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4feab5-99a8-431f-8e9a-04290922e157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:56.039610 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-ea4feab5-99a8-431f-8e9a-04290922e157 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:56.040824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ea4feab5-99a8-431f-8e9a-04290922e157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:56.042996 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:56.127356 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 116/236] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:12:56.172194 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f43789-ffac-4e35-a9cf-0e88a17b2c0c None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:56.279082 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193258d2-2629-4d6a-9dba-2aa09bdb2521 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:56.279370 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193258d2-2629-4d6a-9dba-2aa09bdb2521 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:56.279563 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193258d2-2629-4d6a-9dba-2aa09bdb2521 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:56.282072 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 117/237] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:12:56.286743 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f087c9-9ea2-4f80-baa6-90188e766d39 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:56.287078 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f087c9-9ea2-4f80-baa6-90188e766d39 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:56.287372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f087c9-9ea2-4f80-baa6-90188e766d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:56.302598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f43789-ffac-4e35-a9cf-0e88a17b2c0c None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:56.327095 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b4f087c9-9ea2-4f80-baa6-90188e766d39 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:56.328312 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b4f087c9-9ea2-4f80-baa6-90188e766d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:56.328828 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:56.380162 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63520f68-66ac-414c-b669-ef6e1244fdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:56.380989 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63520f68-66ac-414c-b669-ef6e1244fdea None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:56.381272 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63520f68-66ac-414c-b669-ef6e1244fdea None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:56.381551 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63520f68-66ac-414c-b669-ef6e1244fdea None admin] PATH_INFO: `/v3/domains/default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:56.385558 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63520f68-66ac-414c-b669-ef6e1244fdea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:56.387087 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63520f68-66ac-414c-b669-ef6e1244fdea None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:56.389070 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 121/238] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:12:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:56.395209 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63520f68-66ac-414c-b669-ef6e1244fdea None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:56.457430 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 118/239] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:12:56.493416 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f087c9-9ea2-4f80-baa6-90188e766d39 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:56.529840 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63520f68-66ac-414c-b669-ef6e1244fdea None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:56.575206 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:56.582372 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10716e0b-a78f-4c08-8233-129b3d7c35de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:56.583055 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10716e0b-a78f-4c08-8233-129b3d7c35de None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:56.583345 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10716e0b-a78f-4c08-8233-129b3d7c35de None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:56.583629 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10716e0b-a78f-4c08-8233-129b3d7c35de None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:56.584355 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10716e0b-a78f-4c08-8233-129b3d7c35de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:56.586497 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10716e0b-a78f-4c08-8233-129b3d7c35de None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:56.622502 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f087c9-9ea2-4f80-baa6-90188e766d39 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:56.630225 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 122/240] 10.222.0.32 () {60 vars in 1132 bytes} [Wed Jun 1 04:12:56 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:12:56.669476 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e980c7a-ffdc-491f-8a8c-02e230a23307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:56.670320 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e980c7a-ffdc-491f-8a8c-02e230a23307 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:56.670602 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e980c7a-ffdc-491f-8a8c-02e230a23307 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:56.670879 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e980c7a-ffdc-491f-8a8c-02e230a23307 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:56.683410 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e980c7a-ffdc-491f-8a8c-02e230a23307 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:12:56.691444 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-6e980c7a-ffdc-491f-8a8c-02e230a23307 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 01 04:12:56.691444 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:12:56.691444 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:12:56.691444 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:12:56.691444 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:12:56.691444 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:12:56.691444 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:12:56.691444 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:12:56.691444 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:12:56.691444 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:12:56.691444 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:12:56.691444 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:12:56.691444 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:12:56.691444 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:12:56.691444 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:12:56.691444 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:12:56.692319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:12:56.692319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:12:56.692319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:12:56.692319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:12:56.692319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:12:56.692319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:12:56.692319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:12:56.692319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:12:56.692319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:12:56.692319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:12:56.692319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:12:56.692319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:12:56.692319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:12:56.692319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:12:56.692319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:12:56.692319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:12:56.694153 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:12:56.694153 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:12:56.694153 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:12:56.694153 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:12:56.694153 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:12:56.694153 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:12:56.694153 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:12:56.694153 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:12:56.694153 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:12:56.694153 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:12:56.694153 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 01 04:12:56.694153 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:12:56.694153 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 119/241] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:12:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:12:56.700293 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10716e0b-a78f-4c08-8233-129b3d7c35de None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:56.737721 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:56.825232 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10716e0b-a78f-4c08-8233-129b3d7c35de None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:56.868787 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8021821-f71c-4f1f-b76b-d574b1390f0c None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:56.869095 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8021821-f71c-4f1f-b76b-d574b1390f0c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:56.869338 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8021821-f71c-4f1f-b76b-d574b1390f0c None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:56.870982 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 120/242] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:12:56.877355 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2cc83-8bc0-4f36-aa10-ee338c97156c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:56.877642 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2cc83-8bc0-4f36-aa10-ee338c97156c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:56.877920 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2cc83-8bc0-4f36-aa10-ee338c97156c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:56.878130 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407564c-6a92-4de4-8314-86d01d20d842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:56.878736 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407564c-6a92-4de4-8314-86d01d20d842 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:56.879020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407564c-6a92-4de4-8314-86d01d20d842 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:56.879298 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407564c-6a92-4de4-8314-86d01d20d842 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:56.880339 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407564c-6a92-4de4-8314-86d01d20d842 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:56.880707 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407564c-6a92-4de4-8314-86d01d20d842 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:56.882188 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407564c-6a92-4de4-8314-86d01d20d842 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:56.897511 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 123/243] 10.222.0.32 () {56 vars in 1101 bytes} [Wed Jun 1 04:12:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:56.901515 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407564c-6a92-4de4-8314-86d01d20d842 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:56.903941 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2ee2cc83-8bc0-4f36-aa10-ee338c97156c None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:56.905143 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2ee2cc83-8bc0-4f36-aa10-ee338c97156c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:57.011986 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 121/244] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 04:12:57.034353 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:57.037082 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2cc83-8bc0-4f36-aa10-ee338c97156c None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:57.045247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407564c-6a92-4de4-8314-86d01d20d842 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:57.081004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46106af-1226-4167-83be-5c7a025f0eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:57.082268 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46106af-1226-4167-83be-5c7a025f0eab None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:57.082759 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46106af-1226-4167-83be-5c7a025f0eab None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:57.083255 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46106af-1226-4167-83be-5c7a025f0eab None admin] PATH_INFO: `/v3/users/cd0492ff5c9b45668210fee028d5850e` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:57.102497 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46106af-1226-4167-83be-5c7a025f0eab None admin] RBAC: Authorizing `identity:get_user(user_id=cd0492ff5c9b45668210fee028d5850e)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:57.104334 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46106af-1226-4167-83be-5c7a025f0eab None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:57.106646 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 124/245] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:12:56 2022] GET /identity/v3/users/cd0492ff5c9b45668210fee028d5850e => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:12:57.111668 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:57.112222 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46106af-1226-4167-83be-5c7a025f0eab None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:57.190396 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2cc83-8bc0-4f36-aa10-ee338c97156c None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:57.228613 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389cd32-a031-49c3-91d9-10e2e35e2cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:57.229415 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389cd32-a031-49c3-91d9-10e2e35e2cef None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:57.229699 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389cd32-a031-49c3-91d9-10e2e35e2cef None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:57.230017 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389cd32-a031-49c3-91d9-10e2e35e2cef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:57.239697 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46106af-1226-4167-83be-5c7a025f0eab None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:57.243614 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e389cd32-a031-49c3-91d9-10e2e35e2cef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:12:57.251059 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-e389cd32-a031-49c3-91d9-10e2e35e2cef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:12:57.251059 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:12:57.251059 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:12:57.251059 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:12:57.251059 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:12:57.251059 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:12:57.251059 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:12:57.251059 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:12:57.251059 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:12:57.251059 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:12:57.251059 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:12:57.251059 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:12:57.251059 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:12:57.251059 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:12:57.251059 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:12:57.251059 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:12:57.251982 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:12:57.251982 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:12:57.251982 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:12:57.251982 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:12:57.251982 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:12:57.251982 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:12:57.251982 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:12:57.251982 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:12:57.251982 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:12:57.251982 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:12:57.251982 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:12:57.251982 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:12:57.251982 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:12:57.251982 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:12:57.251982 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:12:57.251982 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:12:57.252759 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:12:57.252759 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:12:57.252759 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:12:57.252759 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:12:57.252759 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:12:57.252759 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:12:57.252759 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:12:57.252759 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:12:57.252759 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:12:57.252759 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:12:57.252759 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:12:57.252759 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:12:57.252759 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 122/246] 10.222.0.32 () {56 vars in 1096 bytes} [Wed Jun 1 04:12:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:12:57.258288 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389cd32-a031-49c3-91d9-10e2e35e2cef None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:57.281076 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79294b65-a5dc-4268-ab17-bae0e5e562e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:57.282094 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79294b65-a5dc-4268-ab17-bae0e5e562e7 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:57.282583 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79294b65-a5dc-4268-ab17-bae0e5e562e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:57.283083 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79294b65-a5dc-4268-ab17-bae0e5e562e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:57.308082 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:57.363185 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79294b65-a5dc-4268-ab17-bae0e5e562e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:57.365048 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79294b65-a5dc-4268-ab17-bae0e5e562e7 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:57.377568 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389cd32-a031-49c3-91d9-10e2e35e2cef None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:57.396650 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:57.430992 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ccd9f7-60e9-4639-840b-779ac98b2e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:57.431684 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ccd9f7-60e9-4639-840b-779ac98b2e69 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:57.431971 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ccd9f7-60e9-4639-840b-779ac98b2e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:57.432253 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ccd9f7-60e9-4639-840b-779ac98b2e69 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:57.433018 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ccd9f7-60e9-4639-840b-779ac98b2e69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:57.433338 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ccd9f7-60e9-4639-840b-779ac98b2e69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:57.434808 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ccd9f7-60e9-4639-840b-779ac98b2e69 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:57.448589 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 123/247] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:12:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:12:57.453986 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ccd9f7-60e9-4639-840b-779ac98b2e69 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:57.479854 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 125/248] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:12:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 04:12:57.486007 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79294b65-a5dc-4268-ab17-bae0e5e562e7 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:57.550663 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:57.606516 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ccd9f7-60e9-4639-840b-779ac98b2e69 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:57.652093 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79294b65-a5dc-4268-ab17-bae0e5e562e7 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:57.654604 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937d42a-2875-4a86-8365-b9accf55a066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:57.655773 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937d42a-2875-4a86-8365-b9accf55a066 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:57.656276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937d42a-2875-4a86-8365-b9accf55a066 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:57.656749 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937d42a-2875-4a86-8365-b9accf55a066 None admin] PATH_INFO: `/v3/users/ff8ba619394c458fb8578d98a778789b` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:57.658198 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937d42a-2875-4a86-8365-b9accf55a066 None admin] RBAC: Authorizing `identity:get_user(user_id=ff8ba619394c458fb8578d98a778789b)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:57.660877 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937d42a-2875-4a86-8365-b9accf55a066 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:57.663143 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 124/249] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:12:57 2022] GET /identity/v3/users/ff8ba619394c458fb8578d98a778789b => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:12:57.668691 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937d42a-2875-4a86-8365-b9accf55a066 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:57.711305 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54dbabf-4221-4857-8882-8d638a53245a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:57.712523 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54dbabf-4221-4857-8882-8d638a53245a None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:57.713011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54dbabf-4221-4857-8882-8d638a53245a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:57.713534 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54dbabf-4221-4857-8882-8d638a53245a None admin] PATH_INFO: `/v3/projects/047a5e1b44994e5690d32519e9f95eff` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:57.715043 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54dbabf-4221-4857-8882-8d638a53245a None admin] RBAC: Authorizing `identity:get_project(project_id=047a5e1b44994e5690d32519e9f95eff)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:57.716704 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54dbabf-4221-4857-8882-8d638a53245a None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:57.719106 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 126/250] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:12:57 2022] GET /identity/v3/projects/047a5e1b44994e5690d32519e9f95eff => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:57.720531 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b58401-7481-43e0-add9-773d370ba80c None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:57.721038 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b58401-7481-43e0-add9-773d370ba80c None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:57.721512 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b58401-7481-43e0-add9-773d370ba80c None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:57.723244 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 127/251] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:12:57.725335 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b58401-7481-43e0-add9-773d370ba80c None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:57.780381 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:57.889789 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937d42a-2875-4a86-8365-b9accf55a066 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:57.891961 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b58401-7481-43e0-add9-773d370ba80c None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:57.928701 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115f43b-ad49-4de2-b284-553b3a2ee0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:57.929869 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115f43b-ad49-4de2-b284-553b3a2ee0be None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:57.930200 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115f43b-ad49-4de2-b284-553b3a2ee0be None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:57.930479 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115f43b-ad49-4de2-b284-553b3a2ee0be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:57.934270 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:57.964265 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51384cc-ce3b-4ee0-a9c8-2505a4d43ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:57.964929 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51384cc-ce3b-4ee0-a9c8-2505a4d43ebd None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:57.965218 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51384cc-ce3b-4ee0-a9c8-2505a4d43ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:57.965500 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51384cc-ce3b-4ee0-a9c8-2505a4d43ebd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:57.966456 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51384cc-ce3b-4ee0-a9c8-2505a4d43ebd None admin] RBAC: Adding query filter params (role.id=7b78e36083484a9a810a37da3f18974b, scope.project.id=047a5e1b44994e5690d32519e9f95eff, user.id=cd0492ff5c9b45668210fee028d5850e) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:57.966780 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51384cc-ce3b-4ee0-a9c8-2505a4d43ebd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:57.968217 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51384cc-ce3b-4ee0-a9c8-2505a4d43ebd None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:57.974655 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 128/252] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:12:57 2022] GET /identity/v3/role_assignments?user.id=cd0492ff5c9b45668210fee028d5850e&scope.project.id=047a5e1b44994e5690d32519e9f95eff&role.id=7b78e36083484a9a810a37da3f18974b => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:57.975888 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848b431-82cb-44c5-846c-e21481005fc8 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:57.976768 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848b431-82cb-44c5-846c-e21481005fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:57.977043 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848b431-82cb-44c5-846c-e21481005fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:58.011146 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-2848b431-82cb-44c5-846c-e21481005fc8 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:58.012490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-2848b431-82cb-44c5-846c-e21481005fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:58.019731 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1115f43b-ad49-4de2-b284-553b3a2ee0be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:58.021956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1115f43b-ad49-4de2-b284-553b3a2ee0be None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:58.077952 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:58.139032 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 125/253] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:12:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 04:12:58.140437 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 129/254] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:12:58.151154 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115f43b-ad49-4de2-b284-553b3a2ee0be None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:58.195623 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5695f-4b5a-4dce-bdc0-648a9530810b None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:58.195930 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5695f-4b5a-4dce-bdc0-648a9530810b None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:58.196223 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5695f-4b5a-4dce-bdc0-648a9530810b None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:58.197913 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 130/255] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:12:58.203952 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5695f-4b5a-4dce-bdc0-648a9530810b None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:58.265847 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115f43b-ad49-4de2-b284-553b3a2ee0be None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:58.307140 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632658a-7bd4-4ec6-9ff4-30db7c2ec1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:58.308080 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632658a-7bd4-4ec6-9ff4-30db7c2ec1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:58.308450 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632658a-7bd4-4ec6-9ff4-30db7c2ec1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:58.308733 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632658a-7bd4-4ec6-9ff4-30db7c2ec1b0 None admin] PATH_INFO: `/v3/projects/047a5e1b44994e5690d32519e9f95eff` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:58.310059 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632658a-7bd4-4ec6-9ff4-30db7c2ec1b0 None admin] RBAC: Authorizing `identity:get_project(project_id=047a5e1b44994e5690d32519e9f95eff)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:58.311661 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632658a-7bd4-4ec6-9ff4-30db7c2ec1b0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:58.313638 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 126/256] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:12:58 2022] GET /identity/v3/projects/047a5e1b44994e5690d32519e9f95eff => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:58.314886 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe504ccd-76c1-4aaf-8e88-903248c720c4 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:58.315175 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe504ccd-76c1-4aaf-8e88-903248c720c4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:58.315454 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe504ccd-76c1-4aaf-8e88-903248c720c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:58.334033 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-fe504ccd-76c1-4aaf-8e88-903248c720c4 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:12:58.335294 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-fe504ccd-76c1-4aaf-8e88-903248c720c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:12:58.347922 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:58.408072 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 127/257] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:12:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:12:58.409155 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe504ccd-76c1-4aaf-8e88-903248c720c4 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:58.420104 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5695f-4b5a-4dce-bdc0-648a9530810b None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:58.448650 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:58.499302 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c6c5d-acd5-43ea-a2c8-e87d3f8bc04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:58.500109 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c6c5d-acd5-43ea-a2c8-e87d3f8bc04c None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:58.500392 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c6c5d-acd5-43ea-a2c8-e87d3f8bc04c None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:58.500664 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c6c5d-acd5-43ea-a2c8-e87d3f8bc04c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:58.516335 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe504ccd-76c1-4aaf-8e88-903248c720c4 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:58.527479 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c6c5d-acd5-43ea-a2c8-e87d3f8bc04c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:12:58.547398 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-3d1c6c5d-acd5-43ea-a2c8-e87d3f8bc04c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 01 04:12:58.547398 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:12:58.547398 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:12:58.547398 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:12:58.547398 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:12:58.547398 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:12:58.547398 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:12:58.547398 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:12:58.547398 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:12:58.547398 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:12:58.547398 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:12:58.547398 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:12:58.547398 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:12:58.547398 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:12:58.547398 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:12:58.547398 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:12:58.548290 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:12:58.548290 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:12:58.548290 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:12:58.548290 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:12:58.548290 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:12:58.548290 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:12:58.548290 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:12:58.548290 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:12:58.548290 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:12:58.548290 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:12:58.548290 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:12:58.548290 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:12:58.548290 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:12:58.548290 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:12:58.548290 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:12:58.548290 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:12:58.549055 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:12:58.549055 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:12:58.549055 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:12:58.549055 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:12:58.549055 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:12:58.549055 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:12:58.549055 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:12:58.549055 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:12:58.549055 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:12:58.549055 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:12:58.549055 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 01 04:12:58.549055 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:12:58.549055 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 131/258] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:12:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:12:58.549708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c6c5d-acd5-43ea-a2c8-e87d3f8bc04c None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:58.554954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5715942-651a-4e83-b41b-a6ef43bfde55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:58.555621 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5715942-651a-4e83-b41b-a6ef43bfde55 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:58.556019 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5715942-651a-4e83-b41b-a6ef43bfde55 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:58.556300 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5715942-651a-4e83-b41b-a6ef43bfde55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:58.557308 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5715942-651a-4e83-b41b-a6ef43bfde55 None admin] RBAC: Adding query filter params (role.id=76fc054ad9544460a7be1e2010c23642, scope.project.id=047a5e1b44994e5690d32519e9f95eff, user.id=ff8ba619394c458fb8578d98a778789b) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:58.557669 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5715942-651a-4e83-b41b-a6ef43bfde55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:58.559166 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5715942-651a-4e83-b41b-a6ef43bfde55 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:58.566412 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 128/259] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:12:58 2022] GET /identity/v3/role_assignments?user.id=ff8ba619394c458fb8578d98a778789b&scope.project.id=047a5e1b44994e5690d32519e9f95eff&role.id=76fc054ad9544460a7be1e2010c23642 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:58.567420 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5715942-651a-4e83-b41b-a6ef43bfde55 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:58.582400 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:58.680726 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5715942-651a-4e83-b41b-a6ef43bfde55 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:58.714060 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c6c5d-acd5-43ea-a2c8-e87d3f8bc04c None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:58.720988 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796835c-f75b-4f84-acd1-f433ecfab276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:58.721784 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796835c-f75b-4f84-acd1-f433ecfab276 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:58.722108 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796835c-f75b-4f84-acd1-f433ecfab276 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:58.722386 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796835c-f75b-4f84-acd1-f433ecfab276 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:58.723143 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796835c-f75b-4f84-acd1-f433ecfab276 None admin] RBAC: Adding query filter params (name=member) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:58.723448 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796835c-f75b-4f84-acd1-f433ecfab276 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:58.724830 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796835c-f75b-4f84-acd1-f433ecfab276 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:58.734865 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 129/260] 10.222.0.32 () {56 vars in 1101 bytes} [Wed Jun 1 04:12:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:58.743234 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796835c-f75b-4f84-acd1-f433ecfab276 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:58.774946 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d690d-f67e-489b-a145-f1badd03015d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:58.775795 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d690d-f67e-489b-a145-f1badd03015d None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:58.776078 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d690d-f67e-489b-a145-f1badd03015d None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:58.776358 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d690d-f67e-489b-a145-f1badd03015d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:58.797398 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d690d-f67e-489b-a145-f1badd03015d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:12:58.805691 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-a79d690d-f67e-489b-a145-f1badd03015d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 04:12:58.805691 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:12:58.805691 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:12:58.805691 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:12:58.805691 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:12:58.805691 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:12:58.805691 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:12:58.805691 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:12:58.805691 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:12:58.805691 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:12:58.805691 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:12:58.805691 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:12:58.805691 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:12:58.805691 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:12:58.805691 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:12:58.805691 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:12:58.807867 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:12:58.807867 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:12:58.807867 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:12:58.807867 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:12:58.807867 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:12:58.807867 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:12:58.807867 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:12:58.807867 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:12:58.807867 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:12:58.807867 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:12:58.807867 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:12:58.807867 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:12:58.807867 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:12:58.807867 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:12:58.807867 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:12:58.807867 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:12:58.809725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:12:58.809725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:12:58.809725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:12:58.809725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:12:58.809725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:12:58.809725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:12:58.809725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:12:58.809725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:12:58.809725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:12:58.809725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:12:58.809725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 04:12:58.809725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:12:58.814768 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 132/261] 10.222.0.32 () {56 vars in 1114 bytes} [Wed Jun 1 04:12:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:12:58.821888 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d690d-f67e-489b-a145-f1badd03015d None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:58.859402 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:58.932732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d690d-f67e-489b-a145-f1badd03015d None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:58.938337 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:58.971821 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370049a-6086-48c7-86a9-67e5661f433d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:58.972413 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370049a-6086-48c7-86a9-67e5661f433d None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:58.972700 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370049a-6086-48c7-86a9-67e5661f433d None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:58.972980 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370049a-6086-48c7-86a9-67e5661f433d None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:58.973729 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370049a-6086-48c7-86a9-67e5661f433d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:58.974134 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370049a-6086-48c7-86a9-67e5661f433d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:58.975537 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370049a-6086-48c7-86a9-67e5661f433d None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:58.985636 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 133/262] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:12:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:58.992332 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370049a-6086-48c7-86a9-67e5661f433d None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:59.006174 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796835c-f75b-4f84-acd1-f433ecfab276 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:59.076548 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36a03e-83da-4a08-baab-854e15550dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:59.078298 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36a03e-83da-4a08-baab-854e15550dde None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:59.078852 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36a03e-83da-4a08-baab-854e15550dde None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:59.079420 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36a03e-83da-4a08-baab-854e15550dde None admin] PATH_INFO: `/v3/users/65a591927e53434abfe929d4a4bad802` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:59.080884 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b36a03e-83da-4a08-baab-854e15550dde None admin] RBAC: Authorizing `identity:get_user(user_id=65a591927e53434abfe929d4a4bad802)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:59.082798 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b36a03e-83da-4a08-baab-854e15550dde None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:59.084680 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 130/263] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:12:58 2022] GET /identity/v3/users/65a591927e53434abfe929d4a4bad802 => generated 297 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:59.096803 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:59.099134 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36a03e-83da-4a08-baab-854e15550dde None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:59.102945 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370049a-6086-48c7-86a9-67e5661f433d None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:59.138960 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c892c26-d4d5-4062-bde0-3315e491d2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:59.139839 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c892c26-d4d5-4062-bde0-3315e491d2a4 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:59.140127 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c892c26-d4d5-4062-bde0-3315e491d2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:59.140405 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c892c26-d4d5-4062-bde0-3315e491d2a4 None admin] PATH_INFO: `/v3/users/ff8ba619394c458fb8578d98a778789b` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:59.141605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c892c26-d4d5-4062-bde0-3315e491d2a4 None admin] RBAC: Authorizing `identity:get_user(user_id=ff8ba619394c458fb8578d98a778789b)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:59.143101 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c892c26-d4d5-4062-bde0-3315e491d2a4 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:59.144937 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 134/264] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:12:58 2022] GET /identity/v3/users/ff8ba619394c458fb8578d98a778789b => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:12:59.152784 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c892c26-d4d5-4062-bde0-3315e491d2a4 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:59.259141 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c892c26-d4d5-4062-bde0-3315e491d2a4 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:59.283334 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36a03e-83da-4a08-baab-854e15550dde None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:59.293900 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ff19d-4109-4069-845f-465f9d5807e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:59.294585 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ff19d-4109-4069-845f-465f9d5807e4 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:59.294868 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ff19d-4109-4069-845f-465f9d5807e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:59.295145 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ff19d-4109-4069-845f-465f9d5807e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:59.326990 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:59.345626 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6783b-c254-403e-81aa-133faa560bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:59.346894 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6783b-c254-403e-81aa-133faa560bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:59.347384 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6783b-c254-403e-81aa-133faa560bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:59.347945 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6783b-c254-403e-81aa-133faa560bb5 None admin] PATH_INFO: `/v3/projects/047a5e1b44994e5690d32519e9f95eff` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:59.352431 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c6783b-c254-403e-81aa-133faa560bb5 None admin] RBAC: Authorizing `identity:get_project(project_id=047a5e1b44994e5690d32519e9f95eff)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:59.354213 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c6783b-c254-403e-81aa-133faa560bb5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:59.356638 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 131/265] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:12:59 2022] GET /identity/v3/projects/047a5e1b44994e5690d32519e9f95eff => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:12:59.369739 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ff19d-4109-4069-845f-465f9d5807e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:59.371230 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ff19d-4109-4069-845f-465f9d5807e4 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:59.379832 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6783b-c254-403e-81aa-133faa560bb5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:59.397129 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:59.477543 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 135/266] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:12:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 01 04:12:59.482904 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ff19d-4109-4069-845f-465f9d5807e4 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:59.550405 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:59.585063 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6783b-c254-403e-81aa-133faa560bb5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:59.585888 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ff19d-4109-4069-845f-465f9d5807e4 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:59.627899 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c72cf-34f9-4967-b913-393607b42e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:59.628770 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c72cf-34f9-4967-b913-393607b42e83 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:59.629053 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c72cf-34f9-4967-b913-393607b42e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:59.629334 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c72cf-34f9-4967-b913-393607b42e83 None admin] PATH_INFO: `/v3/projects/047a5e1b44994e5690d32519e9f95eff` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:59.630723 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c72cf-34f9-4967-b913-393607b42e83 None admin] RBAC: Authorizing `identity:get_project(project_id=047a5e1b44994e5690d32519e9f95eff)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:59.632189 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c72cf-34f9-4967-b913-393607b42e83 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:59.634850 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 136/267] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:12:59 2022] GET /identity/v3/projects/047a5e1b44994e5690d32519e9f95eff => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:12:59.640850 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c72cf-34f9-4967-b913-393607b42e83 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:12:59.674714 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667522d9-ba1f-44de-8eb1-46b8c285a90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:59.675638 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667522d9-ba1f-44de-8eb1-46b8c285a90b None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:59.675926 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667522d9-ba1f-44de-8eb1-46b8c285a90b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:59.676206 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667522d9-ba1f-44de-8eb1-46b8c285a90b None admin] PATH_INFO: `/v3/projects/047a5e1b44994e5690d32519e9f95eff/users/65a591927e53434abfe929d4a4bad802/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:59.681271 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667522d9-ba1f-44de-8eb1-46b8c285a90b None admin] RBAC: Authorizing `identity:create_grant(project_id=047a5e1b44994e5690d32519e9f95eff, user_id=65a591927e53434abfe929d4a4bad802, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:59.683083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667522d9-ba1f-44de-8eb1-46b8c285a90b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:59.713696 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 132/268] 10.222.0.32 () {58 vars in 1439 bytes} [Wed Jun 1 04:12:59 2022] PUT /identity/v3/projects/047a5e1b44994e5690d32519e9f95eff/users/65a591927e53434abfe929d4a4bad802/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:12:59.768209 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c72cf-34f9-4967-b913-393607b42e83 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:12:59.829616 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:12:59.834670 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdebcc-1106-48e1-b21e-551fba9c2eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:12:59.835388 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdebcc-1106-48e1-b21e-551fba9c2eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:12:59.835651 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdebcc-1106-48e1-b21e-551fba9c2eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:12:59.835936 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdebcc-1106-48e1-b21e-551fba9c2eb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:12:59.836811 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fdebcc-1106-48e1-b21e-551fba9c2eb3 None admin] RBAC: Adding query filter params (role.id=71e70e8fe1344699a131764a348d51d6, scope.project.id=047a5e1b44994e5690d32519e9f95eff, user.id=ff8ba619394c458fb8578d98a778789b) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:12:59.837533 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fdebcc-1106-48e1-b21e-551fba9c2eb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:12:59.839211 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fdebcc-1106-48e1-b21e-551fba9c2eb3 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:12:59.846331 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 137/269] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:12:59 2022] GET /identity/v3/role_assignments?user.id=ff8ba619394c458fb8578d98a778789b&scope.project.id=047a5e1b44994e5690d32519e9f95eff&role.id=71e70e8fe1344699a131764a348d51d6 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:00.307013 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f90c7-2b54-4420-9b64-60b7eab1f0af None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:00.307522 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f90c7-2b54-4420-9b64-60b7eab1f0af None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:00.307597 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f90c7-2b54-4420-9b64-60b7eab1f0af None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:00.309174 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 133/270] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:00.314532 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96d13b-b7de-4566-9283-f0aa8099c5f2 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:00.314960 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96d13b-b7de-4566-9283-f0aa8099c5f2 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:00.315140 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96d13b-b7de-4566-9283-f0aa8099c5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:00.332411 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-7d96d13b-b7de-4566-9283-f0aa8099c5f2 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:00.333580 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7d96d13b-b7de-4566-9283-f0aa8099c5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:00.402803 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 138/271] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:13:00.426878 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f90c7-2b54-4420-9b64-60b7eab1f0af None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:00.433196 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b2c75-4509-420c-bad6-1dcfae1247ab None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:00.433504 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b2c75-4509-420c-bad6-1dcfae1247ab None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:00.433763 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b2c75-4509-420c-bad6-1dcfae1247ab None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:00.435570 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 139/272] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:00.447036 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe38e3b-dc76-4b18-95cc-844060e7659d None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:00.447551 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe38e3b-dc76-4b18-95cc-844060e7659d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:00.447975 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe38e3b-dc76-4b18-95cc-844060e7659d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:00.466029 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-6fe38e3b-dc76-4b18-95cc-844060e7659d None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:00.467216 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6fe38e3b-dc76-4b18-95cc-844060e7659d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:00.511645 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:00.555370 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f90c7-2b54-4420-9b64-60b7eab1f0af None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:00.561695 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 140/273] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 04:13:00.591940 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe38e3b-dc76-4b18-95cc-844060e7659d None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:00.595109 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ef070-284a-44c5-92de-401efeb83067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:00.595992 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ef070-284a-44c5-92de-401efeb83067 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:00.596287 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ef070-284a-44c5-92de-401efeb83067 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:00.596568 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ef070-284a-44c5-92de-401efeb83067 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:00.607855 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ef070-284a-44c5-92de-401efeb83067 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:00.615515 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-739ef070-284a-44c5-92de-401efeb83067 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 01 04:13:00.615515 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:00.615515 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:00.615515 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:00.615515 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:00.615515 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:00.615515 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:00.615515 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:00.615515 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:00.615515 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:00.615515 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:00.615515 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:00.615515 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:00.615515 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:00.615515 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:00.615515 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:00.616406 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:00.616406 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:00.616406 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:00.616406 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:00.616406 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:00.616406 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:00.616406 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:00.616406 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:00.616406 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:00.616406 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:00.616406 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:00.616406 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:00.616406 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:00.616406 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:00.616406 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:00.616406 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:00.617364 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:00.617364 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:00.617364 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:00.617364 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:00.617364 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:00.617364 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:00.617364 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:00.617364 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:00.617364 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:00.617364 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:00.617364 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 01 04:13:00.617364 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:00.617364 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 134/274] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:13:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:00.622565 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ef070-284a-44c5-92de-401efeb83067 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:00.664950 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:00.718944 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe38e3b-dc76-4b18-95cc-844060e7659d None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:00.755499 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b1e80-d070-4e23-bb95-d32cc906e533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:00.756298 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b1e80-d070-4e23-bb95-d32cc906e533 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:00.756584 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b1e80-d070-4e23-bb95-d32cc906e533 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:00.756868 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b1e80-d070-4e23-bb95-d32cc906e533 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:00.758182 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b1e80-d070-4e23-bb95-d32cc906e533 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:00.759541 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b1e80-d070-4e23-bb95-d32cc906e533 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:00.761446 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 141/275] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:13:00.762685 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330c150-f8b1-47c2-bc75-826b789be0d2 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:00.762978 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330c150-f8b1-47c2-bc75-826b789be0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:00.763255 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330c150-f8b1-47c2-bc75-826b789be0d2 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:00.766124 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 142/276] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:00.766435 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330c150-f8b1-47c2-bc75-826b789be0d2 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:00.768409 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ef070-284a-44c5-92de-401efeb83067 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:00.803821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:00.814324 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969cad0-5290-40f9-97cc-71d8dc6a3411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:00.815299 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969cad0-5290-40f9-97cc-71d8dc6a3411 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:00.815588 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969cad0-5290-40f9-97cc-71d8dc6a3411 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:00.815871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969cad0-5290-40f9-97cc-71d8dc6a3411 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:00.816791 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d969cad0-5290-40f9-97cc-71d8dc6a3411 None admin] RBAC: Adding query filter params (name=member) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:00.817112 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d969cad0-5290-40f9-97cc-71d8dc6a3411 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:00.819409 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d969cad0-5290-40f9-97cc-71d8dc6a3411 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:00.834602 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 135/277] 10.222.0.32 () {56 vars in 1101 bytes} [Wed Jun 1 04:13:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:13:00.834602 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bbaaf-1870-461b-a3e4-59dea01f50a9 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:00.834602 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bbaaf-1870-461b-a3e4-59dea01f50a9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:00.834602 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bbaaf-1870-461b-a3e4-59dea01f50a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:00.853810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-9f9bbaaf-1870-461b-a3e4-59dea01f50a9 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:00.855212 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9f9bbaaf-1870-461b-a3e4-59dea01f50a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:00.875485 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330c150-f8b1-47c2-bc75-826b789be0d2 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:00.901276 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:00.915242 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151ca97-0a2b-4345-b1f6-1ed777945fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:00.916106 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151ca97-0a2b-4345-b1f6-1ed777945fb1 None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:00.916389 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151ca97-0a2b-4345-b1f6-1ed777945fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:00.916670 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151ca97-0a2b-4345-b1f6-1ed777945fb1 None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:00.917377 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151ca97-0a2b-4345-b1f6-1ed777945fb1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:00.918874 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151ca97-0a2b-4345-b1f6-1ed777945fb1 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:00.931694 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 136/278] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:13:00.932713 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9bbaaf-1870-461b-a3e4-59dea01f50a9 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:00.951402 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 143/279] 10.222.0.32 () {60 vars in 1132 bytes} [Wed Jun 1 04:13:00 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:13:00.955464 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151ca97-0a2b-4345-b1f6-1ed777945fb1 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:01.063181 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9bbaaf-1870-461b-a3e4-59dea01f50a9 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:01.079264 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151ca97-0a2b-4345-b1f6-1ed777945fb1 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:01.094444 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:01.115788 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5612457-23fa-4042-9c18-808ba9d68262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:01.117273 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5612457-23fa-4042-9c18-808ba9d68262 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:01.117566 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5612457-23fa-4042-9c18-808ba9d68262 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:01.117836 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5612457-23fa-4042-9c18-808ba9d68262 None admin] PATH_INFO: `/v3/users/7eec6f884f414bcb98e41629c596ef86` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:01.120405 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b4203-6035-4a36-9e16-b102372a62f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:01.121520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b4203-6035-4a36-9e16-b102372a62f0 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:01.121955 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b4203-6035-4a36-9e16-b102372a62f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:01.122491 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b4203-6035-4a36-9e16-b102372a62f0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:01.138264 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5612457-23fa-4042-9c18-808ba9d68262 None admin] RBAC: Authorizing `identity:get_user(user_id=7eec6f884f414bcb98e41629c596ef86)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:01.139435 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b4203-6035-4a36-9e16-b102372a62f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:01.140044 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5612457-23fa-4042-9c18-808ba9d68262 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:01.141819 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 137/280] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:13:00 2022] GET /identity/v3/users/7eec6f884f414bcb98e41629c596ef86 => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:01.147625 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5612457-23fa-4042-9c18-808ba9d68262 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:01.148925 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-922b4203-6035-4a36-9e16-b102372a62f0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 01 04:13:01.148925 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:01.148925 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:01.148925 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:01.148925 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:01.148925 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:01.148925 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:01.148925 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:01.148925 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:01.148925 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:01.148925 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:01.148925 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:01.148925 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:01.148925 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:01.148925 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:01.148925 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:01.149786 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:01.149786 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:01.149786 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:01.149786 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:01.149786 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:01.149786 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:01.149786 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:01.149786 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:01.149786 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:01.149786 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:01.149786 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:01.149786 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:01.149786 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:01.149786 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:01.149786 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:01.149786 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:01.150632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:01.150632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:01.150632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:01.150632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:01.150632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:01.150632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:01.150632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:01.150632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:01.150632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:01.150632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:01.150632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 01 04:13:01.150632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:01.153134 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 144/281] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:13:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:01.159137 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b4203-6035-4a36-9e16-b102372a62f0 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:01.214538 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:01.279884 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5612457-23fa-4042-9c18-808ba9d68262 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:01.295286 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b4203-6035-4a36-9e16-b102372a62f0 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:01.321497 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13629f-c2fd-46c7-b46c-4f768d0e9ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:01.322225 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13629f-c2fd-46c7-b46c-4f768d0e9ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:01.322580 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13629f-c2fd-46c7-b46c-4f768d0e9ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:01.322926 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13629f-c2fd-46c7-b46c-4f768d0e9ae2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:01.323832 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13629f-c2fd-46c7-b46c-4f768d0e9ae2 None admin] RBAC: Adding query filter params (role.id=3f08ec4046094d04a533ba522f71ba9a, user.id=7eec6f884f414bcb98e41629c596ef86, scope.system=all) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:01.324215 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13629f-c2fd-46c7-b46c-4f768d0e9ae2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:01.325919 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13629f-c2fd-46c7-b46c-4f768d0e9ae2 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:01.331704 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 138/282] 10.222.0.32 () {56 vars in 1308 bytes} [Wed Jun 1 04:13:01 2022] GET /identity/v3/role_assignments?user.id=7eec6f884f414bcb98e41629c596ef86&scope.system=all&role.id=3f08ec4046094d04a533ba522f71ba9a => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:13:01.334429 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef89855-1d59-4acb-bc1f-9cdd87198cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:01.336179 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef89855-1d59-4acb-bc1f-9cdd87198cde None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:01.336605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef89855-1d59-4acb-bc1f-9cdd87198cde None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:01.337018 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef89855-1d59-4acb-bc1f-9cdd87198cde None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:01.337988 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef89855-1d59-4acb-bc1f-9cdd87198cde None admin] RBAC: Adding query filter params (name=reader) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:01.338459 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef89855-1d59-4acb-bc1f-9cdd87198cde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:01.339892 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef89855-1d59-4acb-bc1f-9cdd87198cde None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:01.350325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 145/283] 10.222.0.32 () {56 vars in 1101 bytes} [Wed Jun 1 04:13:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:13:01.356570 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13629f-c2fd-46c7-b46c-4f768d0e9ae2 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:01.406799 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:01.473281 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13629f-c2fd-46c7-b46c-4f768d0e9ae2 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:01.518368 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef7df7-49dd-4e6c-8c80-332093f6d51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:01.519722 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef7df7-49dd-4e6c-8c80-332093f6d51a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:01.520005 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef7df7-49dd-4e6c-8c80-332093f6d51a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:01.520280 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef7df7-49dd-4e6c-8c80-332093f6d51a None admin] PATH_INFO: `/v3/users/cd0492ff5c9b45668210fee028d5850e` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:01.521559 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aef7df7-49dd-4e6c-8c80-332093f6d51a None admin] RBAC: Authorizing `identity:get_user(user_id=cd0492ff5c9b45668210fee028d5850e)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:01.523686 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aef7df7-49dd-4e6c-8c80-332093f6d51a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:01.525445 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 139/284] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:13:01 2022] GET /identity/v3/users/cd0492ff5c9b45668210fee028d5850e => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:01.531017 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef89855-1d59-4acb-bc1f-9cdd87198cde None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:01.648842 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef89855-1d59-4acb-bc1f-9cdd87198cde None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:01.650737 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:01.686173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f68fa-7d7b-4b4c-98ed-f3f701442217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:01.687422 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f68fa-7d7b-4b4c-98ed-f3f701442217 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:01.687912 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f68fa-7d7b-4b4c-98ed-f3f701442217 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:01.688390 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f68fa-7d7b-4b4c-98ed-f3f701442217 None admin] PATH_INFO: `/v3/projects/047a5e1b44994e5690d32519e9f95eff` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:01.689812 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f68fa-7d7b-4b4c-98ed-f3f701442217 None admin] RBAC: Authorizing `identity:get_project(project_id=047a5e1b44994e5690d32519e9f95eff)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:01.691485 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f68fa-7d7b-4b4c-98ed-f3f701442217 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:01.693680 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 146/285] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:13:01 2022] GET /identity/v3/projects/047a5e1b44994e5690d32519e9f95eff => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:01.699786 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef7df7-49dd-4e6c-8c80-332093f6d51a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:01.828930 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef7df7-49dd-4e6c-8c80-332093f6d51a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:01.840682 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:01.864619 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403ba61-b446-4cb4-8319-71479b3eec25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:01.865517 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403ba61-b446-4cb4-8319-71479b3eec25 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:01.865797 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403ba61-b446-4cb4-8319-71479b3eec25 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:01.866095 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403ba61-b446-4cb4-8319-71479b3eec25 None admin] PATH_INFO: `/v3/projects/047a5e1b44994e5690d32519e9f95eff/users/cd0492ff5c9b45668210fee028d5850e/roles/7b78e36083484a9a810a37da3f18974b` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:01.868101 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7403ba61-b446-4cb4-8319-71479b3eec25 None admin] RBAC: Authorizing `identity:create_grant(project_id=047a5e1b44994e5690d32519e9f95eff, user_id=cd0492ff5c9b45668210fee028d5850e, role_id=7b78e36083484a9a810a37da3f18974b)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:01.869545 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7403ba61-b446-4cb4-8319-71479b3eec25 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:01.884672 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 140/286] 10.222.0.32 () {58 vars in 1439 bytes} [Wed Jun 1 04:13:01 2022] PUT /identity/v3/projects/047a5e1b44994e5690d32519e9f95eff/users/cd0492ff5c9b45668210fee028d5850e/roles/7b78e36083484a9a810a37da3f18974b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:13:02.455312 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27925057-6402-4fa5-998c-97f2f9cbeda7 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:02.456355 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27925057-6402-4fa5-998c-97f2f9cbeda7 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:02.456848 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27925057-6402-4fa5-998c-97f2f9cbeda7 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:02.458561 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 147/287] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:02.471429 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b6702-3181-48f1-93eb-a7ce6a5c3fd7 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:02.472328 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b6702-3181-48f1-93eb-a7ce6a5c3fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:02.472811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b6702-3181-48f1-93eb-a7ce6a5c3fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:02.498965 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-503b6702-3181-48f1-93eb-a7ce6a5c3fd7 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:02.500515 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-503b6702-3181-48f1-93eb-a7ce6a5c3fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:02.585748 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 141/288] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:13:02.629665 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27925057-6402-4fa5-998c-97f2f9cbeda7 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:02.767907 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27925057-6402-4fa5-998c-97f2f9cbeda7 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:02.817379 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397cc384-e938-4ff2-adc8-bc280cf6c6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:02.818847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397cc384-e938-4ff2-adc8-bc280cf6c6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:02.819337 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397cc384-e938-4ff2-adc8-bc280cf6c6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:02.819843 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397cc384-e938-4ff2-adc8-bc280cf6c6e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:02.831047 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397cc384-e938-4ff2-adc8-bc280cf6c6e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:02.839774 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-397cc384-e938-4ff2-adc8-bc280cf6c6e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 01 04:13:02.839774 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:02.839774 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:02.839774 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:02.839774 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:02.839774 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:02.839774 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:02.839774 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:02.839774 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:02.839774 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:02.839774 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:02.839774 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:02.839774 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:02.839774 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:02.839774 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:02.839774 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:02.840682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:02.840682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:02.840682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:02.840682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:02.840682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:02.840682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:02.840682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:02.840682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:02.840682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:02.840682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:02.840682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:02.840682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:02.840682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:02.840682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:02.840682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:02.840682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:02.841490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:02.841490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:02.841490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:02.841490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:02.841490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:02.841490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:02.841490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:02.841490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:02.841490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:02.841490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:02.841490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 01 04:13:02.841490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:02.844114 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 148/289] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:13:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:02.849965 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b6702-3181-48f1-93eb-a7ce6a5c3fd7 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:02.997934 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:03.000932 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b6702-3181-48f1-93eb-a7ce6a5c3fd7 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:03.037666 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9c935-0174-4907-8d82-0c61e1028931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:03.038283 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9c935-0174-4907-8d82-0c61e1028931 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:03.039118 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9c935-0174-4907-8d82-0c61e1028931 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:03.039401 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9c935-0174-4907-8d82-0c61e1028931 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:03.040147 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9c935-0174-4907-8d82-0c61e1028931 None admin] RBAC: Adding query filter params (name=member) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:03.040451 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9c935-0174-4907-8d82-0c61e1028931 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:03.041825 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9c935-0174-4907-8d82-0c61e1028931 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:03.050581 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 142/290] 10.222.0.32 () {56 vars in 1101 bytes} [Wed Jun 1 04:13:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:03.055850 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397cc384-e938-4ff2-adc8-bc280cf6c6e1 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:03.094503 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:03.169505 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397cc384-e938-4ff2-adc8-bc280cf6c6e1 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:03.216311 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e6c97-159a-4950-80ad-c535f71fc4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:03.217232 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e6c97-159a-4950-80ad-c535f71fc4f5 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:03.217523 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e6c97-159a-4950-80ad-c535f71fc4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:03.217795 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e6c97-159a-4950-80ad-c535f71fc4f5 None admin] PATH_INFO: `/v3/users/65a591927e53434abfe929d4a4bad802` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:03.219982 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e6c97-159a-4950-80ad-c535f71fc4f5 None admin] RBAC: Authorizing `identity:get_user(user_id=65a591927e53434abfe929d4a4bad802)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:03.221416 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e6c97-159a-4950-80ad-c535f71fc4f5 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:03.223236 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 149/291] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:13:03 2022] GET /identity/v3/users/65a591927e53434abfe929d4a4bad802 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:13:03.228736 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9c935-0174-4907-8d82-0c61e1028931 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:03.356818 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9c935-0174-4907-8d82-0c61e1028931 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:03.399296 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99409e61-67d2-4605-b59c-64ef9a252307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:03.399956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99409e61-67d2-4605-b59c-64ef9a252307 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:03.400238 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99409e61-67d2-4605-b59c-64ef9a252307 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:03.400514 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99409e61-67d2-4605-b59c-64ef9a252307 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:03.438473 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:03.489442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99409e61-67d2-4605-b59c-64ef9a252307 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:03.490933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99409e61-67d2-4605-b59c-64ef9a252307 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:03.631496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 143/292] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:13:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 04:13:03.637157 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e6c97-159a-4950-80ad-c535f71fc4f5 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:03.761664 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:03.769616 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e6c97-159a-4950-80ad-c535f71fc4f5 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:03.804913 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66198545-1352-45c0-87e5-7d3a8ea9b350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:03.805775 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66198545-1352-45c0-87e5-7d3a8ea9b350 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:03.806093 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66198545-1352-45c0-87e5-7d3a8ea9b350 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:03.806370 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66198545-1352-45c0-87e5-7d3a8ea9b350 None admin] PATH_INFO: `/v3/projects/047a5e1b44994e5690d32519e9f95eff` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:03.807557 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66198545-1352-45c0-87e5-7d3a8ea9b350 None admin] RBAC: Authorizing `identity:get_project(project_id=047a5e1b44994e5690d32519e9f95eff)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:03.809118 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66198545-1352-45c0-87e5-7d3a8ea9b350 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:03.811249 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 150/293] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:13:03 2022] GET /identity/v3/projects/047a5e1b44994e5690d32519e9f95eff => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:03.817025 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99409e61-67d2-4605-b59c-64ef9a252307 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:03.903159 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:03.954651 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99409e61-67d2-4605-b59c-64ef9a252307 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:04.009292 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff54d9-f741-4f3e-bae1-8e69f465064a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:04.009956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff54d9-f741-4f3e-bae1-8e69f465064a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:04.010267 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff54d9-f741-4f3e-bae1-8e69f465064a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:04.010540 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff54d9-f741-4f3e-bae1-8e69f465064a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:04.011371 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff54d9-f741-4f3e-bae1-8e69f465064a None admin] RBAC: Adding query filter params (role.id=3f08ec4046094d04a533ba522f71ba9a, scope.project.id=047a5e1b44994e5690d32519e9f95eff, user.id=65a591927e53434abfe929d4a4bad802) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:04.011679 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff54d9-f741-4f3e-bae1-8e69f465064a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:04.013139 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff54d9-f741-4f3e-bae1-8e69f465064a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:04.021785 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 144/294] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:13:03 2022] GET /identity/v3/role_assignments?user.id=65a591927e53434abfe929d4a4bad802&scope.project.id=047a5e1b44994e5690d32519e9f95eff&role.id=3f08ec4046094d04a533ba522f71ba9a => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:04.067615 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5334cd-7b74-44a7-ab81-41484b1a3b6f None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:04.067960 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5334cd-7b74-44a7-ab81-41484b1a3b6f None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:04.068240 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5334cd-7b74-44a7-ab81-41484b1a3b6f None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:04.070896 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 151/295] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:04.076881 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6ec5c-266f-4ff3-a1af-80d442fb17b9 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:04.077212 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6ec5c-266f-4ff3-a1af-80d442fb17b9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:04.077438 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6ec5c-266f-4ff3-a1af-80d442fb17b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:04.086852 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c69e1-3ad4-4286-930b-887490ef110a None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:04.087186 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c69e1-3ad4-4286-930b-887490ef110a None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:04.087407 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c69e1-3ad4-4286-930b-887490ef110a None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:04.089059 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 152/296] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:13:04.095004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe153b28-0abe-49d9-b61a-6ea17918b641 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:04.095313 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe153b28-0abe-49d9-b61a-6ea17918b641 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:04.095555 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe153b28-0abe-49d9-b61a-6ea17918b641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:04.115969 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2ea6ec5c-266f-4ff3-a1af-80d442fb17b9 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:04.117747 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2ea6ec5c-266f-4ff3-a1af-80d442fb17b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:04.124417 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-fe153b28-0abe-49d9-b61a-6ea17918b641 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:04.125617 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-fe153b28-0abe-49d9-b61a-6ea17918b641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:04.249194 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 153/297] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 04:13:04.264722 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 145/298] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:13:04.272580 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe153b28-0abe-49d9-b61a-6ea17918b641 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:04.288514 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6ec5c-266f-4ff3-a1af-80d442fb17b9 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:04.360686 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:04.417828 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6ec5c-266f-4ff3-a1af-80d442fb17b9 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:04.419454 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:04.427605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe153b28-0abe-49d9-b61a-6ea17918b641 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:04.458188 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe67ca-22c2-4e00-a978-8865f81aed04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:04.459000 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe67ca-22c2-4e00-a978-8865f81aed04 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:04.459277 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe67ca-22c2-4e00-a978-8865f81aed04 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:04.459550 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe67ca-22c2-4e00-a978-8865f81aed04 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:04.471936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe67ca-22c2-4e00-a978-8865f81aed04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:04.476959 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1af39-cd50-46f0-b6f2-0fbd05e15069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:04.478045 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1af39-cd50-46f0-b6f2-0fbd05e15069 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:04.478512 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1af39-cd50-46f0-b6f2-0fbd05e15069 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:04.478936 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1af39-cd50-46f0-b6f2-0fbd05e15069 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:04.481015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-5abe67ca-22c2-4e00-a978-8865f81aed04 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 01 04:13:04.481015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:04.481015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:04.481015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:04.481015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:04.481015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:04.481015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:04.481015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:04.481015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:04.481015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:04.481015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:04.481015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:04.481015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:04.481015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:04.481015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:04.481015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:04.481921 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:04.481921 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:04.481921 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:04.481921 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:04.481921 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:04.481921 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:04.481921 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:04.481921 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:04.481921 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:04.481921 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:04.481921 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:04.481921 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:04.481921 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:04.481921 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:04.481921 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:04.481921 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:04.482773 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:04.482773 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:04.482773 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:04.482773 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:04.482773 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:04.482773 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:04.482773 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:04.482773 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:04.482773 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:04.482773 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:04.482773 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 01 04:13:04.482773 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:04.482773 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 146/299] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:13:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:04.483435 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1220768-119d-4329-bd74-7ccb4aadcfba None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:04.483503 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1220768-119d-4329-bd74-7ccb4aadcfba None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:04.484104 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1220768-119d-4329-bd74-7ccb4aadcfba None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:04.485160 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 147/300] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:04.493193 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0861b2-f19f-492f-ad9b-bb7810f9f52e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:04.493193 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0861b2-f19f-492f-ad9b-bb7810f9f52e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:04.493193 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0861b2-f19f-492f-ad9b-bb7810f9f52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:04.501781 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd1af39-cd50-46f0-b6f2-0fbd05e15069 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:04.512019 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-8fd1af39-cd50-46f0-b6f2-0fbd05e15069 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 01 04:13:04.512019 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:04.512019 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:04.512019 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:04.512019 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:04.512019 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:04.512019 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:04.512019 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:04.512019 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:04.512019 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:04.512019 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:04.512019 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:04.512019 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:04.512019 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:04.512019 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:04.512019 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:04.512948 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:04.512948 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:04.512948 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:04.512948 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:04.512948 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:04.512948 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:04.512948 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:04.512948 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:04.512948 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:04.512948 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:04.512948 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:04.512948 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:04.512948 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:04.512948 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:04.512948 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:04.512948 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:04.513720 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:04.513720 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:04.513720 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:04.513720 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:04.513720 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:04.513720 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:04.513720 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:04.513720 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:04.513720 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:04.513720 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:04.513720 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 01 04:13:04.513720 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:04.513720 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 154/301] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:13:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:04.513720 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1af39-cd50-46f0-b6f2-0fbd05e15069 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:04.514466 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-9e0861b2-f19f-492f-ad9b-bb7810f9f52e None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:04.515118 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9e0861b2-f19f-492f-ad9b-bb7810f9f52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:04.587607 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 148/302] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 04:13:04.595749 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0861b2-f19f-492f-ad9b-bb7810f9f52e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:04.627042 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1af39-cd50-46f0-b6f2-0fbd05e15069 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:04.643999 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:04.664354 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f44744-21ad-4e30-aa1c-e184fd319c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:04.665021 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f44744-21ad-4e30-aa1c-e184fd319c1c None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:04.665310 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f44744-21ad-4e30-aa1c-e184fd319c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:04.665602 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f44744-21ad-4e30-aa1c-e184fd319c1c None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:04.666382 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f44744-21ad-4e30-aa1c-e184fd319c1c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:04.666702 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f44744-21ad-4e30-aa1c-e184fd319c1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:04.668138 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f44744-21ad-4e30-aa1c-e184fd319c1c None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:04.681942 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 155/303] 10.222.0.32 () {56 vars in 1101 bytes} [Wed Jun 1 04:13:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:04.681942 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f44744-21ad-4e30-aa1c-e184fd319c1c None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:04.703226 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:04.706469 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0861b2-f19f-492f-ad9b-bb7810f9f52e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:04.742753 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19e1e8-01d4-4f38-8b08-a0453add76d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:04.743420 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19e1e8-01d4-4f38-8b08-a0453add76d8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:04.743702 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19e1e8-01d4-4f38-8b08-a0453add76d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:04.743982 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19e1e8-01d4-4f38-8b08-a0453add76d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:04.744719 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19e1e8-01d4-4f38-8b08-a0453add76d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:04.745020 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19e1e8-01d4-4f38-8b08-a0453add76d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:04.746434 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19e1e8-01d4-4f38-8b08-a0453add76d8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:04.754836 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 149/304] 10.222.0.32 () {56 vars in 1101 bytes} [Wed Jun 1 04:13:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:04.755524 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19e1e8-01d4-4f38-8b08-a0453add76d8 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:04.797769 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f44744-21ad-4e30-aa1c-e184fd319c1c None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:04.832143 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9394cb8-ebae-419c-a2b5-302606cd680a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:04.832928 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9394cb8-ebae-419c-a2b5-302606cd680a None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:04.833208 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9394cb8-ebae-419c-a2b5-302606cd680a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:04.833484 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9394cb8-ebae-419c-a2b5-302606cd680a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:04.834683 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9394cb8-ebae-419c-a2b5-302606cd680a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:04.836679 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9394cb8-ebae-419c-a2b5-302606cd680a None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:04.838325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 156/305] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:04.842956 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9394cb8-ebae-419c-a2b5-302606cd680a None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:04.862653 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19e1e8-01d4-4f38-8b08-a0453add76d8 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:04.871308 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:04.896993 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabcc96-d0cf-4d26-a7bc-eed0b4aad454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:04.898587 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabcc96-d0cf-4d26-a7bc-eed0b4aad454 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:04.898874 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabcc96-d0cf-4d26-a7bc-eed0b4aad454 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:04.899148 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabcc96-d0cf-4d26-a7bc-eed0b4aad454 None admin] PATH_INFO: `/v3/users/32b1d9f529be45ad9935063db45da84e` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:04.912250 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabcc96-d0cf-4d26-a7bc-eed0b4aad454 None admin] RBAC: Authorizing `identity:get_user(user_id=32b1d9f529be45ad9935063db45da84e)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:04.913718 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabcc96-d0cf-4d26-a7bc-eed0b4aad454 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:04.915409 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 150/306] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:13:04 2022] GET /identity/v3/users/32b1d9f529be45ad9935063db45da84e => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:04.916641 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66b76c-4d52-4b33-a964-57dbc8ffb3df None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:04.916926 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66b76c-4d52-4b33-a964-57dbc8ffb3df None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:04.917203 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66b76c-4d52-4b33-a964-57dbc8ffb3df None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:04.922058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 151/307] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:04.922058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66b76c-4d52-4b33-a964-57dbc8ffb3df None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:04.935766 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:04.952718 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9394cb8-ebae-419c-a2b5-302606cd680a None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:04.985268 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ff702-3e47-4ff7-a5d5-1689f978aab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:04.986178 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ff702-3e47-4ff7-a5d5-1689f978aab0 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:04.986466 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ff702-3e47-4ff7-a5d5-1689f978aab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:04.986745 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ff702-3e47-4ff7-a5d5-1689f978aab0 None admin] PATH_INFO: `/v3/users/7eec6f884f414bcb98e41629c596ef86` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:04.988063 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ff702-3e47-4ff7-a5d5-1689f978aab0 None admin] RBAC: Authorizing `identity:get_user(user_id=7eec6f884f414bcb98e41629c596ef86)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:04.989526 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ff702-3e47-4ff7-a5d5-1689f978aab0 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:04.991190 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 157/308] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:13:04 2022] GET /identity/v3/users/7eec6f884f414bcb98e41629c596ef86 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:04.996567 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ff702-3e47-4ff7-a5d5-1689f978aab0 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:05.019030 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66b76c-4d52-4b33-a964-57dbc8ffb3df None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:05.051390 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8768d-926d-4a52-ae21-449e43a8bfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:05.052074 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8768d-926d-4a52-ae21-449e43a8bfe5 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:05.052344 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8768d-926d-4a52-ae21-449e43a8bfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:05.052621 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8768d-926d-4a52-ae21-449e43a8bfe5 None admin] PATH_INFO: `/v3/groups` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:05.053311 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8768d-926d-4a52-ae21-449e43a8bfe5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:05.055277 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8768d-926d-4a52-ae21-449e43a8bfe5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:05.069080 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 152/309] 10.222.0.32 () {60 vars in 1134 bytes} [Wed Jun 1 04:13:04 2022] POST /identity/v3/groups => generated 229 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:13:05.082213 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0740e-3122-418d-8f3d-556f6ae2e604 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:05.082213 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0740e-3122-418d-8f3d-556f6ae2e604 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:05.082213 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0740e-3122-418d-8f3d-556f6ae2e604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:05.093739 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ff702-3e47-4ff7-a5d5-1689f978aab0 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:05.109042 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c1c0740e-3122-418d-8f3d-556f6ae2e604 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:05.110315 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c1c0740e-3122-418d-8f3d-556f6ae2e604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:05.133180 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70748400-b83d-4b8a-883d-c5b9ee64b745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:05.133854 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70748400-b83d-4b8a-883d-c5b9ee64b745 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:05.134189 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70748400-b83d-4b8a-883d-c5b9ee64b745 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:05.134474 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70748400-b83d-4b8a-883d-c5b9ee64b745 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:05.135335 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70748400-b83d-4b8a-883d-c5b9ee64b745 None admin] RBAC: Adding query filter params (role.id=7b78e36083484a9a810a37da3f18974b, user.id=32b1d9f529be45ad9935063db45da84e, scope.system=all) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:05.135653 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70748400-b83d-4b8a-883d-c5b9ee64b745 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:05.136122 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:05.137168 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70748400-b83d-4b8a-883d-c5b9ee64b745 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:05.154002 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 158/310] 10.222.0.32 () {56 vars in 1308 bytes} [Wed Jun 1 04:13:04 2022] GET /identity/v3/role_assignments?user.id=32b1d9f529be45ad9935063db45da84e&scope.system=all&role.id=7b78e36083484a9a810a37da3f18974b => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:05.154002 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70748400-b83d-4b8a-883d-c5b9ee64b745 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:05.196133 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:05.222444 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 153/311] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:13:05.239031 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0740e-3122-418d-8f3d-556f6ae2e604 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:05.321541 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70748400-b83d-4b8a-883d-c5b9ee64b745 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:05.365755 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0740e-3122-418d-8f3d-556f6ae2e604 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:05.371364 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c32ef-2058-4c24-89d0-ea94cc4ce1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:05.372240 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c32ef-2058-4c24-89d0-ea94cc4ce1b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:05.372523 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c32ef-2058-4c24-89d0-ea94cc4ce1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:05.372804 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c32ef-2058-4c24-89d0-ea94cc4ce1b7 None admin] PATH_INFO: `/v3/system/users/7eec6f884f414bcb98e41629c596ef86/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:05.374815 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94c32ef-2058-4c24-89d0-ea94cc4ce1b7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7eec6f884f414bcb98e41629c596ef86, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:05.375733 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94c32ef-2058-4c24-89d0-ea94cc4ce1b7 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:05.387938 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 159/312] 10.222.0.32 () {58 vars in 1334 bytes} [Wed Jun 1 04:13:05 2022] PUT /identity/v3/system/users/7eec6f884f414bcb98e41629c596ef86/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:13:05.407711 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec975fc-9178-42f3-875f-b9e16d3b9719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:05.408574 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec975fc-9178-42f3-875f-b9e16d3b9719 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:05.408859 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec975fc-9178-42f3-875f-b9e16d3b9719 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:05.409136 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec975fc-9178-42f3-875f-b9e16d3b9719 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:05.429542 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec975fc-9178-42f3-875f-b9e16d3b9719 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:05.438184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-6ec975fc-9178-42f3-875f-b9e16d3b9719 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 01 04:13:05.438184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:05.438184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:05.438184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:05.438184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:05.438184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:05.438184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:05.438184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:05.438184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:05.438184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:05.438184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:05.438184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:05.438184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:05.438184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:05.438184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:05.438184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:05.439142 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:05.439142 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:05.439142 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:05.439142 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:05.439142 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:05.439142 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:05.439142 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:05.439142 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:05.439142 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:05.439142 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:05.439142 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:05.439142 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:05.439142 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:05.439142 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:05.439142 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:05.439142 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:05.440242 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:05.440242 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:05.440242 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:05.440242 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:05.440242 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:05.440242 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:05.440242 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:05.440242 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:05.440242 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:05.440242 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:05.440242 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 01 04:13:05.440242 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:05.440242 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 154/313] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:13:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:13:05.447499 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c32ef-2058-4c24-89d0-ea94cc4ce1b7 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:05.550379 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:05.569954 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c32ef-2058-4c24-89d0-ea94cc4ce1b7 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:05.609729 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eda254-6170-4050-ba11-8fb550343177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:05.610429 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eda254-6170-4050-ba11-8fb550343177 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:05.610715 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eda254-6170-4050-ba11-8fb550343177 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:05.610993 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eda254-6170-4050-ba11-8fb550343177 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:05.611747 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eda254-6170-4050-ba11-8fb550343177 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:05.612056 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eda254-6170-4050-ba11-8fb550343177 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:05.613437 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eda254-6170-4050-ba11-8fb550343177 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:05.623836 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 160/314] 10.222.0.32 () {56 vars in 1101 bytes} [Wed Jun 1 04:13:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:05.629372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec975fc-9178-42f3-875f-b9e16d3b9719 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:05.648828 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:05.746675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec975fc-9178-42f3-875f-b9e16d3b9719 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:05.782068 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c9a35-237f-4bc6-86ac-424774027b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:05.782957 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c9a35-237f-4bc6-86ac-424774027b87 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:05.783244 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c9a35-237f-4bc6-86ac-424774027b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:05.783524 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c9a35-237f-4bc6-86ac-424774027b87 None admin] PATH_INFO: `/v3/users/cd0492ff5c9b45668210fee028d5850e` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:05.784730 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c9a35-237f-4bc6-86ac-424774027b87 None admin] RBAC: Authorizing `identity:get_user(user_id=cd0492ff5c9b45668210fee028d5850e)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:05.786219 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c9a35-237f-4bc6-86ac-424774027b87 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:05.788160 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 155/315] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:13:05 2022] GET /identity/v3/users/cd0492ff5c9b45668210fee028d5850e => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:05.795323 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eda254-6170-4050-ba11-8fb550343177 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:05.900867 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eda254-6170-4050-ba11-8fb550343177 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:05.936371 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4068138-a0d8-450b-925d-57f759782ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:05.937025 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4068138-a0d8-450b-925d-57f759782ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:05.937309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4068138-a0d8-450b-925d-57f759782ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:05.937587 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4068138-a0d8-450b-925d-57f759782ff9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:05.954327 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:06.009908 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4068138-a0d8-450b-925d-57f759782ff9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:06.011326 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4068138-a0d8-450b-925d-57f759782ff9 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:06.113368 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 161/316] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:13:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 04:13:06.118903 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c9a35-237f-4bc6-86ac-424774027b87 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:06.207026 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:06.223874 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c9a35-237f-4bc6-86ac-424774027b87 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:06.258460 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14144c-d5e6-4ce0-8771-c48a81a187d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:06.259327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14144c-d5e6-4ce0-8771-c48a81a187d7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:06.259610 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14144c-d5e6-4ce0-8771-c48a81a187d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:06.259887 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14144c-d5e6-4ce0-8771-c48a81a187d7 None admin] PATH_INFO: `/v3/projects/047a5e1b44994e5690d32519e9f95eff` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:06.261123 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f14144c-d5e6-4ce0-8771-c48a81a187d7 None admin] RBAC: Authorizing `identity:get_project(project_id=047a5e1b44994e5690d32519e9f95eff)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:06.262537 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f14144c-d5e6-4ce0-8771-c48a81a187d7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:06.264519 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 156/317] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:13:06 2022] GET /identity/v3/projects/047a5e1b44994e5690d32519e9f95eff => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:06.270316 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4068138-a0d8-450b-925d-57f759782ff9 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:06.326360 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:06.374320 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4068138-a0d8-450b-925d-57f759782ff9 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:06.412262 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691b350-7c23-4a62-adac-e57de7de06b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:06.412977 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691b350-7c23-4a62-adac-e57de7de06b8 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:06.413772 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691b350-7c23-4a62-adac-e57de7de06b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:06.414136 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691b350-7c23-4a62-adac-e57de7de06b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:06.414966 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1691b350-7c23-4a62-adac-e57de7de06b8 None admin] RBAC: Adding query filter params (role.id=7b78e36083484a9a810a37da3f18974b, scope.project.id=047a5e1b44994e5690d32519e9f95eff, user.id=cd0492ff5c9b45668210fee028d5850e) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:06.415332 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1691b350-7c23-4a62-adac-e57de7de06b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:06.416796 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1691b350-7c23-4a62-adac-e57de7de06b8 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:06.422896 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 162/318] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:13:06 2022] GET /identity/v3/role_assignments?user.id=cd0492ff5c9b45668210fee028d5850e&scope.project.id=047a5e1b44994e5690d32519e9f95eff&role.id=7b78e36083484a9a810a37da3f18974b => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:07.456117 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ef1ca-9c26-4a7b-b6e9-5e16e42011c4 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:07.456604 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ef1ca-9c26-4a7b-b6e9-5e16e42011c4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:07.456604 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ef1ca-9c26-4a7b-b6e9-5e16e42011c4 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:07.457997 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 157/319] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:07.463751 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286fcae-cbcf-460e-a4ff-c6d43fd62296 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:07.464164 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286fcae-cbcf-460e-a4ff-c6d43fd62296 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:07.464323 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286fcae-cbcf-460e-a4ff-c6d43fd62296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:07.481252 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-7286fcae-cbcf-460e-a4ff-c6d43fd62296 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:07.482460 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7286fcae-cbcf-460e-a4ff-c6d43fd62296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:07.535000 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1d869-f02c-4d4d-ad4c-787012cb272a None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:07.535375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1d869-f02c-4d4d-ad4c-787012cb272a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:07.535598 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1d869-f02c-4d4d-ad4c-787012cb272a None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:07.537124 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 158/320] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:13:07.544539 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e24528-e8e6-406c-876b-0ebcff56ea8f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:07.544823 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e24528-e8e6-406c-876b-0ebcff56ea8f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:07.545103 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e24528-e8e6-406c-876b-0ebcff56ea8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:07.557704 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 163/321] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:13:07.562345 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-f7e24528-e8e6-406c-876b-0ebcff56ea8f None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:07.563517 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f7e24528-e8e6-406c-876b-0ebcff56ea8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:07.580554 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286fcae-cbcf-460e-a4ff-c6d43fd62296 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:07.623388 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:07.639767 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 159/322] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 04:13:07.663100 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e24528-e8e6-406c-876b-0ebcff56ea8f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:07.688531 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286fcae-cbcf-460e-a4ff-c6d43fd62296 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:07.724119 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd69258-57f5-4fea-befe-5fc9af33a2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:07.724818 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd69258-57f5-4fea-befe-5fc9af33a2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:07.725107 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd69258-57f5-4fea-befe-5fc9af33a2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:07.725384 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd69258-57f5-4fea-befe-5fc9af33a2e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:07.726590 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd69258-57f5-4fea-befe-5fc9af33a2e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:07.728060 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd69258-57f5-4fea-befe-5fc9af33a2e9 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:07.729701 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 164/323] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:13:07.730913 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b04d5-51ad-40e6-a8af-d61865e065b2 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:07.731145 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b04d5-51ad-40e6-a8af-d61865e065b2 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:07.731409 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b04d5-51ad-40e6-a8af-d61865e065b2 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:07.732773 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 165/324] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:07.735277 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b04d5-51ad-40e6-a8af-d61865e065b2 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:07.744954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:07.763810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e24528-e8e6-406c-876b-0ebcff56ea8f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:07.797890 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49d32b-a43e-4fa3-a44f-1c00db90da4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:07.798699 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49d32b-a43e-4fa3-a44f-1c00db90da4f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:07.799093 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49d32b-a43e-4fa3-a44f-1c00db90da4f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:07.799463 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49d32b-a43e-4fa3-a44f-1c00db90da4f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:07.810059 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49d32b-a43e-4fa3-a44f-1c00db90da4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:07.818527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-ec49d32b-a43e-4fa3-a44f-1c00db90da4f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 01 04:13:07.818527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:07.818527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:07.818527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:07.818527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:07.818527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:07.818527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:07.818527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:07.818527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:07.818527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:07.818527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:07.818527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:07.818527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:07.818527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:07.818527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:07.818527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:07.820174 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:07.820174 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:07.820174 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:07.820174 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:07.820174 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:07.820174 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:07.820174 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:07.820174 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:07.820174 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:07.820174 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:07.820174 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:07.820174 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:07.820174 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:07.820174 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:07.820174 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:07.820174 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:07.821205 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:07.821205 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:07.821205 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:07.821205 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:07.821205 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:07.821205 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:07.821205 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:07.821205 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:07.821205 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:07.821205 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:07.821205 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 01 04:13:07.821205 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:07.821205 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 160/325] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:13:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:13:07.822077 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db1cc1-a3a9-447c-b01c-ed9f5abab0bf None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:07.822077 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db1cc1-a3a9-447c-b01c-ed9f5abab0bf None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:07.822077 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db1cc1-a3a9-447c-b01c-ed9f5abab0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:07.839559 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a4db1cc1-a3a9-447c-b01c-ed9f5abab0bf None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:07.840957 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a4db1cc1-a3a9-447c-b01c-ed9f5abab0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:07.841645 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b04d5-51ad-40e6-a8af-d61865e065b2 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:07.848832 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:07.875759 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c6001-db70-4575-acba-cdac81e787ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:07.876414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c6001-db70-4575-acba-cdac81e787ff None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:07.876691 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c6001-db70-4575-acba-cdac81e787ff None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:07.876963 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c6001-db70-4575-acba-cdac81e787ff None admin] PATH_INFO: `/v3/groups` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:07.877635 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c6001-db70-4575-acba-cdac81e787ff None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:07.879079 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c6001-db70-4575-acba-cdac81e787ff None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:07.894870 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 166/326] 10.222.0.32 () {60 vars in 1134 bytes} [Wed Jun 1 04:13:07 2022] POST /identity/v3/groups => generated 226 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:13:07.895874 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c6001-db70-4575-acba-cdac81e787ff None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:07.909417 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 161/327] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:13:07.939371 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db1cc1-a3a9-447c-b01c-ed9f5abab0bf None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:08.018584 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:08.028114 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c6001-db70-4575-acba-cdac81e787ff None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:08.053611 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db1cc1-a3a9-447c-b01c-ed9f5abab0bf None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:08.063423 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8438ed-e996-4e99-b362-b340aa1a0bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:08.064105 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8438ed-e996-4e99-b362-b340aa1a0bdf None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:08.064390 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8438ed-e996-4e99-b362-b340aa1a0bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:08.064667 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8438ed-e996-4e99-b362-b340aa1a0bdf None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:08.065434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8438ed-e996-4e99-b362-b340aa1a0bdf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:08.065742 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8438ed-e996-4e99-b362-b340aa1a0bdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:08.067179 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8438ed-e996-4e99-b362-b340aa1a0bdf None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:08.076907 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 167/328] 10.222.0.32 () {56 vars in 1101 bytes} [Wed Jun 1 04:13:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:08.082749 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8438ed-e996-4e99-b362-b340aa1a0bdf None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:08.102568 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e758bf-48ef-46e2-85bc-a43690dd2b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:08.103369 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e758bf-48ef-46e2-85bc-a43690dd2b1b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:08.103646 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e758bf-48ef-46e2-85bc-a43690dd2b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:08.103920 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e758bf-48ef-46e2-85bc-a43690dd2b1b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:08.115134 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:08.120740 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e758bf-48ef-46e2-85bc-a43690dd2b1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:08.128442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-04e758bf-48ef-46e2-85bc-a43690dd2b1b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 01 04:13:08.128442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:08.128442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:08.128442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:08.128442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:08.128442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:08.128442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:08.128442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:08.128442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:08.128442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:08.128442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:08.128442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:08.128442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:08.128442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:08.128442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:08.128442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:08.129366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:08.129366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:08.129366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:08.129366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:08.129366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:08.129366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:08.129366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:08.129366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:08.129366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:08.129366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:08.129366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:08.129366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:08.129366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:08.129366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:08.129366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:08.129366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:08.130327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:08.130327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:08.130327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:08.130327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:08.130327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:08.130327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:08.130327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:08.130327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:08.130327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:08.130327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:08.130327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 01 04:13:08.130327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:08.134532 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 162/329] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:13:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:13:08.136084 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e758bf-48ef-46e2-85bc-a43690dd2b1b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:08.221701 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8438ed-e996-4e99-b362-b340aa1a0bdf None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:08.262447 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e758bf-48ef-46e2-85bc-a43690dd2b1b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:08.273838 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd91c3-976f-4efc-a1e5-02c223f92a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:08.275034 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd91c3-976f-4efc-a1e5-02c223f92a8f None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:08.275314 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd91c3-976f-4efc-a1e5-02c223f92a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:08.275595 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd91c3-976f-4efc-a1e5-02c223f92a8f None admin] PATH_INFO: `/v3/users/32b1d9f529be45ad9935063db45da84e` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:08.276811 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd91c3-976f-4efc-a1e5-02c223f92a8f None admin] RBAC: Authorizing `identity:get_user(user_id=32b1d9f529be45ad9935063db45da84e)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:08.278560 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd91c3-976f-4efc-a1e5-02c223f92a8f None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:08.280398 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 168/330] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:13:08 2022] GET /identity/v3/users/32b1d9f529be45ad9935063db45da84e => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:08.285770 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd91c3-976f-4efc-a1e5-02c223f92a8f None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:08.301015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:08.307794 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b7b56-4956-40dc-8309-dca4dd096645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:08.308548 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b7b56-4956-40dc-8309-dca4dd096645 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:08.308833 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b7b56-4956-40dc-8309-dca4dd096645 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:08.309110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b7b56-4956-40dc-8309-dca4dd096645 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:08.310068 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b7b56-4956-40dc-8309-dca4dd096645 None admin] RBAC: Adding query filter params (name=member) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:08.310500 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b7b56-4956-40dc-8309-dca4dd096645 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:08.311792 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b7b56-4956-40dc-8309-dca4dd096645 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:08.321442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 163/331] 10.222.0.32 () {56 vars in 1101 bytes} [Wed Jun 1 04:13:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:08.326658 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b7b56-4956-40dc-8309-dca4dd096645 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:08.408054 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:08.415692 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd91c3-976f-4efc-a1e5-02c223f92a8f None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:08.460998 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b7b56-4956-40dc-8309-dca4dd096645 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:08.466179 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b41e8f-8e9c-4fde-be22-8a5ec38555a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:08.467056 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b41e8f-8e9c-4fde-be22-8a5ec38555a6 None admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:08.467336 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b41e8f-8e9c-4fde-be22-8a5ec38555a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:08.467609 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b41e8f-8e9c-4fde-be22-8a5ec38555a6 None admin] PATH_INFO: `/v3/system/users/32b1d9f529be45ad9935063db45da84e/roles/7b78e36083484a9a810a37da3f18974b` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:08.469624 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b41e8f-8e9c-4fde-be22-8a5ec38555a6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=32b1d9f529be45ad9935063db45da84e, role_id=7b78e36083484a9a810a37da3f18974b)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:08.471099 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b41e8f-8e9c-4fde-be22-8a5ec38555a6 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:08.483561 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 169/332] 10.222.0.32 () {58 vars in 1334 bytes} [Wed Jun 1 04:13:08 2022] PUT /identity/v3/system/users/32b1d9f529be45ad9935063db45da84e/roles/7b78e36083484a9a810a37da3f18974b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:13:08.510674 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2bd4b8-0d31-4589-8a36-13ca8780f423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:08.511601 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2bd4b8-0d31-4589-8a36-13ca8780f423 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:08.511885 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2bd4b8-0d31-4589-8a36-13ca8780f423 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:08.512160 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2bd4b8-0d31-4589-8a36-13ca8780f423 None admin] PATH_INFO: `/v3/users/7eec6f884f414bcb98e41629c596ef86` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:08.513574 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2bd4b8-0d31-4589-8a36-13ca8780f423 None admin] RBAC: Authorizing `identity:get_user(user_id=7eec6f884f414bcb98e41629c596ef86)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:08.515101 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2bd4b8-0d31-4589-8a36-13ca8780f423 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:08.516828 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 164/333] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:13:08 2022] GET /identity/v3/users/7eec6f884f414bcb98e41629c596ef86 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:13:08.523086 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b41e8f-8e9c-4fde-be22-8a5ec38555a6 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:08.646503 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b41e8f-8e9c-4fde-be22-8a5ec38555a6 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:08.686696 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe96a7-c647-40aa-b80c-59f0ae31ead5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:08.687362 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe96a7-c647-40aa-b80c-59f0ae31ead5 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:08.687648 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe96a7-c647-40aa-b80c-59f0ae31ead5 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:08.687932 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe96a7-c647-40aa-b80c-59f0ae31ead5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:08.688772 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe96a7-c647-40aa-b80c-59f0ae31ead5 None admin] RBAC: Adding query filter params (role.id=3f08ec4046094d04a533ba522f71ba9a, user.id=7eec6f884f414bcb98e41629c596ef86, scope.system=all) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:08.689086 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe96a7-c647-40aa-b80c-59f0ae31ead5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:08.690604 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe96a7-c647-40aa-b80c-59f0ae31ead5 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:08.714198 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 170/334] 10.222.0.32 () {56 vars in 1308 bytes} [Wed Jun 1 04:13:08 2022] GET /identity/v3/role_assignments?user.id=7eec6f884f414bcb98e41629c596ef86&scope.system=all&role.id=3f08ec4046094d04a533ba522f71ba9a => generated 510 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:10.407440 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abedad9-e79c-48f6-868a-526f9d74382d None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:10.407921 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abedad9-e79c-48f6-868a-526f9d74382d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:10.407921 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abedad9-e79c-48f6-868a-526f9d74382d None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:10.409584 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 165/335] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:10.415488 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60018f61-d446-4de6-82eb-20a8f6dc8788 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:10.415940 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60018f61-d446-4de6-82eb-20a8f6dc8788 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:10.416140 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60018f61-d446-4de6-82eb-20a8f6dc8788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:10.434872 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-60018f61-d446-4de6-82eb-20a8f6dc8788 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:10.436301 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-60018f61-d446-4de6-82eb-20a8f6dc8788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:10.452268 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:10.520811 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 171/336] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 04:13:10.545250 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abedad9-e79c-48f6-868a-526f9d74382d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:10.622743 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:10.670645 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abedad9-e79c-48f6-868a-526f9d74382d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:10.715944 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b1882-e48b-4989-a78a-27deb223ad2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:10.716745 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b1882-e48b-4989-a78a-27deb223ad2b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:10.717027 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b1882-e48b-4989-a78a-27deb223ad2b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:10.717297 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b1882-e48b-4989-a78a-27deb223ad2b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:10.734830 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b1882-e48b-4989-a78a-27deb223ad2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:10.742975 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-564b1882-e48b-4989-a78a-27deb223ad2b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 01 04:13:10.742975 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:10.742975 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:10.742975 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:10.742975 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:10.742975 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:10.742975 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:10.742975 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:10.742975 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:10.742975 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:10.742975 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:10.742975 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:10.742975 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:10.742975 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:10.742975 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:10.742975 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:10.745372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:10.745372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:10.745372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:10.745372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:10.745372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:10.745372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:10.745372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:10.745372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:10.745372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:10.745372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:10.745372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:10.745372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:10.745372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:10.745372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:10.745372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:10.745372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:10.747323 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:10.747323 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:10.747323 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:10.747323 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:10.747323 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:10.747323 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:10.747323 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:10.747323 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:10.747323 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:10.747323 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:10.747323 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 01 04:13:10.747323 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:10.747323 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 166/337] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:13:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:10.750209 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60018f61-d446-4de6-82eb-20a8f6dc8788 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:10.914889 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60018f61-d446-4de6-82eb-20a8f6dc8788 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:10.962732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318de9b-048e-49f9-a8be-03184bfb064b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:10.963794 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318de9b-048e-49f9-a8be-03184bfb064b None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:10.964285 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318de9b-048e-49f9-a8be-03184bfb064b None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:10.964753 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318de9b-048e-49f9-a8be-03184bfb064b None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:10.965702 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318de9b-048e-49f9-a8be-03184bfb064b None admin] RBAC: Adding query filter params (name=member) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:10.966242 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318de9b-048e-49f9-a8be-03184bfb064b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:10.967820 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318de9b-048e-49f9-a8be-03184bfb064b None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:10.982659 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 172/338] 10.222.0.32 () {56 vars in 1101 bytes} [Wed Jun 1 04:13:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:10.987815 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b1882-e48b-4989-a78a-27deb223ad2b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:11.134308 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b1882-e48b-4989-a78a-27deb223ad2b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:11.169200 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:11.182810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e9214-cf08-4a35-bc87-9d3854ea09be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:11.183493 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e9214-cf08-4a35-bc87-9d3854ea09be None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:11.183775 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e9214-cf08-4a35-bc87-9d3854ea09be None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:11.184052 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e9214-cf08-4a35-bc87-9d3854ea09be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:11.269455 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e9214-cf08-4a35-bc87-9d3854ea09be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:11.270963 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e9214-cf08-4a35-bc87-9d3854ea09be None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:11.340165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6586f09-543a-4acc-88f0-1fd0e5722bd2 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:11.340794 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6586f09-543a-4acc-88f0-1fd0e5722bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:11.341275 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6586f09-543a-4acc-88f0-1fd0e5722bd2 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:11.343154 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 173/339] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:11.349763 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00689175-e943-4de6-a3b9-1974bec7054b None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:11.350335 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00689175-e943-4de6-a3b9-1974bec7054b None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:11.350862 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00689175-e943-4de6-a3b9-1974bec7054b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:11.387036 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-00689175-e943-4de6-a3b9-1974bec7054b None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:11.388249 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-00689175-e943-4de6-a3b9-1974bec7054b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:11.395022 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:11.403070 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 167/340] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:13:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 04:13:11.404805 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a4810-9e57-44de-85d1-735ba1ecbbbf None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:11.405096 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a4810-9e57-44de-85d1-735ba1ecbbbf None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:11.405584 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a4810-9e57-44de-85d1-735ba1ecbbbf None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:11.407339 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 168/341] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:11.412716 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1d5db-05ba-4f0a-8d16-eb67be21f70a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:11.413295 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1d5db-05ba-4f0a-8d16-eb67be21f70a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:11.413295 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1d5db-05ba-4f0a-8d16-eb67be21f70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:11.433714 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e5d1d5db-05ba-4f0a-8d16-eb67be21f70a None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:11.434932 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e5d1d5db-05ba-4f0a-8d16-eb67be21f70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:11.458350 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:11.522202 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 169/342] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 01 04:13:11.523953 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d1d5db-05ba-4f0a-8d16-eb67be21f70a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:11.656992 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d1d5db-05ba-4f0a-8d16-eb67be21f70a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:11.664146 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 174/343] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 04:13:11.665051 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00689175-e943-4de6-a3b9-1974bec7054b None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:11.701899 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f9480-01ee-4347-924b-5c34d0c3bcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:11.703217 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f9480-01ee-4347-924b-5c34d0c3bcb6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:11.703808 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f9480-01ee-4347-924b-5c34d0c3bcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:11.704246 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f9480-01ee-4347-924b-5c34d0c3bcb6 None admin] PATH_INFO: `/v3/projects/51115e4840444ed8aa7f060448c5cc92` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:11.706173 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f9480-01ee-4347-924b-5c34d0c3bcb6 None admin] RBAC: Authorizing `identity:get_project(project_id=51115e4840444ed8aa7f060448c5cc92)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:11.708067 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f9480-01ee-4347-924b-5c34d0c3bcb6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:11.710600 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 170/344] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:13:11 2022] GET /identity/v3/projects/51115e4840444ed8aa7f060448c5cc92 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:11.716380 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f9480-01ee-4347-924b-5c34d0c3bcb6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:11.750394 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:11.852613 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f9480-01ee-4347-924b-5c34d0c3bcb6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:11.873727 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00689175-e943-4de6-a3b9-1974bec7054b None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:11.901672 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ae8bd-7404-42ff-8c6f-99e105146910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:11.903423 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ae8bd-7404-42ff-8c6f-99e105146910 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:11.904074 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ae8bd-7404-42ff-8c6f-99e105146910 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:11.904653 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ae8bd-7404-42ff-8c6f-99e105146910 None admin] PATH_INFO: `/v3/groups/b8c50852cd364f6d8b2cc2f364abef8a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:11.914970 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ae8bd-7404-42ff-8c6f-99e105146910 None admin] RBAC: Authorizing `identity:get_group(group_id=b8c50852cd364f6d8b2cc2f364abef8a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:11.916744 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ae8bd-7404-42ff-8c6f-99e105146910 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:11.919083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 171/345] 10.222.0.32 () {56 vars in 1180 bytes} [Wed Jun 1 04:13:11 2022] GET /identity/v3/groups/b8c50852cd364f6d8b2cc2f364abef8a => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:11.919640 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32591946-9a73-400c-a2c7-dfc8bc925526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:11.920182 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ae8bd-7404-42ff-8c6f-99e105146910 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:11.920932 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32591946-9a73-400c-a2c7-dfc8bc925526 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:11.921408 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32591946-9a73-400c-a2c7-dfc8bc925526 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:11.921883 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32591946-9a73-400c-a2c7-dfc8bc925526 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:11.931831 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:11.935544 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32591946-9a73-400c-a2c7-dfc8bc925526 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:11.944807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-32591946-9a73-400c-a2c7-dfc8bc925526 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 04:13:11.944807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:11.944807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:11.944807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:11.944807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:11.944807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:11.944807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:11.944807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:11.944807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:11.944807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:11.944807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:11.944807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:11.944807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:11.944807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:11.944807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:11.944807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:11.945729 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:11.945729 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:11.945729 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:11.945729 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:11.945729 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:11.945729 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:11.945729 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:11.945729 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:11.945729 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:11.945729 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:11.945729 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:11.945729 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:11.945729 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:11.945729 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:11.945729 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:11.945729 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:11.946544 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:11.946544 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:11.946544 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:11.946544 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:11.946544 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:11.946544 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:11.946544 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:11.946544 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:11.946544 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:11.946544 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:11.946544 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 04:13:11.946544 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:11.949146 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 175/346] 10.222.0.32 () {56 vars in 1114 bytes} [Wed Jun 1 04:13:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:11.950777 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73c549-ea81-47c2-b579-c8e2d7e3b1d2 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:11.951285 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73c549-ea81-47c2-b579-c8e2d7e3b1d2 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:11.951780 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73c549-ea81-47c2-b579-c8e2d7e3b1d2 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:11.953374 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 176/347] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:11.954386 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73c549-ea81-47c2-b579-c8e2d7e3b1d2 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:12.031050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:12.054720 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ae8bd-7404-42ff-8c6f-99e105146910 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:12.103857 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18668c9a-cbdf-42ba-9713-ce6d556e7e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:12.104600 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18668c9a-cbdf-42ba-9713-ce6d556e7e8a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:12.104881 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18668c9a-cbdf-42ba-9713-ce6d556e7e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:12.105156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18668c9a-cbdf-42ba-9713-ce6d556e7e8a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:12.106193 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73c549-ea81-47c2-b579-c8e2d7e3b1d2 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:12.123023 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18668c9a-cbdf-42ba-9713-ce6d556e7e8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:12.132436 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-18668c9a-cbdf-42ba-9713-ce6d556e7e8a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 01 04:13:12.132436 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:12.132436 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:12.132436 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:12.132436 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:12.132436 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:12.132436 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:12.132436 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:12.132436 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:12.132436 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:12.132436 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:12.132436 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:12.132436 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:12.132436 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:12.132436 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:12.132436 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:12.133599 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:12.133599 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:12.133599 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:12.133599 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:12.133599 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:12.133599 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:12.133599 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:12.133599 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:12.133599 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:12.133599 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:12.133599 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:12.133599 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:12.133599 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:12.133599 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:12.133599 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:12.133599 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:12.134514 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:12.134514 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:12.134514 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:12.134514 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:12.134514 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:12.134514 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:12.134514 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:12.134514 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:12.134514 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:12.134514 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:12.134514 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 01 04:13:12.134514 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:12.137089 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 172/348] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:13:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:12.137089 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b08ae-0f75-449c-a3d4-6f66e4bbda18 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:12.137089 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b08ae-0f75-449c-a3d4-6f66e4bbda18 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:12.137089 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b08ae-0f75-449c-a3d4-6f66e4bbda18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:12.163323 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-400b08ae-0f75-449c-a3d4-6f66e4bbda18 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:12.164811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-400b08ae-0f75-449c-a3d4-6f66e4bbda18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:12.179329 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af686bf0-d1a5-4e26-8611-9c963a032ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:12.179998 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af686bf0-d1a5-4e26-8611-9c963a032ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:12.180281 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af686bf0-d1a5-4e26-8611-9c963a032ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:12.180558 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af686bf0-d1a5-4e26-8611-9c963a032ab7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:12.181385 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af686bf0-d1a5-4e26-8611-9c963a032ab7 None admin] RBAC: Adding query filter params (group.id=b8c50852cd364f6d8b2cc2f364abef8a, role.id=3f08ec4046094d04a533ba522f71ba9a, scope.project.id=51115e4840444ed8aa7f060448c5cc92) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:12.181701 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af686bf0-d1a5-4e26-8611-9c963a032ab7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:12.183161 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af686bf0-d1a5-4e26-8611-9c963a032ab7 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:12.207852 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 177/349] 10.222.0.32 () {56 vars in 1376 bytes} [Wed Jun 1 04:13:11 2022] GET /identity/v3/role_assignments?group.id=b8c50852cd364f6d8b2cc2f364abef8a&scope.project.id=51115e4840444ed8aa7f060448c5cc92&role.id=3f08ec4046094d04a533ba522f71ba9a => generated 260 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:12.208950 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af686bf0-d1a5-4e26-8611-9c963a032ab7 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:12.246481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 173/350] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:13:12.247586 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b08ae-0f75-449c-a3d4-6f66e4bbda18 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:12.327336 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:12.354206 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:12.380948 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b08ae-0f75-449c-a3d4-6f66e4bbda18 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:12.401065 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af686bf0-d1a5-4e26-8611-9c963a032ab7 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:12.420062 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f9c95-ab58-44e8-8a94-ff70fbf7f04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:12.421375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f9c95-ab58-44e8-8a94-ff70fbf7f04c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:12.421796 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f9c95-ab58-44e8-8a94-ff70fbf7f04c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:12.422239 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f9c95-ab58-44e8-8a94-ff70fbf7f04c None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:12.424224 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f9c95-ab58-44e8-8a94-ff70fbf7f04c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:12.424686 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f9c95-ab58-44e8-8a94-ff70fbf7f04c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:12.426219 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f9c95-ab58-44e8-8a94-ff70fbf7f04c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:12.436288 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 174/351] 10.222.0.32 () {56 vars in 1101 bytes} [Wed Jun 1 04:13:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:12.437348 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f9c95-ab58-44e8-8a94-ff70fbf7f04c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:12.467799 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115dbd39-42c5-43d6-8797-462b6d41e78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:12.468804 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115dbd39-42c5-43d6-8797-462b6d41e78e None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:12.469088 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115dbd39-42c5-43d6-8797-462b6d41e78e None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:12.469368 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115dbd39-42c5-43d6-8797-462b6d41e78e None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:12.470193 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115dbd39-42c5-43d6-8797-462b6d41e78e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:12.470681 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115dbd39-42c5-43d6-8797-462b6d41e78e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:12.472189 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115dbd39-42c5-43d6-8797-462b6d41e78e None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:12.490277 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 178/352] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:13:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:12.491963 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115dbd39-42c5-43d6-8797-462b6d41e78e None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:12.547111 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f9c95-ab58-44e8-8a94-ff70fbf7f04c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:12.586367 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ec70b-265a-47aa-be5d-5ea9b3001c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:12.587518 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ec70b-265a-47aa-be5d-5ea9b3001c24 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:12.588029 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ec70b-265a-47aa-be5d-5ea9b3001c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:12.588442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ec70b-265a-47aa-be5d-5ea9b3001c24 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:12.595326 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:12.601002 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ec70b-265a-47aa-be5d-5ea9b3001c24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:12.609120 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-845ec70b-265a-47aa-be5d-5ea9b3001c24 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 01 04:13:12.609120 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:12.609120 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:12.609120 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:12.609120 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:12.609120 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:12.609120 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:12.609120 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:12.609120 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:12.609120 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:12.609120 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:12.609120 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:12.609120 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:12.609120 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:12.609120 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:12.609120 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:12.610385 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:12.610385 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:12.610385 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:12.610385 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:12.610385 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:12.610385 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:12.610385 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:12.610385 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:12.610385 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:12.610385 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:12.610385 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:12.610385 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:12.610385 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:12.610385 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:12.610385 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:12.610385 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:12.611169 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:12.611169 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:12.611169 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:12.611169 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:12.611169 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:12.611169 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:12.611169 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:12.611169 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:12.611169 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:12.611169 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:12.611169 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 01 04:13:12.611169 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:12.613395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 175/353] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:13:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:12.614455 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ec70b-265a-47aa-be5d-5ea9b3001c24 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:12.680468 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115dbd39-42c5-43d6-8797-462b6d41e78e None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:12.715215 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:12.725818 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceba037-b656-4c78-93f7-8048efd728f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:12.727259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceba037-b656-4c78-93f7-8048efd728f4 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:12.727615 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceba037-b656-4c78-93f7-8048efd728f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:12.727974 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceba037-b656-4c78-93f7-8048efd728f4 None admin] PATH_INFO: `/v3/users/32b1d9f529be45ad9935063db45da84e` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:12.729538 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceba037-b656-4c78-93f7-8048efd728f4 None admin] RBAC: Authorizing `identity:get_user(user_id=32b1d9f529be45ad9935063db45da84e)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:12.731777 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceba037-b656-4c78-93f7-8048efd728f4 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:12.734908 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 179/354] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:13:12 2022] GET /identity/v3/users/32b1d9f529be45ad9935063db45da84e => generated 293 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:12.736042 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceba037-b656-4c78-93f7-8048efd728f4 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:12.737681 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ec70b-265a-47aa-be5d-5ea9b3001c24 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:12.777538 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a15c49-3e6b-4190-ac23-0b6522fc53fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:12.778399 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a15c49-3e6b-4190-ac23-0b6522fc53fd None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:12.778684 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a15c49-3e6b-4190-ac23-0b6522fc53fd None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:12.778960 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a15c49-3e6b-4190-ac23-0b6522fc53fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:12.858967 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:12.870847 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a15c49-3e6b-4190-ac23-0b6522fc53fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:12.872913 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a15c49-3e6b-4190-ac23-0b6522fc53fd None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:12.881074 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceba037-b656-4c78-93f7-8048efd728f4 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:12.926478 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66430667-6c04-4b5d-8ccb-9976473c2c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:12.927147 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66430667-6c04-4b5d-8ccb-9976473c2c08 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:12.927433 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66430667-6c04-4b5d-8ccb-9976473c2c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:12.927712 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66430667-6c04-4b5d-8ccb-9976473c2c08 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:12.928461 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66430667-6c04-4b5d-8ccb-9976473c2c08 None admin] RBAC: Adding query filter params (name=member) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:12.929352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66430667-6c04-4b5d-8ccb-9976473c2c08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:12.930763 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66430667-6c04-4b5d-8ccb-9976473c2c08 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:12.940745 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 180/355] 10.222.0.32 () {56 vars in 1101 bytes} [Wed Jun 1 04:13:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:12.942183 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0518b1-13a0-4470-b12c-1cbbbfa5045f None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:12.942364 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0518b1-13a0-4470-b12c-1cbbbfa5045f None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:12.942644 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0518b1-13a0-4470-b12c-1cbbbfa5045f None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:12.944340 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 181/356] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:12.945150 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0518b1-13a0-4470-b12c-1cbbbfa5045f None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:13.001796 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 176/357] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:13:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 04:13:13.002916 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a15c49-3e6b-4190-ac23-0b6522fc53fd None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:13.029871 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:13.086667 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0518b1-13a0-4470-b12c-1cbbbfa5045f None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:13.128651 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df9664-be02-4844-a1d5-1e0c2a6057ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:13.129219 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df9664-be02-4844-a1d5-1e0c2a6057ad None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:13.129550 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df9664-be02-4844-a1d5-1e0c2a6057ad None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:13.129832 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df9664-be02-4844-a1d5-1e0c2a6057ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:13.130693 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df9664-be02-4844-a1d5-1e0c2a6057ad None admin] RBAC: Adding query filter params (role.id=7b78e36083484a9a810a37da3f18974b, user.id=32b1d9f529be45ad9935063db45da84e, scope.system=all) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:13.131003 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df9664-be02-4844-a1d5-1e0c2a6057ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:13.133458 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df9664-be02-4844-a1d5-1e0c2a6057ad None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:13.134547 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a15c49-3e6b-4190-ac23-0b6522fc53fd None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:13.147304 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 182/358] 10.222.0.32 () {56 vars in 1308 bytes} [Wed Jun 1 04:13:12 2022] GET /identity/v3/role_assignments?user.id=32b1d9f529be45ad9935063db45da84e&scope.system=all&role.id=7b78e36083484a9a810a37da3f18974b => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:13.148793 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425ce1d-8079-41c3-b27f-900570a639af None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:13.149074 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425ce1d-8079-41c3-b27f-900570a639af None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:13.149369 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425ce1d-8079-41c3-b27f-900570a639af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:13.158390 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:13.172637 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-7425ce1d-8079-41c3-b27f-900570a639af None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:13.173823 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7425ce1d-8079-41c3-b27f-900570a639af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:13.192881 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9c07f-dfb0-4181-998a-457bcdb390ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:13.193820 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9c07f-dfb0-4181-998a-457bcdb390ae None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:13.194429 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9c07f-dfb0-4181-998a-457bcdb390ae None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:13.194718 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9c07f-dfb0-4181-998a-457bcdb390ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:13.293677 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9c07f-dfb0-4181-998a-457bcdb390ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:13.295539 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9c07f-dfb0-4181-998a-457bcdb390ae None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:13.327030 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 183/359] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:13:13.327907 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425ce1d-8079-41c3-b27f-900570a639af None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:13.404914 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:13.436979 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:13.445638 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 177/360] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:13:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 04:13:13.447194 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d3dca-f2ea-4d56-bec8-fabfc06f0b8d None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:13.447650 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d3dca-f2ea-4d56-bec8-fabfc06f0b8d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:13.448078 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d3dca-f2ea-4d56-bec8-fabfc06f0b8d None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:13.449563 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 178/361] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:13.450418 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d3dca-f2ea-4d56-bec8-fabfc06f0b8d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:13.470326 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425ce1d-8079-41c3-b27f-900570a639af None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:13.512158 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632cb95-0414-402f-bafa-d9366d870781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:13.513034 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632cb95-0414-402f-bafa-d9366d870781 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:13.513716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632cb95-0414-402f-bafa-d9366d870781 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:13.513956 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632cb95-0414-402f-bafa-d9366d870781 None admin] PATH_INFO: `/v3/projects/51115e4840444ed8aa7f060448c5cc92` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:13.515776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632cb95-0414-402f-bafa-d9366d870781 None admin] RBAC: Authorizing `identity:get_project(project_id=51115e4840444ed8aa7f060448c5cc92)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:13.517410 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632cb95-0414-402f-bafa-d9366d870781 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:13.520022 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 184/362] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:13:13 2022] GET /identity/v3/projects/51115e4840444ed8aa7f060448c5cc92 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:13.520741 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632cb95-0414-402f-bafa-d9366d870781 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:13.593629 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d3dca-f2ea-4d56-bec8-fabfc06f0b8d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:13.656809 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecc413-021e-4013-9211-2e7e7bde3f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:13.658520 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecc413-021e-4013-9211-2e7e7bde3f3b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:13.660651 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecc413-021e-4013-9211-2e7e7bde3f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:13.661235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecc413-021e-4013-9211-2e7e7bde3f3b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:13.672702 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632cb95-0414-402f-bafa-d9366d870781 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:13.684910 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ecc413-021e-4013-9211-2e7e7bde3f3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:13.692767 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:13.697157 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-66ecc413-021e-4013-9211-2e7e7bde3f3b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 04:13:13.697157 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:13.697157 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:13.697157 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:13.697157 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:13.697157 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:13.697157 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:13.697157 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:13.697157 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:13.697157 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:13.697157 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:13.697157 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:13.697157 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:13.697157 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:13.697157 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:13.697157 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:13.698149 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:13.698149 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:13.698149 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:13.698149 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:13.698149 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:13.698149 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:13.698149 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:13.698149 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:13.698149 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:13.698149 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:13.698149 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:13.698149 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:13.698149 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:13.698149 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:13.698149 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:13.698149 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:13.699045 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:13.699045 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:13.699045 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:13.699045 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:13.699045 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:13.699045 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:13.699045 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:13.699045 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:13.699045 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:13.699045 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:13.699045 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 04:13:13.699045 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:13.699659 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 179/363] 10.222.0.32 () {56 vars in 1114 bytes} [Wed Jun 1 04:13:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:13.706320 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b34a4-3778-4083-adce-a8404747b656 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:13.706320 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b34a4-3778-4083-adce-a8404747b656 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:13.706320 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b34a4-3778-4083-adce-a8404747b656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:13.727990 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-ff1b34a4-3778-4083-adce-a8404747b656 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:13.729170 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ff1b34a4-3778-4083-adce-a8404747b656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:13.731865 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac8e92-4fc4-402b-bdb3-d1747370d2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:13.732729 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac8e92-4fc4-402b-bdb3-d1747370d2fa None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:13.733005 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac8e92-4fc4-402b-bdb3-d1747370d2fa None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:13.733274 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac8e92-4fc4-402b-bdb3-d1747370d2fa None admin] PATH_INFO: `/v3/projects/047a5e1b44994e5690d32519e9f95eff` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:13.734525 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac8e92-4fc4-402b-bdb3-d1747370d2fa None admin] RBAC: Authorizing `identity:get_project(project_id=047a5e1b44994e5690d32519e9f95eff)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:13.735952 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac8e92-4fc4-402b-bdb3-d1747370d2fa None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:13.737630 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 185/364] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:13:13 2022] GET /identity/v3/projects/047a5e1b44994e5690d32519e9f95eff => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:13.742160 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac8e92-4fc4-402b-bdb3-d1747370d2fa None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:13.817673 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:13.840463 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 180/365] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:13:13.841656 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b34a4-3778-4083-adce-a8404747b656 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:13.911413 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac8e92-4fc4-402b-bdb3-d1747370d2fa None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:13.972371 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36384a-7c52-4b6a-b67e-931d520ecbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:13.973248 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36384a-7c52-4b6a-b67e-931d520ecbb4 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:13.973534 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36384a-7c52-4b6a-b67e-931d520ecbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:13.973816 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36384a-7c52-4b6a-b67e-931d520ecbb4 None admin] PATH_INFO: `/v3/groups/b8c50852cd364f6d8b2cc2f364abef8a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:13.975791 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36384a-7c52-4b6a-b67e-931d520ecbb4 None admin] RBAC: Authorizing `identity:get_group(group_id=b8c50852cd364f6d8b2cc2f364abef8a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:13.977779 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36384a-7c52-4b6a-b67e-931d520ecbb4 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:13.979490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 186/366] 10.222.0.32 () {56 vars in 1180 bytes} [Wed Jun 1 04:13:13 2022] GET /identity/v3/groups/b8c50852cd364f6d8b2cc2f364abef8a => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:13.980256 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36384a-7c52-4b6a-b67e-931d520ecbb4 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:13.994599 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b34a4-3778-4083-adce-a8404747b656 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:14.044884 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53e26a-b0cb-4679-82fc-a3054c43cbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:14.045867 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53e26a-b0cb-4679-82fc-a3054c43cbcd None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:14.046324 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53e26a-b0cb-4679-82fc-a3054c43cbcd None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:14.046750 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53e26a-b0cb-4679-82fc-a3054c43cbcd None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:14.047675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53e26a-b0cb-4679-82fc-a3054c43cbcd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:14.048183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53e26a-b0cb-4679-82fc-a3054c43cbcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:14.049800 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53e26a-b0cb-4679-82fc-a3054c43cbcd None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:14.066244 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 181/367] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:13:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:14.067624 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53e26a-b0cb-4679-82fc-a3054c43cbcd None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:14.076902 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:14.143992 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:14.172773 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36384a-7c52-4b6a-b67e-931d520ecbb4 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:14.212549 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53e26a-b0cb-4679-82fc-a3054c43cbcd None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:14.219239 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475299a-639b-4100-a907-48a0042929ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:14.220551 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475299a-639b-4100-a907-48a0042929ab None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:14.220847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475299a-639b-4100-a907-48a0042929ab None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:14.221130 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475299a-639b-4100-a907-48a0042929ab None admin] PATH_INFO: `/v3/groups/b8c50852cd364f6d8b2cc2f364abef8a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:14.222773 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0475299a-639b-4100-a907-48a0042929ab None admin] RBAC: Authorizing `identity:get_group(group_id=b8c50852cd364f6d8b2cc2f364abef8a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:14.224380 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0475299a-639b-4100-a907-48a0042929ab None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:14.226872 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 187/368] 10.222.0.32 () {56 vars in 1180 bytes} [Wed Jun 1 04:13:13 2022] GET /identity/v3/groups/b8c50852cd364f6d8b2cc2f364abef8a => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:14.227536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475299a-639b-4100-a907-48a0042929ab None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:14.266184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf6b91-11fa-4880-8d3e-73519d5d9939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:14.267392 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf6b91-11fa-4880-8d3e-73519d5d9939 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:14.267680 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf6b91-11fa-4880-8d3e-73519d5d9939 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:14.267958 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf6b91-11fa-4880-8d3e-73519d5d9939 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:14.281680 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf6b91-11fa-4880-8d3e-73519d5d9939 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:14.289920 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-2eaf6b91-11fa-4880-8d3e-73519d5d9939 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:13:14.289920 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:14.289920 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:14.289920 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:14.289920 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:14.289920 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:14.289920 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:14.289920 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:14.289920 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:14.289920 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:14.289920 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:14.289920 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:14.289920 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:14.289920 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:14.289920 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:14.289920 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:14.290824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:14.290824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:14.290824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:14.290824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:14.290824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:14.290824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:14.290824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:14.290824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:14.290824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:14.290824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:14.290824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:14.290824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:14.290824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:14.290824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:14.290824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:14.290824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:14.291628 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:14.291628 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:14.291628 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:14.291628 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:14.291628 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:14.291628 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:14.291628 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:14.291628 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:14.291628 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:14.291628 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:14.291628 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:13:14.291628 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:14.292722 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 182/369] 10.222.0.32 () {56 vars in 1096 bytes} [Wed Jun 1 04:13:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:14.293339 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf6b91-11fa-4880-8d3e-73519d5d9939 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:14.347334 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475299a-639b-4100-a907-48a0042929ab None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:14.366813 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:14.395480 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235dd754-7c68-4cfc-bb46-d40251cdbf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:14.396150 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235dd754-7c68-4cfc-bb46-d40251cdbf5a None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:14.396434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235dd754-7c68-4cfc-bb46-d40251cdbf5a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:14.396711 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235dd754-7c68-4cfc-bb46-d40251cdbf5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:14.398136 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235dd754-7c68-4cfc-bb46-d40251cdbf5a None admin] RBAC: Adding query filter params (group.id=b8c50852cd364f6d8b2cc2f364abef8a, role.id=71e70e8fe1344699a131764a348d51d6, scope.project.id=51115e4840444ed8aa7f060448c5cc92) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:14.398452 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235dd754-7c68-4cfc-bb46-d40251cdbf5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:14.400014 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235dd754-7c68-4cfc-bb46-d40251cdbf5a None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:14.407582 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 188/370] 10.222.0.32 () {56 vars in 1376 bytes} [Wed Jun 1 04:13:14 2022] GET /identity/v3/role_assignments?group.id=b8c50852cd364f6d8b2cc2f364abef8a&scope.project.id=51115e4840444ed8aa7f060448c5cc92&role.id=71e70e8fe1344699a131764a348d51d6 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:14.408361 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235dd754-7c68-4cfc-bb46-d40251cdbf5a None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:14.426622 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf6b91-11fa-4880-8d3e-73519d5d9939 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:14.437575 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:14.474210 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35259bf-cce6-4fe5-9e30-742c2b797c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:14.474928 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35259bf-cce6-4fe5-9e30-742c2b797c5a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:14.475222 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35259bf-cce6-4fe5-9e30-742c2b797c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:14.475535 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35259bf-cce6-4fe5-9e30-742c2b797c5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:14.554656 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235dd754-7c68-4cfc-bb46-d40251cdbf5a None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:14.561049 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35259bf-cce6-4fe5-9e30-742c2b797c5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:14.562632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35259bf-cce6-4fe5-9e30-742c2b797c5a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:14.595265 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9266a1-511f-4ef2-8d1d-5b5da4b07066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:14.595930 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9266a1-511f-4ef2-8d1d-5b5da4b07066 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:14.596210 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9266a1-511f-4ef2-8d1d-5b5da4b07066 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:14.596487 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9266a1-511f-4ef2-8d1d-5b5da4b07066 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:14.597327 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9266a1-511f-4ef2-8d1d-5b5da4b07066 None admin] RBAC: Adding query filter params (group.id=b8c50852cd364f6d8b2cc2f364abef8a, role.id=3f08ec4046094d04a533ba522f71ba9a, scope.project.id=047a5e1b44994e5690d32519e9f95eff) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:14.597637 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9266a1-511f-4ef2-8d1d-5b5da4b07066 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:14.599123 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9266a1-511f-4ef2-8d1d-5b5da4b07066 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:14.606483 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 189/371] 10.222.0.32 () {56 vars in 1376 bytes} [Wed Jun 1 04:13:14 2022] GET /identity/v3/role_assignments?group.id=b8c50852cd364f6d8b2cc2f364abef8a&scope.project.id=047a5e1b44994e5690d32519e9f95eff&role.id=3f08ec4046094d04a533ba522f71ba9a => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:14.607349 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9266a1-511f-4ef2-8d1d-5b5da4b07066 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:14.679931 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:14.689931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 183/372] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:13:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 04:13:14.696181 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35259bf-cce6-4fe5-9e30-742c2b797c5a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:14.715115 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:14.774222 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9266a1-511f-4ef2-8d1d-5b5da4b07066 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:14.853882 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125d5fc-6a8c-4e68-adfe-fc1040089fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:14.854605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125d5fc-6a8c-4e68-adfe-fc1040089fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:14.854889 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125d5fc-6a8c-4e68-adfe-fc1040089fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:14.855166 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125d5fc-6a8c-4e68-adfe-fc1040089fc3 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:14.855934 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a125d5fc-6a8c-4e68-adfe-fc1040089fc3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:14.856242 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a125d5fc-6a8c-4e68-adfe-fc1040089fc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:14.857650 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a125d5fc-6a8c-4e68-adfe-fc1040089fc3 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:14.871120 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 190/373] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:13:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:14.880825 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125d5fc-6a8c-4e68-adfe-fc1040089fc3 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:14.916518 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35259bf-cce6-4fe5-9e30-742c2b797c5a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:14.964665 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2148dd4-ff60-495f-bf3e-b58e34c73986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:14.965920 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2148dd4-ff60-495f-bf3e-b58e34c73986 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:14.966243 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2148dd4-ff60-495f-bf3e-b58e34c73986 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:14.966521 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2148dd4-ff60-495f-bf3e-b58e34c73986 None admin] PATH_INFO: `/v3/projects/047a5e1b44994e5690d32519e9f95eff` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:14.968028 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2148dd4-ff60-495f-bf3e-b58e34c73986 None admin] RBAC: Authorizing `identity:get_project(project_id=047a5e1b44994e5690d32519e9f95eff)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:14.969750 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2148dd4-ff60-495f-bf3e-b58e34c73986 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:14.972456 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 184/374] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:13:14 2022] GET /identity/v3/projects/047a5e1b44994e5690d32519e9f95eff => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:13:14.980030 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2148dd4-ff60-495f-bf3e-b58e34c73986 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:15.051679 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125d5fc-6a8c-4e68-adfe-fc1040089fc3 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:15.063440 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:15.078322 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:15.105891 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e007c1-3324-41aa-8d6f-24455f4c48d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:15.107062 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e007c1-3324-41aa-8d6f-24455f4c48d3 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:15.107573 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e007c1-3324-41aa-8d6f-24455f4c48d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:15.108050 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e007c1-3324-41aa-8d6f-24455f4c48d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:15.127251 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2148dd4-ff60-495f-bf3e-b58e34c73986 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:15.177519 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0bde5-5614-4af3-b34a-3edf3d805350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:15.178431 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0bde5-5614-4af3-b34a-3edf3d805350 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:15.178754 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0bde5-5614-4af3-b34a-3edf3d805350 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:15.179040 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0bde5-5614-4af3-b34a-3edf3d805350 None admin] PATH_INFO: `/v3/groups/b8c50852cd364f6d8b2cc2f364abef8a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:15.180372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0bde5-5614-4af3-b34a-3edf3d805350 None admin] RBAC: Authorizing `identity:get_group(group_id=b8c50852cd364f6d8b2cc2f364abef8a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:15.181813 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0bde5-5614-4af3-b34a-3edf3d805350 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:15.183806 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 185/375] 10.222.0.32 () {56 vars in 1180 bytes} [Wed Jun 1 04:13:14 2022] GET /identity/v3/groups/b8c50852cd364f6d8b2cc2f364abef8a => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:13:15.185006 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5eed4d-1750-4dcf-b291-34e814147529 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:15.185616 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5eed4d-1750-4dcf-b291-34e814147529 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:15.185616 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5eed4d-1750-4dcf-b291-34e814147529 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:15.190019 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 186/376] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:15.197638 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25910bd9-4e13-4e25-b6aa-a29146c6d9d4 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:15.197924 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25910bd9-4e13-4e25-b6aa-a29146c6d9d4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:15.198232 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25910bd9-4e13-4e25-b6aa-a29146c6d9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:15.218678 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e007c1-3324-41aa-8d6f-24455f4c48d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:15.218852 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-25910bd9-4e13-4e25-b6aa-a29146c6d9d4 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:15.220035 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-25910bd9-4e13-4e25-b6aa-a29146c6d9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:15.220791 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e007c1-3324-41aa-8d6f-24455f4c48d3 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:15.296549 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 187/377] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 04:13:15.297415 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25910bd9-4e13-4e25-b6aa-a29146c6d9d4 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:15.362757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 191/378] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:13:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 04:13:15.363935 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e007c1-3324-41aa-8d6f-24455f4c48d3 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:15.379684 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:15.389838 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:15.419732 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25910bd9-4e13-4e25-b6aa-a29146c6d9d4 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:15.460758 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed655ea5-1e8f-4b58-b178-8751b996f6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:15.461443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed655ea5-1e8f-4b58-b178-8751b996f6af None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:15.461730 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed655ea5-1e8f-4b58-b178-8751b996f6af None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:15.462042 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed655ea5-1e8f-4b58-b178-8751b996f6af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:15.462883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed655ea5-1e8f-4b58-b178-8751b996f6af None admin] RBAC: Adding query filter params (group.id=b8c50852cd364f6d8b2cc2f364abef8a, role.id=71e70e8fe1344699a131764a348d51d6, scope.project.id=047a5e1b44994e5690d32519e9f95eff) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:15.463195 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed655ea5-1e8f-4b58-b178-8751b996f6af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:15.464651 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed655ea5-1e8f-4b58-b178-8751b996f6af None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:15.477093 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 188/379] 10.222.0.32 () {56 vars in 1376 bytes} [Wed Jun 1 04:13:15 2022] GET /identity/v3/role_assignments?group.id=b8c50852cd364f6d8b2cc2f364abef8a&scope.project.id=047a5e1b44994e5690d32519e9f95eff&role.id=71e70e8fe1344699a131764a348d51d6 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:15.478014 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed655ea5-1e8f-4b58-b178-8751b996f6af None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:15.536985 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e007c1-3324-41aa-8d6f-24455f4c48d3 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:15.618841 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59353cbe-df2b-47cb-b9f7-474d0112ae87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:15.620193 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59353cbe-df2b-47cb-b9f7-474d0112ae87 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:15.620193 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59353cbe-df2b-47cb-b9f7-474d0112ae87 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:15.620193 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59353cbe-df2b-47cb-b9f7-474d0112ae87 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:15.646994 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59353cbe-df2b-47cb-b9f7-474d0112ae87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:15.654933 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-59353cbe-df2b-47cb-b9f7-474d0112ae87 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 01 04:13:15.654933 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:15.654933 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:15.654933 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:15.654933 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:15.654933 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:15.654933 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:15.654933 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:15.654933 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:15.654933 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:15.654933 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:15.654933 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:15.654933 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:15.654933 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:15.654933 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:15.654933 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:15.656319 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:15.656319 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:15.656319 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:15.656319 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:15.656319 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:15.656319 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:15.656319 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:15.656319 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:15.656319 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:15.656319 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:15.656319 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:15.656319 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:15.656319 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:15.656319 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:15.656319 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:15.656319 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:15.657582 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:15.657582 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:15.657582 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:15.657582 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:15.657582 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:15.657582 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:15.657582 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:15.657582 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:15.657582 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:15.657582 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:15.657582 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 01 04:13:15.657582 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:15.657582 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 192/380] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:13:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:15.662753 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59353cbe-df2b-47cb-b9f7-474d0112ae87 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:15.671525 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed655ea5-1e8f-4b58-b178-8751b996f6af None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:15.731452 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052947d-94ca-47b6-b937-9d2571af1ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:15.733377 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052947d-94ca-47b6-b937-9d2571af1ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:15.734102 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052947d-94ca-47b6-b937-9d2571af1ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:15.734751 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052947d-94ca-47b6-b937-9d2571af1ed9 None admin] PATH_INFO: `/v3/projects/7aa99b52f0384814a1f8896bb995a2b2` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:15.737190 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d052947d-94ca-47b6-b937-9d2571af1ed9 None admin] RBAC: Authorizing `identity:get_project(project_id=7aa99b52f0384814a1f8896bb995a2b2)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:15.740134 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d052947d-94ca-47b6-b937-9d2571af1ed9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:15.744438 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 189/381] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:13:15 2022] GET /identity/v3/projects/7aa99b52f0384814a1f8896bb995a2b2 => generated 344 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:15.753915 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052947d-94ca-47b6-b937-9d2571af1ed9 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:15.776902 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:15.784219 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:15.830441 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59353cbe-df2b-47cb-b9f7-474d0112ae87 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:15.876392 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba1ad9-7436-4839-a588-83ddff0d09ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:15.877381 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba1ad9-7436-4839-a588-83ddff0d09ee None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:15.877877 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba1ad9-7436-4839-a588-83ddff0d09ee None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:15.878361 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba1ad9-7436-4839-a588-83ddff0d09ee None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:15.879425 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba1ad9-7436-4839-a588-83ddff0d09ee None admin] RBAC: Adding query filter params (name=member) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:15.879914 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba1ad9-7436-4839-a588-83ddff0d09ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:15.881563 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba1ad9-7436-4839-a588-83ddff0d09ee None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:15.891668 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 193/382] 10.222.0.32 () {56 vars in 1101 bytes} [Wed Jun 1 04:13:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:13:15.896968 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba1ad9-7436-4839-a588-83ddff0d09ee None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:15.963376 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052947d-94ca-47b6-b937-9d2571af1ed9 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:16.014264 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba1ad9-7436-4839-a588-83ddff0d09ee None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:16.020568 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f5710-b0e4-460f-9f09-c64669d12819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:16.021944 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f5710-b0e4-460f-9f09-c64669d12819 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:16.023006 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f5710-b0e4-460f-9f09-c64669d12819 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:16.023779 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f5710-b0e4-460f-9f09-c64669d12819 None admin] PATH_INFO: `/v3/groups/44e161c50e1c4fe8b3332c124e78deec` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:16.032274 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f5710-b0e4-460f-9f09-c64669d12819 None admin] RBAC: Authorizing `identity:get_group(group_id=44e161c50e1c4fe8b3332c124e78deec)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:16.035093 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f5710-b0e4-460f-9f09-c64669d12819 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:16.038125 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 190/383] 10.222.0.32 () {56 vars in 1180 bytes} [Wed Jun 1 04:13:15 2022] GET /identity/v3/groups/44e161c50e1c4fe8b3332c124e78deec => generated 229 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:13:16.046075 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:16.047649 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f5710-b0e4-460f-9f09-c64669d12819 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:16.057046 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461bc31-e310-4977-ac97-17f5e8614791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:16.058910 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461bc31-e310-4977-ac97-17f5e8614791 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:16.059214 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461bc31-e310-4977-ac97-17f5e8614791 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:16.059475 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461bc31-e310-4977-ac97-17f5e8614791 None admin] PATH_INFO: `/v3/groups/b8c50852cd364f6d8b2cc2f364abef8a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:16.060868 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461bc31-e310-4977-ac97-17f5e8614791 None admin] RBAC: Authorizing `identity:get_group(group_id=b8c50852cd364f6d8b2cc2f364abef8a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:16.062408 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461bc31-e310-4977-ac97-17f5e8614791 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:16.064571 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 194/384] 10.222.0.32 () {56 vars in 1180 bytes} [Wed Jun 1 04:13:15 2022] GET /identity/v3/groups/b8c50852cd364f6d8b2cc2f364abef8a => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:13:16.071663 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461bc31-e310-4977-ac97-17f5e8614791 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:16.174865 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:16.224054 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f5710-b0e4-460f-9f09-c64669d12819 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:16.236984 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461bc31-e310-4977-ac97-17f5e8614791 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:16.286679 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08521bb4-34d0-4d7a-a471-baee72b437db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:16.289101 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08521bb4-34d0-4d7a-a471-baee72b437db None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:16.289967 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08521bb4-34d0-4d7a-a471-baee72b437db None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:16.292444 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08521bb4-34d0-4d7a-a471-baee72b437db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:16.294662 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08521bb4-34d0-4d7a-a471-baee72b437db None admin] RBAC: Adding query filter params (group.id=44e161c50e1c4fe8b3332c124e78deec, role.id=76fc054ad9544460a7be1e2010c23642, scope.project.id=7aa99b52f0384814a1f8896bb995a2b2) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:16.296075 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08521bb4-34d0-4d7a-a471-baee72b437db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:16.300433 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08521bb4-34d0-4d7a-a471-baee72b437db None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:16.312141 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76121236-7c58-4289-89e3-6d28bbe510d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:16.314041 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76121236-7c58-4289-89e3-6d28bbe510d8 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:16.314724 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76121236-7c58-4289-89e3-6d28bbe510d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:16.315492 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76121236-7c58-4289-89e3-6d28bbe510d8 None admin] PATH_INFO: `/v3/projects/51115e4840444ed8aa7f060448c5cc92` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:16.317896 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76121236-7c58-4289-89e3-6d28bbe510d8 None admin] RBAC: Authorizing `identity:get_project(project_id=51115e4840444ed8aa7f060448c5cc92)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:16.323699 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76121236-7c58-4289-89e3-6d28bbe510d8 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:16.324352 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 191/385] 10.222.0.32 () {56 vars in 1376 bytes} [Wed Jun 1 04:13:16 2022] GET /identity/v3/role_assignments?group.id=44e161c50e1c4fe8b3332c124e78deec&scope.project.id=7aa99b52f0384814a1f8896bb995a2b2&role.id=76fc054ad9544460a7be1e2010c23642 => generated 260 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:13:16.327791 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 195/386] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:13:16 2022] GET /identity/v3/projects/51115e4840444ed8aa7f060448c5cc92 => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:16.336038 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08521bb4-34d0-4d7a-a471-baee72b437db None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:16.507819 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08521bb4-34d0-4d7a-a471-baee72b437db None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:16.560827 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14012fde-20b2-4baa-aa14-92ea2a61ce45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:16.562093 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14012fde-20b2-4baa-aa14-92ea2a61ce45 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:16.562584 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14012fde-20b2-4baa-aa14-92ea2a61ce45 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:16.563086 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14012fde-20b2-4baa-aa14-92ea2a61ce45 None admin] PATH_INFO: `/v3/projects/51115e4840444ed8aa7f060448c5cc92/groups/b8c50852cd364f6d8b2cc2f364abef8a/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:16.565319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14012fde-20b2-4baa-aa14-92ea2a61ce45 None admin] RBAC: Authorizing `identity:create_grant(project_id=51115e4840444ed8aa7f060448c5cc92, group_id=b8c50852cd364f6d8b2cc2f364abef8a, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:16.567017 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14012fde-20b2-4baa-aa14-92ea2a61ce45 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:16.570576 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:16.584549 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 192/387] 10.222.0.32 () {58 vars in 1442 bytes} [Wed Jun 1 04:13:16 2022] PUT /identity/v3/projects/51115e4840444ed8aa7f060448c5cc92/groups/b8c50852cd364f6d8b2cc2f364abef8a/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:13:17.462457 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340acba3-1a13-4fae-a020-6cd1f1bedbe6 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:17.462954 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340acba3-1a13-4fae-a020-6cd1f1bedbe6 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:17.462954 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340acba3-1a13-4fae-a020-6cd1f1bedbe6 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:17.464601 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 196/388] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:17.470224 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924a194-23da-45e0-9389-6ee35f26b686 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:17.470519 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924a194-23da-45e0-9389-6ee35f26b686 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:17.470805 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924a194-23da-45e0-9389-6ee35f26b686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:17.479703 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24f269-bf59-477e-bebf-7fa386c457f2 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:17.480009 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24f269-bf59-477e-bebf-7fa386c457f2 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:17.480290 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24f269-bf59-477e-bebf-7fa386c457f2 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:17.481656 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 197/389] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:13:17.486707 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c47df-eee4-4dd8-9ee0-9466d423538e None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:17.486994 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c47df-eee4-4dd8-9ee0-9466d423538e None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:17.487275 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c47df-eee4-4dd8-9ee0-9466d423538e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:17.507716 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b924a194-23da-45e0-9389-6ee35f26b686 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:17.508936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b924a194-23da-45e0-9389-6ee35f26b686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:17.517596 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-a61c47df-eee4-4dd8-9ee0-9466d423538e None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:17.518830 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a61c47df-eee4-4dd8-9ee0-9466d423538e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:17.583923 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:17.595095 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 198/390] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 04:13:17.608291 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 193/391] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:13:17.632401 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c47df-eee4-4dd8-9ee0-9466d423538e None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:17.642635 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924a194-23da-45e0-9389-6ee35f26b686 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:17.765069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924a194-23da-45e0-9389-6ee35f26b686 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:17.791116 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:17.804686 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70815e36-f0a3-4413-b197-7cd44cb6adc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:17.810001 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70815e36-f0a3-4413-b197-7cd44cb6adc9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:17.810001 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70815e36-f0a3-4413-b197-7cd44cb6adc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:17.810001 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70815e36-f0a3-4413-b197-7cd44cb6adc9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:17.818445 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70815e36-f0a3-4413-b197-7cd44cb6adc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:17.826906 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-70815e36-f0a3-4413-b197-7cd44cb6adc9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 04:13:17.826906 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:17.826906 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:17.826906 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:17.826906 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:17.826906 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:17.826906 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:17.826906 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:17.826906 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:17.826906 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:17.826906 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:17.826906 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:17.826906 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:17.826906 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:17.826906 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:17.826906 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:17.828740 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:17.828740 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:17.828740 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:17.828740 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:17.828740 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:17.828740 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:17.828740 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:17.828740 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:17.828740 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:17.828740 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:17.828740 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:17.828740 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:17.828740 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:17.828740 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:17.828740 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:17.828740 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:17.830368 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:17.830368 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:17.830368 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:17.830368 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:17.830368 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:17.830368 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:17.830368 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:17.830368 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:17.830368 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:17.830368 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:17.830368 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 04:13:17.830368 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:17.830368 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 194/392] 10.222.0.32 () {56 vars in 1114 bytes} [Wed Jun 1 04:13:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:17.838008 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70815e36-f0a3-4413-b197-7cd44cb6adc9 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:17.856547 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c47df-eee4-4dd8-9ee0-9466d423538e None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:17.896933 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c6ba8-3e19-4db3-a4c1-c66710073409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:17.900801 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c6ba8-3e19-4db3-a4c1-c66710073409 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:17.901090 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c6ba8-3e19-4db3-a4c1-c66710073409 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:17.901370 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c6ba8-3e19-4db3-a4c1-c66710073409 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:17.927284 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c6ba8-3e19-4db3-a4c1-c66710073409 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:17.938322 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-5e7c6ba8-3e19-4db3-a4c1-c66710073409 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 01 04:13:17.938322 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:17.938322 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:17.938322 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:17.938322 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:17.938322 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:17.938322 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:17.938322 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:17.938322 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:17.938322 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:17.938322 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:17.938322 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:17.938322 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:17.938322 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:17.938322 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:17.938322 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:17.940426 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:17.940426 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:17.940426 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:17.940426 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:17.940426 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:17.940426 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:17.940426 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:17.940426 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:17.940426 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:17.940426 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:17.940426 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:17.940426 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:17.940426 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:17.940426 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:17.940426 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:17.940426 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:17.942410 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:17.942410 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:17.942410 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:17.942410 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:17.942410 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:17.942410 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:17.942410 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:17.942410 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:17.942410 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:17.942410 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:17.942410 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 01 04:13:17.942410 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:17.942410 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 199/393] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:13:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:17.946018 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c6ba8-3e19-4db3-a4c1-c66710073409 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:18.013040 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70815e36-f0a3-4413-b197-7cd44cb6adc9 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:18.023265 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:18.050577 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e632c-e4ed-4fb9-8466-f0399662843d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:18.051255 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e632c-e4ed-4fb9-8466-f0399662843d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:18.051584 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e632c-e4ed-4fb9-8466-f0399662843d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:18.051871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e632c-e4ed-4fb9-8466-f0399662843d None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:18.052622 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e632c-e4ed-4fb9-8466-f0399662843d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:18.052929 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e632c-e4ed-4fb9-8466-f0399662843d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:18.054406 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e632c-e4ed-4fb9-8466-f0399662843d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:18.066096 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 195/394] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:13:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:13:18.070100 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e632c-e4ed-4fb9-8466-f0399662843d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:18.077357 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c6ba8-3e19-4db3-a4c1-c66710073409 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:18.119785 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:18.139672 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1bf01-a5f4-4fa8-b2f5-ef2d4ccf6999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:18.140400 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1bf01-a5f4-4fa8-b2f5-ef2d4ccf6999 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:18.140688 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1bf01-a5f4-4fa8-b2f5-ef2d4ccf6999 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:18.140962 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1bf01-a5f4-4fa8-b2f5-ef2d4ccf6999 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:18.141712 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1bf01-a5f4-4fa8-b2f5-ef2d4ccf6999 None admin] RBAC: Adding query filter params (name=member) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:18.142032 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1bf01-a5f4-4fa8-b2f5-ef2d4ccf6999 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:18.143501 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1bf01-a5f4-4fa8-b2f5-ef2d4ccf6999 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:18.162193 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 200/395] 10.222.0.32 () {56 vars in 1101 bytes} [Wed Jun 1 04:13:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:13:18.167902 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1bf01-a5f4-4fa8-b2f5-ef2d4ccf6999 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:18.199050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e632c-e4ed-4fb9-8466-f0399662843d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:18.282771 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36000ba1-05ea-41c3-9091-c33978b7e14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:18.283554 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36000ba1-05ea-41c3-9091-c33978b7e14c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:18.283835 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36000ba1-05ea-41c3-9091-c33978b7e14c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:18.284109 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36000ba1-05ea-41c3-9091-c33978b7e14c None admin] PATH_INFO: `/v3/groups/b8c50852cd364f6d8b2cc2f364abef8a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:18.285993 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36000ba1-05ea-41c3-9091-c33978b7e14c None admin] RBAC: Authorizing `identity:get_group(group_id=b8c50852cd364f6d8b2cc2f364abef8a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:18.287432 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36000ba1-05ea-41c3-9091-c33978b7e14c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:18.298471 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 196/396] 10.222.0.32 () {56 vars in 1180 bytes} [Wed Jun 1 04:13:18 2022] GET /identity/v3/groups/b8c50852cd364f6d8b2cc2f364abef8a => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:18.299916 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36000ba1-05ea-41c3-9091-c33978b7e14c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:18.353417 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1bf01-a5f4-4fa8-b2f5-ef2d4ccf6999 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:18.404363 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:18.415737 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323cf454-e36d-465b-9b13-bece73d1352c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:18.417498 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cf454-e36d-465b-9b13-bece73d1352c None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:18.417786 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cf454-e36d-465b-9b13-bece73d1352c None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:18.418088 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cf454-e36d-465b-9b13-bece73d1352c None admin] PATH_INFO: `/v3/groups/b8c50852cd364f6d8b2cc2f364abef8a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:18.419375 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323cf454-e36d-465b-9b13-bece73d1352c None admin] RBAC: Authorizing `identity:get_group(group_id=b8c50852cd364f6d8b2cc2f364abef8a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:18.420966 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323cf454-e36d-465b-9b13-bece73d1352c None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:18.423457 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 201/397] 10.222.0.32 () {56 vars in 1180 bytes} [Wed Jun 1 04:13:18 2022] GET /identity/v3/groups/b8c50852cd364f6d8b2cc2f364abef8a => generated 226 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:13:18.429767 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323cf454-e36d-465b-9b13-bece73d1352c None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:18.464923 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36000ba1-05ea-41c3-9091-c33978b7e14c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:18.502493 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:18.510592 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d3806-1a0e-4ede-9989-b079f553cce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:18.512293 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d3806-1a0e-4ede-9989-b079f553cce7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:18.512584 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d3806-1a0e-4ede-9989-b079f553cce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:18.512862 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d3806-1a0e-4ede-9989-b079f553cce7 None admin] PATH_INFO: `/v3/projects/51115e4840444ed8aa7f060448c5cc92` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:18.514135 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d3806-1a0e-4ede-9989-b079f553cce7 None admin] RBAC: Authorizing `identity:get_project(project_id=51115e4840444ed8aa7f060448c5cc92)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:18.515593 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d3806-1a0e-4ede-9989-b079f553cce7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:18.526835 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 197/398] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:13:18 2022] GET /identity/v3/projects/51115e4840444ed8aa7f060448c5cc92 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:13:18.528498 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d3806-1a0e-4ede-9989-b079f553cce7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:18.669228 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d3806-1a0e-4ede-9989-b079f553cce7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:18.677324 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323cf454-e36d-465b-9b13-bece73d1352c None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:18.712911 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09edb16-c1e7-4b55-9d3c-0e08fd5a07b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:18.713832 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09edb16-c1e7-4b55-9d3c-0e08fd5a07b0 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:18.714160 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09edb16-c1e7-4b55-9d3c-0e08fd5a07b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:18.714441 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09edb16-c1e7-4b55-9d3c-0e08fd5a07b0 None admin] PATH_INFO: `/v3/projects/51115e4840444ed8aa7f060448c5cc92/groups/b8c50852cd364f6d8b2cc2f364abef8a/roles/71e70e8fe1344699a131764a348d51d6` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:18.716701 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09edb16-c1e7-4b55-9d3c-0e08fd5a07b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=51115e4840444ed8aa7f060448c5cc92, group_id=b8c50852cd364f6d8b2cc2f364abef8a, role_id=71e70e8fe1344699a131764a348d51d6)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:18.718189 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09edb16-c1e7-4b55-9d3c-0e08fd5a07b0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:18.723531 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1192ac6-ee5e-4157-9b32-7d0cb0e22150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:18.724434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1192ac6-ee5e-4157-9b32-7d0cb0e22150 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:18.724728 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1192ac6-ee5e-4157-9b32-7d0cb0e22150 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:18.725005 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1192ac6-ee5e-4157-9b32-7d0cb0e22150 None admin] PATH_INFO: `/v3/projects/047a5e1b44994e5690d32519e9f95eff` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:18.729050 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1192ac6-ee5e-4157-9b32-7d0cb0e22150 None admin] RBAC: Authorizing `identity:get_project(project_id=047a5e1b44994e5690d32519e9f95eff)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:18.729050 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1192ac6-ee5e-4157-9b32-7d0cb0e22150 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:18.734254 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 202/399] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:13:18 2022] GET /identity/v3/projects/047a5e1b44994e5690d32519e9f95eff => generated 302 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:18.735757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e9a2f-8771-40ef-9161-91c07456657d None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:18.736070 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e9a2f-8771-40ef-9161-91c07456657d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:18.736319 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e9a2f-8771-40ef-9161-91c07456657d None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:18.738029 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 203/400] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:18.739964 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e9a2f-8771-40ef-9161-91c07456657d None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:18.743530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 198/401] 10.222.0.32 () {58 vars in 1442 bytes} [Wed Jun 1 04:13:18 2022] PUT /identity/v3/projects/51115e4840444ed8aa7f060448c5cc92/groups/b8c50852cd364f6d8b2cc2f364abef8a/roles/71e70e8fe1344699a131764a348d51d6 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:13:18.751892 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ddf095-8056-4961-8e25-8a96f55c9c4f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:18.752513 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ddf095-8056-4961-8e25-8a96f55c9c4f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:18.752983 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ddf095-8056-4961-8e25-8a96f55c9c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:18.781173 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-95ddf095-8056-4961-8e25-8a96f55c9c4f None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:18.782757 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-95ddf095-8056-4961-8e25-8a96f55c9c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:18.805127 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:18.846829 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:18.882007 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e9a2f-8771-40ef-9161-91c07456657d None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:18.899928 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 199/402] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:13:18.925423 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b75d34-c669-4df4-9837-2c94f82fe8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:18.926662 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b75d34-c669-4df4-9837-2c94f82fe8f9 None admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:18.927143 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b75d34-c669-4df4-9837-2c94f82fe8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:18.927594 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b75d34-c669-4df4-9837-2c94f82fe8f9 None admin] PATH_INFO: `/v3/projects/047a5e1b44994e5690d32519e9f95eff/groups/b8c50852cd364f6d8b2cc2f364abef8a/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:18.930022 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b75d34-c669-4df4-9837-2c94f82fe8f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=047a5e1b44994e5690d32519e9f95eff, group_id=b8c50852cd364f6d8b2cc2f364abef8a, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:18.931707 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b75d34-c669-4df4-9837-2c94f82fe8f9 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:18.934230 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ddf095-8056-4961-8e25-8a96f55c9c4f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:18.951689 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 204/403] 10.222.0.32 () {58 vars in 1442 bytes} [Wed Jun 1 04:13:18 2022] PUT /identity/v3/projects/047a5e1b44994e5690d32519e9f95eff/groups/b8c50852cd364f6d8b2cc2f364abef8a/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:13:19.100048 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ddf095-8056-4961-8e25-8a96f55c9c4f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:19.138762 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba9ed4-2cb7-432c-98ae-29515c68f1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:19.139597 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba9ed4-2cb7-432c-98ae-29515c68f1db None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:19.139906 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba9ed4-2cb7-432c-98ae-29515c68f1db None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:19.140185 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba9ed4-2cb7-432c-98ae-29515c68f1db None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:19.151787 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba9ed4-2cb7-432c-98ae-29515c68f1db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:19.160083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-7cba9ed4-2cb7-432c-98ae-29515c68f1db None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 04:13:19.160083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:19.160083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:19.160083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:19.160083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:19.160083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:19.160083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:19.160083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:19.160083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:19.160083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:19.160083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:19.160083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:19.160083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:19.160083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:19.160083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:19.160083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:19.161002 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:19.161002 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:19.161002 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:19.161002 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:19.161002 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:19.161002 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:19.161002 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:19.161002 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:19.161002 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:19.161002 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:19.161002 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:19.161002 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:19.161002 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:19.161002 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:19.161002 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:19.161002 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:19.161869 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:19.161869 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:19.161869 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:19.161869 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:19.161869 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:19.161869 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:19.161869 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:19.161869 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:19.161869 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:19.161869 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:19.161869 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 04:13:19.161869 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:19.161869 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 200/404] 10.222.0.32 () {56 vars in 1114 bytes} [Wed Jun 1 04:13:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:13:19.169716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b75d34-c669-4df4-9837-2c94f82fe8f9 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:19.283806 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f959b9d-551e-43f3-bbbf-be6f8d3dbd87 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:19.284183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f959b9d-551e-43f3-bbbf-be6f8d3dbd87 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:19.284374 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f959b9d-551e-43f3-bbbf-be6f8d3dbd87 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:19.285944 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 201/405] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:13:19.292243 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b64fb-c27c-4f31-880f-15ab4b682b16 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:19.292539 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b64fb-c27c-4f31-880f-15ab4b682b16 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:19.292826 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b64fb-c27c-4f31-880f-15ab4b682b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:19.304400 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b75d34-c669-4df4-9837-2c94f82fe8f9 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:19.310579 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b22b64fb-c27c-4f31-880f-15ab4b682b16 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:19.311780 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b22b64fb-c27c-4f31-880f-15ab4b682b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:19.321202 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:19.346348 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:19.349480 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb753067-39e4-4430-b419-4bad70df81d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:19.350188 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb753067-39e4-4430-b419-4bad70df81d3 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:19.351025 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb753067-39e4-4430-b419-4bad70df81d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:19.351302 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb753067-39e4-4430-b419-4bad70df81d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:19.352054 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb753067-39e4-4430-b419-4bad70df81d3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:19.352361 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb753067-39e4-4430-b419-4bad70df81d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:19.354579 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb753067-39e4-4430-b419-4bad70df81d3 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:19.363906 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 205/406] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:13:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:19.369422 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb753067-39e4-4430-b419-4bad70df81d3 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:19.398563 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 202/407] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:13:19.419805 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b64fb-c27c-4f31-880f-15ab4b682b16 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:19.559452 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb753067-39e4-4430-b419-4bad70df81d3 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:19.623524 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b64fb-c27c-4f31-880f-15ab4b682b16 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:19.632010 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f51b9-9681-457d-8c38-d06558c4c0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:19.637457 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f51b9-9681-457d-8c38-d06558c4c0fb None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:19.637951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f51b9-9681-457d-8c38-d06558c4c0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:19.638347 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f51b9-9681-457d-8c38-d06558c4c0fb None admin] PATH_INFO: `/v3/groups/b8c50852cd364f6d8b2cc2f364abef8a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:19.639900 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f51b9-9681-457d-8c38-d06558c4c0fb None admin] RBAC: Authorizing `identity:get_group(group_id=b8c50852cd364f6d8b2cc2f364abef8a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:19.641395 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f51b9-9681-457d-8c38-d06558c4c0fb None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:19.649413 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 206/408] 10.222.0.32 () {56 vars in 1180 bytes} [Wed Jun 1 04:13:19 2022] GET /identity/v3/groups/b8c50852cd364f6d8b2cc2f364abef8a => generated 226 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:19.651431 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282684a-bbe7-4a13-a6a6-178e2eb043ac None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:19.651715 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282684a-bbe7-4a13-a6a6-178e2eb043ac None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:19.651993 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282684a-bbe7-4a13-a6a6-178e2eb043ac None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:19.653625 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 207/409] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:19.658561 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282684a-bbe7-4a13-a6a6-178e2eb043ac None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:19.677593 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537dafc4-6fe6-479f-a49f-1ed1926937c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:19.678863 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537dafc4-6fe6-479f-a49f-1ed1926937c4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:19.679543 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537dafc4-6fe6-479f-a49f-1ed1926937c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:19.680393 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537dafc4-6fe6-479f-a49f-1ed1926937c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:19.695456 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537dafc4-6fe6-479f-a49f-1ed1926937c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:19.704798 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-537dafc4-6fe6-479f-a49f-1ed1926937c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:13:19.704798 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:19.704798 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:19.704798 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:19.704798 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:19.704798 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:19.704798 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:19.704798 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:19.704798 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:19.704798 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:19.704798 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:19.704798 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:19.704798 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:19.704798 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:19.704798 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:19.704798 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:19.705722 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:19.705722 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:19.705722 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:19.705722 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:19.705722 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:19.705722 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:19.705722 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:19.705722 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:19.705722 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:19.705722 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:19.705722 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:19.705722 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:19.705722 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:19.705722 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:19.705722 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:19.705722 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:19.706527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:19.706527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:19.706527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:19.706527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:19.706527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:19.706527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:19.706527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:19.706527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:19.706527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:19.706527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:19.706527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:13:19.706527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:19.709235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 203/410] 10.222.0.32 () {56 vars in 1096 bytes} [Wed Jun 1 04:13:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:13:19.711844 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861f180-99fd-4598-a085-9f2c0d8feac3 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:19.712992 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:19.713502 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861f180-99fd-4598-a085-9f2c0d8feac3 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:19.714956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861f180-99fd-4598-a085-9f2c0d8feac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:19.737691 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-1861f180-99fd-4598-a085-9f2c0d8feac3 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:19.739850 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1861f180-99fd-4598-a085-9f2c0d8feac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:19.780633 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:19.787843 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282684a-bbe7-4a13-a6a6-178e2eb043ac None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:19.825924 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 204/411] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:13:19.830605 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861f180-99fd-4598-a085-9f2c0d8feac3 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:19.843565 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518c9c3-1b20-420e-9875-56832fa9f96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:19.844665 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518c9c3-1b20-420e-9875-56832fa9f96e None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:19.845134 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518c9c3-1b20-420e-9875-56832fa9f96e None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:19.845549 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518c9c3-1b20-420e-9875-56832fa9f96e None admin] PATH_INFO: `/v3/projects/047a5e1b44994e5690d32519e9f95eff` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:19.846948 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0518c9c3-1b20-420e-9875-56832fa9f96e None admin] RBAC: Authorizing `identity:get_project(project_id=047a5e1b44994e5690d32519e9f95eff)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:19.848795 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0518c9c3-1b20-420e-9875-56832fa9f96e None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:19.852849 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 208/412] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:13:19 2022] GET /identity/v3/projects/047a5e1b44994e5690d32519e9f95eff => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:19.855061 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518c9c3-1b20-420e-9875-56832fa9f96e None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:19.968703 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518c9c3-1b20-420e-9875-56832fa9f96e None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:19.970694 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861f180-99fd-4598-a085-9f2c0d8feac3 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:19.980665 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:20.007296 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff8ebe-8ef6-41a8-9f19-e1f2e05023f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:20.008328 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff8ebe-8ef6-41a8-9f19-e1f2e05023f8 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:20.008748 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff8ebe-8ef6-41a8-9f19-e1f2e05023f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:20.009105 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb72807-a7df-4e5a-91b0-db81a4218b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:20.009353 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff8ebe-8ef6-41a8-9f19-e1f2e05023f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:20.009966 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb72807-a7df-4e5a-91b0-db81a4218b75 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:20.010364 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb72807-a7df-4e5a-91b0-db81a4218b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:20.010739 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb72807-a7df-4e5a-91b0-db81a4218b75 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:20.011573 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb72807-a7df-4e5a-91b0-db81a4218b75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:20.011968 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb72807-a7df-4e5a-91b0-db81a4218b75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:20.013418 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb72807-a7df-4e5a-91b0-db81a4218b75 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:20.021485 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff8ebe-8ef6-41a8-9f19-e1f2e05023f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:20.022579 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 205/413] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:13:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:20.023493 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb72807-a7df-4e5a-91b0-db81a4218b75 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:20.030245 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-16ff8ebe-8ef6-41a8-9f19-e1f2e05023f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 01 04:13:20.030245 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:20.030245 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:20.030245 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:20.030245 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:20.030245 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:20.030245 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:20.030245 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:20.030245 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:20.030245 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:20.030245 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:20.030245 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:20.030245 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:20.030245 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:20.030245 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:20.030245 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:20.031124 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:20.031124 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:20.031124 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:20.031124 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:20.031124 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:20.031124 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:20.031124 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:20.031124 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:20.031124 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:20.031124 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:20.031124 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:20.031124 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:20.031124 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:20.031124 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:20.031124 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:20.031124 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:20.031901 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:20.031901 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:20.031901 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:20.031901 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:20.031901 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:20.031901 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:20.031901 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:20.031901 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:20.031901 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:20.031901 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:20.031901 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 01 04:13:20.031901 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:20.034599 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 209/414] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:13:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:20.035639 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff8ebe-8ef6-41a8-9f19-e1f2e05023f8 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:20.043356 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:20.130094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb72807-a7df-4e5a-91b0-db81a4218b75 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:20.146997 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff8ebe-8ef6-41a8-9f19-e1f2e05023f8 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:20.169995 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8efdbb-3fb8-4aa7-a8fc-4865184ade5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:20.169995 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8efdbb-3fb8-4aa7-a8fc-4865184ade5c None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:20.169995 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8efdbb-3fb8-4aa7-a8fc-4865184ade5c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:20.169995 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8efdbb-3fb8-4aa7-a8fc-4865184ade5c None admin] PATH_INFO: `/v3/projects/047a5e1b44994e5690d32519e9f95eff/groups/b8c50852cd364f6d8b2cc2f364abef8a/roles/71e70e8fe1344699a131764a348d51d6` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:20.170383 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8efdbb-3fb8-4aa7-a8fc-4865184ade5c None admin] RBAC: Authorizing `identity:create_grant(project_id=047a5e1b44994e5690d32519e9f95eff, group_id=b8c50852cd364f6d8b2cc2f364abef8a, role_id=71e70e8fe1344699a131764a348d51d6)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:20.170383 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8efdbb-3fb8-4aa7-a8fc-4865184ade5c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:20.184049 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 206/415] 10.222.0.32 () {58 vars in 1442 bytes} [Wed Jun 1 04:13:20 2022] PUT /identity/v3/projects/047a5e1b44994e5690d32519e9f95eff/groups/b8c50852cd364f6d8b2cc2f364abef8a/roles/71e70e8fe1344699a131764a348d51d6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:13:20.184900 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8efdbb-3fb8-4aa7-a8fc-4865184ade5c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:20.191770 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7eb643-1b17-4b16-978a-fdf6a4f4195a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:20.192744 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7eb643-1b17-4b16-978a-fdf6a4f4195a None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:20.193029 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7eb643-1b17-4b16-978a-fdf6a4f4195a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:20.193571 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7eb643-1b17-4b16-978a-fdf6a4f4195a None admin] PATH_INFO: `/v3/groups/44e161c50e1c4fe8b3332c124e78deec` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:20.198996 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7eb643-1b17-4b16-978a-fdf6a4f4195a None admin] RBAC: Authorizing `identity:get_group(group_id=44e161c50e1c4fe8b3332c124e78deec)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:20.200699 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7eb643-1b17-4b16-978a-fdf6a4f4195a None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:20.202505 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 210/416] 10.222.0.32 () {56 vars in 1180 bytes} [Wed Jun 1 04:13:20 2022] GET /identity/v3/groups/44e161c50e1c4fe8b3332c124e78deec => generated 229 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:20.208574 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7eb643-1b17-4b16-978a-fdf6a4f4195a None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:20.289551 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:20.304017 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:20.339195 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8efdbb-3fb8-4aa7-a8fc-4865184ade5c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:20.417928 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e9479-3d87-4f27-b23e-35cbe8218a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:20.420182 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e9479-3d87-4f27-b23e-35cbe8218a06 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:20.420471 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e9479-3d87-4f27-b23e-35cbe8218a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:20.420859 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e9479-3d87-4f27-b23e-35cbe8218a06 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:20.421632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e9479-3d87-4f27-b23e-35cbe8218a06 None admin] RBAC: Adding query filter params (name=member) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:20.421939 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e9479-3d87-4f27-b23e-35cbe8218a06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:20.423394 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e9479-3d87-4f27-b23e-35cbe8218a06 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:20.440745 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 207/417] 10.222.0.32 () {56 vars in 1101 bytes} [Wed Jun 1 04:13:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:20.447675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7eb643-1b17-4b16-978a-fdf6a4f4195a None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:20.449844 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e9479-3d87-4f27-b23e-35cbe8218a06 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:20.494919 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1718df0-39d1-4494-9b93-1bbf49fdb22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:20.495888 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1718df0-39d1-4494-9b93-1bbf49fdb22b None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:20.496168 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1718df0-39d1-4494-9b93-1bbf49fdb22b None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:20.496440 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1718df0-39d1-4494-9b93-1bbf49fdb22b None admin] PATH_INFO: `/v3/projects/7aa99b52f0384814a1f8896bb995a2b2` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:20.497754 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1718df0-39d1-4494-9b93-1bbf49fdb22b None admin] RBAC: Authorizing `identity:get_project(project_id=7aa99b52f0384814a1f8896bb995a2b2)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:20.499332 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1718df0-39d1-4494-9b93-1bbf49fdb22b None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:20.501345 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 211/418] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:13:20 2022] GET /identity/v3/projects/7aa99b52f0384814a1f8896bb995a2b2 => generated 344 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:13:20.506657 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1718df0-39d1-4494-9b93-1bbf49fdb22b None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:20.574422 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e9479-3d87-4f27-b23e-35cbe8218a06 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:20.638883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b5762-f724-46a9-8140-32113346ad18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:20.639666 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b5762-f724-46a9-8140-32113346ad18 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:20.645998 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b5762-f724-46a9-8140-32113346ad18 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:20.645998 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b5762-f724-46a9-8140-32113346ad18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:20.645998 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:20.698653 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1718df0-39d1-4494-9b93-1bbf49fdb22b None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:20.706321 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:20.741836 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8374ef-ae7a-453b-bf2d-84b50de5f228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:20.741836 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8374ef-ae7a-453b-bf2d-84b50de5f228 None admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:20.741836 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8374ef-ae7a-453b-bf2d-84b50de5f228 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:20.741836 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8374ef-ae7a-453b-bf2d-84b50de5f228 None admin] PATH_INFO: `/v3/projects/7aa99b52f0384814a1f8896bb995a2b2/groups/44e161c50e1c4fe8b3332c124e78deec/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:20.742679 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8374ef-ae7a-453b-bf2d-84b50de5f228 None admin] RBAC: Authorizing `identity:create_grant(project_id=7aa99b52f0384814a1f8896bb995a2b2, group_id=44e161c50e1c4fe8b3332c124e78deec, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:20.742679 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8374ef-ae7a-453b-bf2d-84b50de5f228 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:20.762271 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 212/419] 10.222.0.32 () {58 vars in 1442 bytes} [Wed Jun 1 04:13:20 2022] PUT /identity/v3/projects/7aa99b52f0384814a1f8896bb995a2b2/groups/44e161c50e1c4fe8b3332c124e78deec/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:13:20.768404 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b5762-f724-46a9-8140-32113346ad18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:20.769916 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b5762-f724-46a9-8140-32113346ad18 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:20.926369 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 208/420] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:13:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 01 04:13:20.932590 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8374ef-ae7a-453b-bf2d-84b50de5f228 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:21.070756 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8374ef-ae7a-453b-bf2d-84b50de5f228 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:21.111929 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced370c-a0d8-4475-a94b-df9d2878877e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:21.112812 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced370c-a0d8-4475-a94b-df9d2878877e None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:21.113089 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced370c-a0d8-4475-a94b-df9d2878877e None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:21.113364 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced370c-a0d8-4475-a94b-df9d2878877e None admin] PATH_INFO: `/v3/projects/51115e4840444ed8aa7f060448c5cc92` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:21.114621 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced370c-a0d8-4475-a94b-df9d2878877e None admin] RBAC: Authorizing `identity:get_project(project_id=51115e4840444ed8aa7f060448c5cc92)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:21.116122 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced370c-a0d8-4475-a94b-df9d2878877e None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:21.118020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 213/421] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:13:20 2022] GET /identity/v3/projects/51115e4840444ed8aa7f060448c5cc92 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:21.123755 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b5762-f724-46a9-8140-32113346ad18 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:21.164445 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:21.241016 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b5762-f724-46a9-8140-32113346ad18 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:21.290025 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6861e-b215-4804-9458-501320e94868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:21.290897 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6861e-b215-4804-9458-501320e94868 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:21.291179 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6861e-b215-4804-9458-501320e94868 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:21.291455 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6861e-b215-4804-9458-501320e94868 None admin] PATH_INFO: `/v3/groups/b8c50852cd364f6d8b2cc2f364abef8a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:21.292635 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6861e-b215-4804-9458-501320e94868 None admin] RBAC: Authorizing `identity:get_group(group_id=b8c50852cd364f6d8b2cc2f364abef8a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:21.294092 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6861e-b215-4804-9458-501320e94868 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:21.295870 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 209/422] 10.222.0.32 () {56 vars in 1180 bytes} [Wed Jun 1 04:13:21 2022] GET /identity/v3/groups/b8c50852cd364f6d8b2cc2f364abef8a => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:21.301866 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced370c-a0d8-4475-a94b-df9d2878877e None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:21.347317 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:21.437493 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced370c-a0d8-4475-a94b-df9d2878877e None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:21.482787 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962d6dc-a8dd-40c5-867d-ff5412d2b051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:21.483482 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962d6dc-a8dd-40c5-867d-ff5412d2b051 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:21.483771 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962d6dc-a8dd-40c5-867d-ff5412d2b051 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:21.484051 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962d6dc-a8dd-40c5-867d-ff5412d2b051 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:21.484913 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962d6dc-a8dd-40c5-867d-ff5412d2b051 None admin] RBAC: Adding query filter params (group.id=b8c50852cd364f6d8b2cc2f364abef8a, role.id=3f08ec4046094d04a533ba522f71ba9a, scope.project.id=51115e4840444ed8aa7f060448c5cc92) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:21.485223 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962d6dc-a8dd-40c5-867d-ff5412d2b051 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:21.486744 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962d6dc-a8dd-40c5-867d-ff5412d2b051 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:21.493735 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 214/423] 10.222.0.32 () {56 vars in 1376 bytes} [Wed Jun 1 04:13:21 2022] GET /identity/v3/role_assignments?group.id=b8c50852cd364f6d8b2cc2f364abef8a&scope.project.id=51115e4840444ed8aa7f060448c5cc92&role.id=3f08ec4046094d04a533ba522f71ba9a => generated 611 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:21.513792 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e586f4-0195-49d0-92c8-6c031b2440b8 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:21.514133 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e586f4-0195-49d0-92c8-6c031b2440b8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:21.514371 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e586f4-0195-49d0-92c8-6c031b2440b8 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:21.515805 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 210/424] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:21.526503 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bf24a-75c0-48db-96db-ea85d4ea8a5c None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:21.526503 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bf24a-75c0-48db-96db-ea85d4ea8a5c None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:21.526503 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bf24a-75c0-48db-96db-ea85d4ea8a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:21.563283 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-ff8bf24a-75c0-48db-96db-ea85d4ea8a5c None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:21.564525 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-ff8bf24a-75c0-48db-96db-ea85d4ea8a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:21.703907 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 215/425] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 04:13:21.729120 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e586f4-0195-49d0-92c8-6c031b2440b8 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:21.786230 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9971195-a2fd-428e-b1c0-ffc580dad9ff None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:21.786769 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9971195-a2fd-428e-b1c0-ffc580dad9ff None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:21.786769 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9971195-a2fd-428e-b1c0-ffc580dad9ff None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:21.789515 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 216/426] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:13:21.794840 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9748531-d089-4d0a-8a7d-56a051976571 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:21.795317 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9748531-d089-4d0a-8a7d-56a051976571 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:21.795698 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9748531-d089-4d0a-8a7d-56a051976571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:21.818098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-f9748531-d089-4d0a-8a7d-56a051976571 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:21.820220 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f9748531-d089-4d0a-8a7d-56a051976571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:21.846547 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:21.847585 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e586f4-0195-49d0-92c8-6c031b2440b8 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:21.851044 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:21.889071 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b25c8-5e4c-4387-b596-29cec16a160b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:21.889889 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b25c8-5e4c-4387-b596-29cec16a160b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:21.890310 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b25c8-5e4c-4387-b596-29cec16a160b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:21.890495 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b25c8-5e4c-4387-b596-29cec16a160b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:21.906654 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b25c8-5e4c-4387-b596-29cec16a160b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:21.907587 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 217/427] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 04:13:21.915258 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-783b25c8-5e4c-4387-b596-29cec16a160b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 01 04:13:21.915258 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:21.915258 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:21.915258 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:21.915258 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:21.915258 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:21.915258 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:21.915258 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:21.915258 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:21.915258 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:21.915258 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:21.915258 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:21.915258 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:21.915258 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:21.915258 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:21.915258 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:21.916235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:21.916235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:21.916235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:21.916235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:21.916235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:21.916235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:21.916235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:21.916235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:21.916235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:21.916235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:21.916235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:21.916235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:21.916235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:21.916235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:21.916235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:21.916235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:21.917089 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:21.917089 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:21.917089 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:21.917089 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:21.917089 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:21.917089 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:21.917089 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:21.917089 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:21.917089 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:21.917089 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:21.917089 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 01 04:13:21.917089 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:21.917089 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 211/428] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:13:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:21.923774 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9748531-d089-4d0a-8a7d-56a051976571 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:21.935687 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b25c8-5e4c-4387-b596-29cec16a160b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:22.045732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9748531-d089-4d0a-8a7d-56a051976571 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:22.053118 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b25c8-5e4c-4387-b596-29cec16a160b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:22.091739 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3cdef-ef81-42de-860f-0e48149f6018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:22.092746 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3cdef-ef81-42de-860f-0e48149f6018 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:22.093031 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3cdef-ef81-42de-860f-0e48149f6018 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:22.093311 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3cdef-ef81-42de-860f-0e48149f6018 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:22.094149 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3cdef-ef81-42de-860f-0e48149f6018 None admin] RBAC: Adding query filter params (name=member) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:22.094566 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3cdef-ef81-42de-860f-0e48149f6018 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:22.096848 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b14f3-8eb7-4afb-acf1-147f92bed53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:22.097178 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3cdef-ef81-42de-860f-0e48149f6018 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:22.098031 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b14f3-8eb7-4afb-acf1-147f92bed53f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:22.098561 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b14f3-8eb7-4afb-acf1-147f92bed53f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:22.098988 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b14f3-8eb7-4afb-acf1-147f92bed53f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:22.107241 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 218/429] 10.222.0.32 () {56 vars in 1101 bytes} [Wed Jun 1 04:13:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:22.112553 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3cdef-ef81-42de-860f-0e48149f6018 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:22.113852 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b14f3-8eb7-4afb-acf1-147f92bed53f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:22.123227 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-4f6b14f3-8eb7-4afb-acf1-147f92bed53f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 04:13:22.123227 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:22.123227 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:22.123227 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:22.123227 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:22.123227 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:22.123227 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:22.123227 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:22.123227 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:22.123227 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:22.123227 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:22.123227 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:22.123227 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:22.123227 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:22.123227 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:22.123227 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:22.124137 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:22.124137 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:22.124137 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:22.124137 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:22.124137 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:22.124137 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:22.124137 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:22.124137 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:22.124137 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:22.124137 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:22.124137 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:22.124137 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:22.124137 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:22.124137 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:22.124137 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:22.124137 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:22.124954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:22.124954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:22.124954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:22.124954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:22.124954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:22.124954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:22.124954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:22.124954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:22.124954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:22.124954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:22.124954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 04:13:22.124954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:22.132133 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 212/430] 10.222.0.32 () {56 vars in 1114 bytes} [Wed Jun 1 04:13:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:13:22.134754 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b14f3-8eb7-4afb-acf1-147f92bed53f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:22.136314 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:22.165208 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:22.221293 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3cdef-ef81-42de-860f-0e48149f6018 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:22.252857 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b14f3-8eb7-4afb-acf1-147f92bed53f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:22.264587 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b3363-173b-4f42-a01c-589a6c72a003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:22.265243 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b3363-173b-4f42-a01c-589a6c72a003 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:22.265528 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b3363-173b-4f42-a01c-589a6c72a003 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:22.265811 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b3363-173b-4f42-a01c-589a6c72a003 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:22.292417 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddfb107-20b3-49ed-8d29-e16f3172d3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:22.293503 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfb107-20b3-49ed-8d29-e16f3172d3f3 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:22.294047 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfb107-20b3-49ed-8d29-e16f3172d3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:22.294526 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfb107-20b3-49ed-8d29-e16f3172d3f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:22.295569 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddfb107-20b3-49ed-8d29-e16f3172d3f3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:22.296133 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddfb107-20b3-49ed-8d29-e16f3172d3f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:22.297833 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddfb107-20b3-49ed-8d29-e16f3172d3f3 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:22.309586 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 213/431] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:13:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:13:22.315545 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddfb107-20b3-49ed-8d29-e16f3172d3f3 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:22.348885 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b3363-173b-4f42-a01c-589a6c72a003 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:22.351046 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b3363-173b-4f42-a01c-589a6c72a003 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:22.378222 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:22.411845 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:22.439270 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddfb107-20b3-49ed-8d29-e16f3172d3f3 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:22.482181 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afb863-399c-41c5-bf38-ae737110bb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:22.483075 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afb863-399c-41c5-bf38-ae737110bb2f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:22.483507 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afb863-399c-41c5-bf38-ae737110bb2f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:22.483931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afb863-399c-41c5-bf38-ae737110bb2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:22.486966 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 219/432] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:13:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 01 04:13:22.492898 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b3363-173b-4f42-a01c-589a6c72a003 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:22.557930 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1afb863-399c-41c5-bf38-ae737110bb2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:22.559647 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1afb863-399c-41c5-bf38-ae737110bb2f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:22.600715 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b3363-173b-4f42-a01c-589a6c72a003 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:22.642014 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b01ee-211b-4605-a6cb-b72fd084576b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:22.643445 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b01ee-211b-4605-a6cb-b72fd084576b None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:22.643929 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b01ee-211b-4605-a6cb-b72fd084576b None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:22.644304 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b01ee-211b-4605-a6cb-b72fd084576b None admin] PATH_INFO: `/v3/projects/047a5e1b44994e5690d32519e9f95eff` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:22.646036 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b01ee-211b-4605-a6cb-b72fd084576b None admin] RBAC: Authorizing `identity:get_project(project_id=047a5e1b44994e5690d32519e9f95eff)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:22.647939 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b01ee-211b-4605-a6cb-b72fd084576b None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:22.654044 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 220/433] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:13:22 2022] GET /identity/v3/projects/047a5e1b44994e5690d32519e9f95eff => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:13:22.654300 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:22.656499 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:22.657218 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b01ee-211b-4605-a6cb-b72fd084576b None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:22.674824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 214/434] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:13:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 01 04:13:22.680953 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afb863-399c-41c5-bf38-ae737110bb2f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:22.794748 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afb863-399c-41c5-bf38-ae737110bb2f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:22.801551 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b01ee-211b-4605-a6cb-b72fd084576b None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:22.831692 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac95ad8-d54a-400c-ac06-3a702cca42e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:22.832464 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac95ad8-d54a-400c-ac06-3a702cca42e5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:22.832750 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac95ad8-d54a-400c-ac06-3a702cca42e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:22.833029 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac95ad8-d54a-400c-ac06-3a702cca42e5 None admin] PATH_INFO: `/v3/projects/51115e4840444ed8aa7f060448c5cc92` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:22.834283 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac95ad8-d54a-400c-ac06-3a702cca42e5 None admin] RBAC: Authorizing `identity:get_project(project_id=51115e4840444ed8aa7f060448c5cc92)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:22.835769 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac95ad8-d54a-400c-ac06-3a702cca42e5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:22.842011 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 215/435] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:13:22 2022] GET /identity/v3/projects/51115e4840444ed8aa7f060448c5cc92 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:13:22.843189 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac95ad8-d54a-400c-ac06-3a702cca42e5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:22.846930 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b6f2f-b90f-46ac-aa56-6299c2c40997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:22.848967 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b6f2f-b90f-46ac-aa56-6299c2c40997 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:22.849469 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b6f2f-b90f-46ac-aa56-6299c2c40997 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:22.849939 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b6f2f-b90f-46ac-aa56-6299c2c40997 None admin] PATH_INFO: `/v3/groups/b8c50852cd364f6d8b2cc2f364abef8a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:22.852311 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b6f2f-b90f-46ac-aa56-6299c2c40997 None admin] RBAC: Authorizing `identity:get_group(group_id=b8c50852cd364f6d8b2cc2f364abef8a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:22.854565 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b6f2f-b90f-46ac-aa56-6299c2c40997 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:22.862387 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 221/436] 10.222.0.32 () {56 vars in 1180 bytes} [Wed Jun 1 04:13:22 2022] GET /identity/v3/groups/b8c50852cd364f6d8b2cc2f364abef8a => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:22.863492 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b6f2f-b90f-46ac-aa56-6299c2c40997 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:22.914576 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:22.962349 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:22.964193 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac95ad8-d54a-400c-ac06-3a702cca42e5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:23.001890 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b6f2f-b90f-46ac-aa56-6299c2c40997 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:23.010269 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87057d66-37ec-4030-a75e-df599ac21f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:23.011766 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87057d66-37ec-4030-a75e-df599ac21f87 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:23.012253 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87057d66-37ec-4030-a75e-df599ac21f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:23.012746 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87057d66-37ec-4030-a75e-df599ac21f87 None admin] PATH_INFO: `/v3/groups/b8c50852cd364f6d8b2cc2f364abef8a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:23.014809 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87057d66-37ec-4030-a75e-df599ac21f87 None admin] RBAC: Authorizing `identity:get_group(group_id=b8c50852cd364f6d8b2cc2f364abef8a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:23.016976 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87057d66-37ec-4030-a75e-df599ac21f87 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:23.019263 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 216/437] 10.222.0.32 () {56 vars in 1180 bytes} [Wed Jun 1 04:13:22 2022] GET /identity/v3/groups/b8c50852cd364f6d8b2cc2f364abef8a => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:23.026656 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87057d66-37ec-4030-a75e-df599ac21f87 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:23.045771 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74624095-5cdd-4443-9c33-e73ddc5282ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:23.046476 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74624095-5cdd-4443-9c33-e73ddc5282ac None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:23.046765 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74624095-5cdd-4443-9c33-e73ddc5282ac None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:23.047047 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74624095-5cdd-4443-9c33-e73ddc5282ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:23.047966 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74624095-5cdd-4443-9c33-e73ddc5282ac None admin] RBAC: Adding query filter params (group.id=b8c50852cd364f6d8b2cc2f364abef8a, role.id=3f08ec4046094d04a533ba522f71ba9a, scope.project.id=047a5e1b44994e5690d32519e9f95eff) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:23.048432 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74624095-5cdd-4443-9c33-e73ddc5282ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:23.050105 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74624095-5cdd-4443-9c33-e73ddc5282ac None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:23.062171 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 222/438] 10.222.0.32 () {56 vars in 1376 bytes} [Wed Jun 1 04:13:22 2022] GET /identity/v3/role_assignments?group.id=b8c50852cd364f6d8b2cc2f364abef8a&scope.project.id=047a5e1b44994e5690d32519e9f95eff&role.id=3f08ec4046094d04a533ba522f71ba9a => generated 611 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:23.111166 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d86ca-9c4e-4bd6-b492-02e9883d54c6 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:23.111365 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d86ca-9c4e-4bd6-b492-02e9883d54c6 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:23.111640 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d86ca-9c4e-4bd6-b492-02e9883d54c6 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:23.113876 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 223/439] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:23.119118 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ede6d-0ecb-40c1-8238-3654ff5f8350 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:23.119442 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ede6d-0ecb-40c1-8238-3654ff5f8350 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:23.119687 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ede6d-0ecb-40c1-8238-3654ff5f8350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:23.138819 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-7c4ede6d-0ecb-40c1-8238-3654ff5f8350 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:23.140051 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7c4ede6d-0ecb-40c1-8238-3654ff5f8350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:23.160132 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87057d66-37ec-4030-a75e-df599ac21f87 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:23.194490 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:23.212616 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a64d9-bb20-4d52-9fd7-76196af9fd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:23.213484 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a64d9-bb20-4d52-9fd7-76196af9fd36 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:23.214168 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a64d9-bb20-4d52-9fd7-76196af9fd36 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:23.214516 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a64d9-bb20-4d52-9fd7-76196af9fd36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:23.215456 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a64d9-bb20-4d52-9fd7-76196af9fd36 None admin] RBAC: Adding query filter params (group.id=b8c50852cd364f6d8b2cc2f364abef8a, role.id=71e70e8fe1344699a131764a348d51d6, scope.project.id=51115e4840444ed8aa7f060448c5cc92) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:23.215841 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a64d9-bb20-4d52-9fd7-76196af9fd36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:23.218274 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a64d9-bb20-4d52-9fd7-76196af9fd36 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:23.227562 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 217/440] 10.222.0.32 () {56 vars in 1376 bytes} [Wed Jun 1 04:13:23 2022] GET /identity/v3/role_assignments?group.id=b8c50852cd364f6d8b2cc2f364abef8a&scope.project.id=51115e4840444ed8aa7f060448c5cc92&role.id=71e70e8fe1344699a131764a348d51d6 => generated 611 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:23.246469 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 224/441] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 04:13:23.267622 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a64d9-bb20-4d52-9fd7-76196af9fd36 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:23.389329 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a64d9-bb20-4d52-9fd7-76196af9fd36 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:23.427494 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e5c532-30f0-4de5-b4a8-226c4896dbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:23.428388 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5c532-30f0-4de5-b4a8-226c4896dbc8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:23.428675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5c532-30f0-4de5-b4a8-226c4896dbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:23.428953 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5c532-30f0-4de5-b4a8-226c4896dbc8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:23.440540 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e5c532-30f0-4de5-b4a8-226c4896dbc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:23.449420 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-f2e5c532-30f0-4de5-b4a8-226c4896dbc8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 04:13:23.449420 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:23.449420 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:23.449420 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:23.449420 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:23.449420 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:23.449420 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:23.449420 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:23.449420 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:23.449420 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:23.449420 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:23.449420 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:23.449420 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:23.449420 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:23.449420 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:23.449420 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:23.450341 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:23.450341 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:23.450341 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:23.450341 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:23.450341 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:23.450341 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:23.450341 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:23.450341 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:23.450341 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:23.450341 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:23.450341 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:23.450341 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:23.450341 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:23.450341 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:23.450341 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:23.450341 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:23.451130 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:23.451130 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:23.451130 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:23.451130 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:23.451130 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:23.451130 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:23.451130 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:23.451130 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:23.451130 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:23.451130 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:23.451130 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 04:13:23.451130 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:23.451130 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 218/442] 10.222.0.32 () {56 vars in 1114 bytes} [Wed Jun 1 04:13:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:23.456082 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7aaa4-ca35-4150-876c-c3dc8f3f7715 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:23.456372 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7aaa4-ca35-4150-876c-c3dc8f3f7715 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:23.456653 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7aaa4-ca35-4150-876c-c3dc8f3f7715 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:23.458153 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 225/443] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:23.458957 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e5c532-30f0-4de5-b4a8-226c4896dbc8 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:23.465473 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e74c3a-a02e-4922-81a0-8131aafbfa58 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:23.465752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e74c3a-a02e-4922-81a0-8131aafbfa58 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:23.466052 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e74c3a-a02e-4922-81a0-8131aafbfa58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:23.483666 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-10e74c3a-a02e-4922-81a0-8131aafbfa58 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:23.485547 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-10e74c3a-a02e-4922-81a0-8131aafbfa58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:23.513238 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:23.536388 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:23.565079 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 226/444] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 04:13:23.578128 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e5c532-30f0-4de5-b4a8-226c4896dbc8 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:23.588428 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e74c3a-a02e-4922-81a0-8131aafbfa58 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:23.621626 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e80d9e-96c7-46d9-9020-645557aef267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:23.622326 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e80d9e-96c7-46d9-9020-645557aef267 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:23.622608 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e80d9e-96c7-46d9-9020-645557aef267 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:23.622879 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e80d9e-96c7-46d9-9020-645557aef267 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:23.623617 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e80d9e-96c7-46d9-9020-645557aef267 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:23.623921 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e80d9e-96c7-46d9-9020-645557aef267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:23.625280 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e80d9e-96c7-46d9-9020-645557aef267 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:23.635191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 219/445] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:13:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:23.642550 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e80d9e-96c7-46d9-9020-645557aef267 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:23.706422 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e74c3a-a02e-4922-81a0-8131aafbfa58 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:23.747879 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c61efd-8022-4620-9260-c7e8465429bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:23.748745 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c61efd-8022-4620-9260-c7e8465429bc None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:23.749029 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c61efd-8022-4620-9260-c7e8465429bc None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:23.749302 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c61efd-8022-4620-9260-c7e8465429bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:23.760229 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e80d9e-96c7-46d9-9020-645557aef267 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:23.762072 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c61efd-8022-4620-9260-c7e8465429bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:23.769716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-c5c61efd-8022-4620-9260-c7e8465429bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:13:23.769716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:23.769716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:23.769716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:23.769716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:23.769716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:23.769716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:23.769716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:23.769716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:23.769716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:23.769716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:23.769716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:23.769716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:23.769716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:23.769716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:23.769716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:23.770678 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:23.770678 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:23.770678 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:23.770678 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:23.770678 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:23.770678 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:23.770678 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:23.770678 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:23.770678 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:23.770678 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:23.770678 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:23.770678 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:23.770678 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:23.770678 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:23.770678 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:23.770678 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:23.771632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:23.771632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:23.771632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:23.771632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:23.771632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:23.771632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:23.771632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:23.771632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:23.771632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:23.771632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:23.771632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:13:23.771632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:23.771632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 227/446] 10.222.0.32 () {56 vars in 1096 bytes} [Wed Jun 1 04:13:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:23.772922 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:23.776812 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c61efd-8022-4620-9260-c7e8465429bc None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:23.803919 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6005911-3504-4422-911c-40604cbd5fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:23.804583 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6005911-3504-4422-911c-40604cbd5fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:23.804859 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6005911-3504-4422-911c-40604cbd5fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:23.805139 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6005911-3504-4422-911c-40604cbd5fc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:23.825202 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:23.872907 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6005911-3504-4422-911c-40604cbd5fc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:23.874408 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6005911-3504-4422-911c-40604cbd5fc2 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:23.883347 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c61efd-8022-4620-9260-c7e8465429bc None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:23.916755 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72caa86-7102-4f16-923d-534b2e2a8a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:23.917334 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72caa86-7102-4f16-923d-534b2e2a8a8c None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:23.917612 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72caa86-7102-4f16-923d-534b2e2a8a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:23.917886 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72caa86-7102-4f16-923d-534b2e2a8a8c None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:23.918656 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72caa86-7102-4f16-923d-534b2e2a8a8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:23.918959 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72caa86-7102-4f16-923d-534b2e2a8a8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:23.920559 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72caa86-7102-4f16-923d-534b2e2a8a8c None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:23.929610 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 228/447] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:13:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:23.936721 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72caa86-7102-4f16-923d-534b2e2a8a8c None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:23.977615 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 220/448] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:13:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 01 04:13:23.983028 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6005911-3504-4422-911c-40604cbd5fc2 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:23.992769 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:24.038595 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72caa86-7102-4f16-923d-534b2e2a8a8c None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:24.040100 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:24.073706 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22001a3-f517-4d4e-bf80-2ac702b1ad85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:24.074386 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22001a3-f517-4d4e-bf80-2ac702b1ad85 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:24.074667 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22001a3-f517-4d4e-bf80-2ac702b1ad85 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:24.074944 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22001a3-f517-4d4e-bf80-2ac702b1ad85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:24.080692 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6005911-3504-4422-911c-40604cbd5fc2 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:24.114528 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80014120-3697-4a60-9200-d1632275833a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:24.115374 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80014120-3697-4a60-9200-d1632275833a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:24.115663 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80014120-3697-4a60-9200-d1632275833a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:24.116551 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80014120-3697-4a60-9200-d1632275833a None admin] PATH_INFO: `/v3/projects/047a5e1b44994e5690d32519e9f95eff` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:24.117743 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80014120-3697-4a60-9200-d1632275833a None admin] RBAC: Authorizing `identity:get_project(project_id=047a5e1b44994e5690d32519e9f95eff)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:24.119219 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80014120-3697-4a60-9200-d1632275833a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:24.120913 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 221/449] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:13:23 2022] GET /identity/v3/projects/047a5e1b44994e5690d32519e9f95eff => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:13:24.126175 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80014120-3697-4a60-9200-d1632275833a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:24.141750 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22001a3-f517-4d4e-bf80-2ac702b1ad85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:24.143283 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22001a3-f517-4d4e-bf80-2ac702b1ad85 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:24.205222 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:24.228050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80014120-3697-4a60-9200-d1632275833a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:24.242458 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 229/450] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:13:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 01 04:13:24.247906 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22001a3-f517-4d4e-bf80-2ac702b1ad85 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:24.249873 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:24.262168 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152abe1-9da4-4cee-b882-91c13293820b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:24.263021 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152abe1-9da4-4cee-b882-91c13293820b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:24.263304 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152abe1-9da4-4cee-b882-91c13293820b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:24.263584 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152abe1-9da4-4cee-b882-91c13293820b None admin] PATH_INFO: `/v3/groups/b8c50852cd364f6d8b2cc2f364abef8a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:24.264759 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152abe1-9da4-4cee-b882-91c13293820b None admin] RBAC: Authorizing `identity:get_group(group_id=b8c50852cd364f6d8b2cc2f364abef8a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:24.266227 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152abe1-9da4-4cee-b882-91c13293820b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:24.267844 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 222/451] 10.222.0.32 () {56 vars in 1180 bytes} [Wed Jun 1 04:13:24 2022] GET /identity/v3/groups/b8c50852cd364f6d8b2cc2f364abef8a => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:13:24.273440 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152abe1-9da4-4cee-b882-91c13293820b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:24.348571 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22001a3-f517-4d4e-bf80-2ac702b1ad85 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:24.372816 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152abe1-9da4-4cee-b882-91c13293820b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:24.384813 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a535021-fe53-4a7b-bc78-ebec24e2a654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:24.385696 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a535021-fe53-4a7b-bc78-ebec24e2a654 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:24.386001 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a535021-fe53-4a7b-bc78-ebec24e2a654 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:24.386288 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a535021-fe53-4a7b-bc78-ebec24e2a654 None admin] PATH_INFO: `/v3/projects/7aa99b52f0384814a1f8896bb995a2b2` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:24.387569 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a535021-fe53-4a7b-bc78-ebec24e2a654 None admin] RBAC: Authorizing `identity:get_project(project_id=7aa99b52f0384814a1f8896bb995a2b2)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:24.389073 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a535021-fe53-4a7b-bc78-ebec24e2a654 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:24.390854 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 230/452] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:13:24 2022] GET /identity/v3/projects/7aa99b52f0384814a1f8896bb995a2b2 => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:24.396475 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a535021-fe53-4a7b-bc78-ebec24e2a654 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:24.410894 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48083f83-1b83-467d-a09c-924d84f2ae51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:24.411559 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48083f83-1b83-467d-a09c-924d84f2ae51 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:24.411841 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48083f83-1b83-467d-a09c-924d84f2ae51 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:24.412115 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48083f83-1b83-467d-a09c-924d84f2ae51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:24.413496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48083f83-1b83-467d-a09c-924d84f2ae51 None admin] RBAC: Adding query filter params (group.id=b8c50852cd364f6d8b2cc2f364abef8a, role.id=71e70e8fe1344699a131764a348d51d6, scope.project.id=047a5e1b44994e5690d32519e9f95eff) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:24.413806 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48083f83-1b83-467d-a09c-924d84f2ae51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:24.415298 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48083f83-1b83-467d-a09c-924d84f2ae51 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:24.421620 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 223/453] 10.222.0.32 () {56 vars in 1376 bytes} [Wed Jun 1 04:13:24 2022] GET /identity/v3/role_assignments?group.id=b8c50852cd364f6d8b2cc2f364abef8a&scope.project.id=047a5e1b44994e5690d32519e9f95eff&role.id=71e70e8fe1344699a131764a348d51d6 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:13:24.477095 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:24.510294 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a535021-fe53-4a7b-bc78-ebec24e2a654 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:24.547119 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309a0c0-0516-44de-bf1b-f7ff8a3b0eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:24.547990 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309a0c0-0516-44de-bf1b-f7ff8a3b0eca None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:24.548268 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309a0c0-0516-44de-bf1b-f7ff8a3b0eca None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:24.548539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309a0c0-0516-44de-bf1b-f7ff8a3b0eca None admin] PATH_INFO: `/v3/groups/44e161c50e1c4fe8b3332c124e78deec` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:24.549747 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309a0c0-0516-44de-bf1b-f7ff8a3b0eca None admin] RBAC: Authorizing `identity:get_group(group_id=44e161c50e1c4fe8b3332c124e78deec)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:24.551241 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309a0c0-0516-44de-bf1b-f7ff8a3b0eca None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:24.552901 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 231/454] 10.222.0.32 () {56 vars in 1180 bytes} [Wed Jun 1 04:13:24 2022] GET /identity/v3/groups/44e161c50e1c4fe8b3332c124e78deec => generated 229 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:13:24.558976 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48083f83-1b83-467d-a09c-924d84f2ae51 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:24.571044 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:24.661744 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48083f83-1b83-467d-a09c-924d84f2ae51 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:24.696683 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df878fca-e315-4826-adc8-13fd9ccf3d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:24.697346 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df878fca-e315-4826-adc8-13fd9ccf3d2c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:24.697635 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df878fca-e315-4826-adc8-13fd9ccf3d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:24.697914 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df878fca-e315-4826-adc8-13fd9ccf3d2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:24.698800 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df878fca-e315-4826-adc8-13fd9ccf3d2c None admin] RBAC: Adding query filter params (group.id=44e161c50e1c4fe8b3332c124e78deec, role.id=76fc054ad9544460a7be1e2010c23642, scope.project.id=7aa99b52f0384814a1f8896bb995a2b2) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:24.699110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df878fca-e315-4826-adc8-13fd9ccf3d2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:24.700549 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df878fca-e315-4826-adc8-13fd9ccf3d2c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:24.706627 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 224/455] 10.222.0.32 () {56 vars in 1376 bytes} [Wed Jun 1 04:13:24 2022] GET /identity/v3/role_assignments?group.id=44e161c50e1c4fe8b3332c124e78deec&scope.project.id=7aa99b52f0384814a1f8896bb995a2b2&role.id=76fc054ad9544460a7be1e2010c23642 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:13:27.426043 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c64f3-8a27-4a61-999a-cb40c3401623 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:27.426508 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c64f3-8a27-4a61-999a-cb40c3401623 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:27.426508 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c64f3-8a27-4a61-999a-cb40c3401623 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:27.428239 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 232/456] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:27.443854 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2577210-c383-434c-b468-74bd8ca3a440 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:27.444361 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2577210-c383-434c-b468-74bd8ca3a440 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:27.444437 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2577210-c383-434c-b468-74bd8ca3a440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:27.471045 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d2577210-c383-434c-b468-74bd8ca3a440 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:27.472312 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d2577210-c383-434c-b468-74bd8ca3a440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:27.560299 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 225/457] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:13:27.596683 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c64f3-8a27-4a61-999a-cb40c3401623 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:27.722533 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08ba0a-4f86-494f-8da6-21c069187a0f None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:27.723159 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08ba0a-4f86-494f-8da6-21c069187a0f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:27.723652 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08ba0a-4f86-494f-8da6-21c069187a0f None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:27.726670 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 226/458] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:27.731355 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4089889-2d45-4f03-b87a-07edfe6f9382 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:27.731918 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4089889-2d45-4f03-b87a-07edfe6f9382 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:27.732401 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4089889-2d45-4f03-b87a-07edfe6f9382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:27.742548 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:27.760240 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c64f3-8a27-4a61-999a-cb40c3401623 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:27.768552 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c4089889-2d45-4f03-b87a-07edfe6f9382 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:27.773160 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c4089889-2d45-4f03-b87a-07edfe6f9382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:27.826393 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c5745-2fef-4596-a643-863afb844b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:27.827907 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c5745-2fef-4596-a643-863afb844b6c None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:27.828276 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c5745-2fef-4596-a643-863afb844b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:27.828626 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c5745-2fef-4596-a643-863afb844b6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:27.838147 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:27.843391 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c5745-2fef-4596-a643-863afb844b6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:27.846032 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c5745-2fef-4596-a643-863afb844b6c None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:27.867456 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-047c5745-2fef-4596-a643-863afb844b6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:27.867456 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:27.867456 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:27.867456 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:27.867456 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:27.867456 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:27.867456 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:27.867456 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:27.867456 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:27.867456 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:27.867456 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:27.867456 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:27.867456 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:13:27.867456 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:13:27.867456 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:13:27.868357 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:13:27.868357 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:27.868357 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:27.868357 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:27.868357 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:27.868357 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:27.868357 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:27.868357 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:27.868357 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:27.868357 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:27.868357 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:27.868357 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:27.868357 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:27.868357 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:27.868357 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:27.868357 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:27.868357 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:27.869226 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:13:27.869226 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:13:27.869226 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:27.869226 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:27.871589 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 233/459] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:27.873077 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dc9b1-f159-44ac-9d15-666b931e66cd None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:27.873534 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dc9b1-f159-44ac-9d15-666b931e66cd None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:27.874018 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dc9b1-f159-44ac-9d15-666b931e66cd None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:27.875730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 234/460] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:27.877065 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 227/461] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:13:27.881865 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5dc9b1-f159-44ac-9d15-666b931e66cd None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:27.885591 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7cb0d-23e7-43ab-a67d-ae84cdf940c2 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:27.886784 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7cb0d-23e7-43ab-a67d-ae84cdf940c2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:27.886784 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7cb0d-23e7-43ab-a67d-ae84cdf940c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:27.904287 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-75b7cb0d-23e7-43ab-a67d-ae84cdf940c2 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:27.905480 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-75b7cb0d-23e7-43ab-a67d-ae84cdf940c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:27.986185 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 228/462] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 04:13:27.987098 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7cb0d-23e7-43ab-a67d-ae84cdf940c2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:27.997886 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5dc9b1-f159-44ac-9d15-666b931e66cd None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:28.036341 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dcbe27-b4ac-47ec-a848-80ef4a2c4565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:28.037937 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dcbe27-b4ac-47ec-a848-80ef4a2c4565 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:28.038464 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dcbe27-b4ac-47ec-a848-80ef4a2c4565 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:28.038954 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dcbe27-b4ac-47ec-a848-80ef4a2c4565 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:28.039858 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dcbe27-b4ac-47ec-a848-80ef4a2c4565 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:28.040364 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dcbe27-b4ac-47ec-a848-80ef4a2c4565 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:28.042066 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dcbe27-b4ac-47ec-a848-80ef4a2c4565 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:28.061863 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 235/463] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:13:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:28.063116 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dcbe27-b4ac-47ec-a848-80ef4a2c4565 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:28.079594 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:28.130880 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7cb0d-23e7-43ab-a67d-ae84cdf940c2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:28.136849 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:28.176667 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ada64f-4c7b-4c58-8687-83a39275986c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:28.177468 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ada64f-4c7b-4c58-8687-83a39275986c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:28.177750 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ada64f-4c7b-4c58-8687-83a39275986c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:28.178098 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ada64f-4c7b-4c58-8687-83a39275986c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:28.189530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ada64f-4c7b-4c58-8687-83a39275986c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:28.191143 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ada64f-4c7b-4c58-8687-83a39275986c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:28.191912 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dcbe27-b4ac-47ec-a848-80ef4a2c4565 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:28.209955 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-80ada64f-4c7b-4c58-8687-83a39275986c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:28.209955 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:28.209955 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:28.209955 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:28.209955 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:28.209955 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:28.209955 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:28.209955 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:28.209955 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:28.209955 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:28.209955 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:28.209955 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:28.209955 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:13:28.209955 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:13:28.209955 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:13:28.210857 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:13:28.210857 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:28.210857 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:28.210857 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:28.210857 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:28.210857 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:28.210857 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:28.210857 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:28.210857 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:28.210857 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:28.210857 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:28.210857 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:28.210857 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:28.210857 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:28.210857 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:28.210857 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:28.210857 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:28.211678 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:13:28.211678 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:13:28.211678 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:28.211678 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:28.211678 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 229/464] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:28.212842 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ada64f-4c7b-4c58-8687-83a39275986c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:28.234666 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e0a76-ddae-468c-a1b0-d607bb4b36b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:28.235460 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e0a76-ddae-468c-a1b0-d607bb4b36b9 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:28.235747 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e0a76-ddae-468c-a1b0-d607bb4b36b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:28.236529 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e0a76-ddae-468c-a1b0-d607bb4b36b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:28.247574 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e0a76-ddae-468c-a1b0-d607bb4b36b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:28.249041 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e0a76-ddae-468c-a1b0-d607bb4b36b9 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:28.268378 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-0c6e0a76-ddae-468c-a1b0-d607bb4b36b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:28.268378 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:28.268378 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:28.268378 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:28.268378 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:28.268378 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:28.268378 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:28.268378 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:28.268378 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:28.268378 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:28.268378 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:28.268378 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:28.268378 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:13:28.268378 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:13:28.268378 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:13:28.269262 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:13:28.269262 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:28.269262 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:28.269262 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:28.269262 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:28.269262 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:28.269262 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:28.269262 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:28.269262 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:28.269262 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:28.269262 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:28.269262 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:28.269262 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:28.269262 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:28.269262 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:28.269262 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:28.269262 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:28.270130 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:13:28.270130 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:13:28.270130 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:28.270130 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:28.270130 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 236/465] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:28.271246 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0d5c5-c517-4566-8698-293632ceba7e None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:28.271246 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0d5c5-c517-4566-8698-293632ceba7e None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:28.271514 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0d5c5-c517-4566-8698-293632ceba7e None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:28.273393 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 237/466] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:28.274775 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0d5c5-c517-4566-8698-293632ceba7e None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:28.328134 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ada64f-4c7b-4c58-8687-83a39275986c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:28.346017 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:28.369375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2778b1e-27af-4cb6-bb8c-616dde19266e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:28.370499 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2778b1e-27af-4cb6-bb8c-616dde19266e None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:28.370988 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2778b1e-27af-4cb6-bb8c-616dde19266e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:28.371494 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2778b1e-27af-4cb6-bb8c-616dde19266e None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:28.372528 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2778b1e-27af-4cb6-bb8c-616dde19266e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:28.374291 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2778b1e-27af-4cb6-bb8c-616dde19266e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:28.398935 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 230/467] 10.222.0.32 () {60 vars in 1132 bytes} [Wed Jun 1 04:13:28 2022] POST /identity/v3/users => generated 248 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:13:28.400222 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2778b1e-27af-4cb6-bb8c-616dde19266e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:28.533611 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2778b1e-27af-4cb6-bb8c-616dde19266e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:28.547355 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0d5c5-c517-4566-8698-293632ceba7e None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:28.549419 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:28.576348 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370baae3-c0e1-497e-af9a-4e6e1dffa4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:28.577398 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370baae3-c0e1-497e-af9a-4e6e1dffa4d8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:28.577933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370baae3-c0e1-497e-af9a-4e6e1dffa4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:28.579029 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370baae3-c0e1-497e-af9a-4e6e1dffa4d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:28.580455 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370baae3-c0e1-497e-af9a-4e6e1dffa4d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:28.581003 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370baae3-c0e1-497e-af9a-4e6e1dffa4d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:28.583365 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370baae3-c0e1-497e-af9a-4e6e1dffa4d8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:28.596702 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7414f-6a85-434b-926a-8baf9d1bc44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:28.597494 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7414f-6a85-434b-926a-8baf9d1bc44f None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:28.598053 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7414f-6a85-434b-926a-8baf9d1bc44f None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:28.598498 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7414f-6a85-434b-926a-8baf9d1bc44f None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:28.599305 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d7414f-6a85-434b-926a-8baf9d1bc44f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:28.599704 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d7414f-6a85-434b-926a-8baf9d1bc44f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:28.601704 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d7414f-6a85-434b-926a-8baf9d1bc44f None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:28.601909 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 231/468] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:28.603500 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a7a7e-4e2d-487a-a536-6c52c3fc87ff None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:28.604223 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a7a7e-4e2d-487a-a536-6c52c3fc87ff None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:28.604679 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a7a7e-4e2d-487a-a536-6c52c3fc87ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:28.616942 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 238/469] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:28.621600 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7414f-6a85-434b-926a-8baf9d1bc44f None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:28.633672 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-062a7a7e-4e2d-487a-a536-6c52c3fc87ff None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:28.635774 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-062a7a7e-4e2d-487a-a536-6c52c3fc87ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:28.664008 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:28.721180 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 232/470] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:13:28.721180 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a7a7e-4e2d-487a-a536-6c52c3fc87ff None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:28.763259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7414f-6a85-434b-926a-8baf9d1bc44f None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:28.808070 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35a652-39f4-4598-a801-095fa43c948c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:28.808948 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35a652-39f4-4598-a801-095fa43c948c None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:28.809240 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35a652-39f4-4598-a801-095fa43c948c None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:28.809526 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35a652-39f4-4598-a801-095fa43c948c None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:28.810434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35a652-39f4-4598-a801-095fa43c948c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:28.812554 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35a652-39f4-4598-a801-095fa43c948c None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:28.831160 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a7a7e-4e2d-487a-a536-6c52c3fc87ff None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:28.845937 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 239/471] 10.222.0.32 () {60 vars in 1132 bytes} [Wed Jun 1 04:13:28 2022] POST /identity/v3/users => generated 246 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:13:28.846852 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35a652-39f4-4598-a801-095fa43c948c None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:28.870334 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:28.872502 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73d927-0b2e-4aed-9ef5-b7e46bfaa5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:28.873512 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73d927-0b2e-4aed-9ef5-b7e46bfaa5ad None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:28.874008 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73d927-0b2e-4aed-9ef5-b7e46bfaa5ad None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:28.874401 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73d927-0b2e-4aed-9ef5-b7e46bfaa5ad None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:28.876035 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73d927-0b2e-4aed-9ef5-b7e46bfaa5ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:28.877217 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73d927-0b2e-4aed-9ef5-b7e46bfaa5ad None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:28.914451 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 233/472] 10.222.0.32 () {60 vars in 1132 bytes} [Wed Jun 1 04:13:28 2022] POST /identity/v3/users => generated 248 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:13:28.916373 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a8887-7584-483c-a731-b7fb077aead0 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:28.916778 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a8887-7584-483c-a731-b7fb077aead0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:28.917211 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a8887-7584-483c-a731-b7fb077aead0 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:28.919160 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 234/473] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:28.924926 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4541595-16af-4b7f-bfe1-339190420261 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:28.925340 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4541595-16af-4b7f-bfe1-339190420261 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:28.925724 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4541595-16af-4b7f-bfe1-339190420261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:28.963599 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e4541595-16af-4b7f-bfe1-339190420261 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:28.965057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e4541595-16af-4b7f-bfe1-339190420261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:28.985522 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35a652-39f4-4598-a801-095fa43c948c None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:29.005468 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:29.051627 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 235/474] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 04:13:29.058413 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede1e58-383a-4a26-9751-e8b433549238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:29.059165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede1e58-383a-4a26-9751-e8b433549238 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:29.059455 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede1e58-383a-4a26-9751-e8b433549238 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:29.059739 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede1e58-383a-4a26-9751-e8b433549238 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:29.073086 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede1e58-383a-4a26-9751-e8b433549238 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:29.074675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede1e58-383a-4a26-9751-e8b433549238 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:29.095554 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4541595-16af-4b7f-bfe1-339190420261 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:29.095751 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-8ede1e58-383a-4a26-9751-e8b433549238 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:29.095751 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:29.095751 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:29.095751 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:29.095751 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:29.095751 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:29.095751 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:29.095751 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:29.095751 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:29.095751 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:29.095751 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:29.095751 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:29.095751 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:13:29.095751 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:13:29.095751 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:13:29.096538 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:13:29.096538 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:29.096538 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:29.096538 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:29.096538 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:29.096538 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:29.096538 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:29.096538 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:29.096538 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:29.096538 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:29.096538 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:29.096538 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:29.096538 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:29.096538 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:29.096538 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:29.096538 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:29.096538 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:29.097352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:13:29.097352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:13:29.097352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:29.097352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:29.097352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 240/475] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:29.102684 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede1e58-383a-4a26-9751-e8b433549238 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:29.191160 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:29.233401 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede1e58-383a-4a26-9751-e8b433549238 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:29.246414 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4541595-16af-4b7f-bfe1-339190420261 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:29.280696 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2c76f-eaf9-4f4d-b00d-24a0921d57b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:29.281359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2c76f-eaf9-4f4d-b00d-24a0921d57b8 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:29.281644 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2c76f-eaf9-4f4d-b00d-24a0921d57b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:29.281921 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2c76f-eaf9-4f4d-b00d-24a0921d57b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:29.282678 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb2c76f-eaf9-4f4d-b00d-24a0921d57b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:29.282988 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb2c76f-eaf9-4f4d-b00d-24a0921d57b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:29.284446 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb2c76f-eaf9-4f4d-b00d-24a0921d57b8 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:29.293367 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10bdf1-724b-4c85-9a70-40e34f30f3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:29.294081 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10bdf1-724b-4c85-9a70-40e34f30f3eb None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:29.294669 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10bdf1-724b-4c85-9a70-40e34f30f3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:29.294669 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10bdf1-724b-4c85-9a70-40e34f30f3eb None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:29.295351 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b10bdf1-724b-4c85-9a70-40e34f30f3eb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:29.296757 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b10bdf1-724b-4c85-9a70-40e34f30f3eb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:29.298060 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 241/476] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:13:29.305473 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2c76f-eaf9-4f4d-b00d-24a0921d57b8 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:29.306971 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.sql.core [None req-6b10bdf1-724b-4c85-9a70-40e34f30f3eb None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 01 04:13:29.306971 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 01 04:13:29.306971 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [parameters: {'id': 'e638b9914c52492d9fbb07eb1cfd12c5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 01 04:13:29.306971 dv-cinder-667108-37-smb devstack@keystone.service[80231]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80231) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 01 04:13:29.324707 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-6b10bdf1-724b-4c85-9a70-40e34f30f3eb None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 01 04:13:29.324707 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:29.324707 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 01 04:13:29.324707 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 01 04:13:29.324707 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 01 04:13:29.324707 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 01 04:13:29.324707 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 01 04:13:29.324707 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result = self._query(query) Jun 01 04:13:29.324707 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 01 04:13:29.324707 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application conn.query(q) Jun 01 04:13:29.324707 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 01 04:13:29.324707 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 01 04:13:29.324707 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 01 04:13:29.324707 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result.read() Jun 01 04:13:29.324707 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 01 04:13:29.325613 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 01 04:13:29.325613 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 01 04:13:29.325613 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 01 04:13:29.325613 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 01 04:13:29.325613 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 01 04:13:29.325613 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 01 04:13:29.325613 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 01 04:13:29.325613 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 01 04:13:29.325613 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:29.325613 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 01 04:13:29.325613 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:29.325613 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:29.325613 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 01 04:13:29.325613 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 01 04:13:29.325613 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 01 04:13:29.325613 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return ref.to_dict() Jun 01 04:13:29.325613 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 01 04:13:29.325613 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application next(self.gen) Jun 01 04:13:29.326541 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 01 04:13:29.326541 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application yield resource Jun 01 04:13:29.326541 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 01 04:13:29.326541 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application next(self.gen) Jun 01 04:13:29.326541 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 01 04:13:29.326541 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.session.rollback() Jun 01 04:13:29.326541 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 01 04:13:29.326541 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.force_reraise() Jun 01 04:13:29.326541 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 01 04:13:29.326541 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise self.value Jun 01 04:13:29.326541 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 01 04:13:29.326541 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 01 04:13:29.326541 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 01 04:13:29.326541 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application session.commit() Jun 01 04:13:29.326541 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 01 04:13:29.326541 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 01 04:13:29.326541 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 01 04:13:29.327382 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._prepare_impl() Jun 01 04:13:29.327382 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 01 04:13:29.327382 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.session.flush() Jun 01 04:13:29.327382 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 01 04:13:29.327382 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._flush(objects) Jun 01 04:13:29.327382 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 01 04:13:29.327382 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 01 04:13:29.327382 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 01 04:13:29.327382 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application compat.raise_( Jun 01 04:13:29.327382 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 01 04:13:29.327382 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception Jun 01 04:13:29.327382 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 01 04:13:29.327382 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application flush_context.execute() Jun 01 04:13:29.327382 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 01 04:13:29.327382 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rec.execute(self) Jun 01 04:13:29.327382 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 01 04:13:29.327382 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 01 04:13:29.328241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 01 04:13:29.328241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 01 04:13:29.328241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 01 04:13:29.328241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 01 04:13:29.328241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 01 04:13:29.328241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 01 04:13:29.328241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 01 04:13:29.328241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 01 04:13:29.328241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 01 04:13:29.328241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 01 04:13:29.328241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 01 04:13:29.328241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 01 04:13:29.328241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 01 04:13:29.328241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 01 04:13:29.328241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 01 04:13:29.328241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception Jun 01 04:13:29.329037 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 01 04:13:29.329037 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 01 04:13:29.329037 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 01 04:13:29.329037 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 01 04:13:29.329037 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 01 04:13:29.329037 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result = self._query(query) Jun 01 04:13:29.329037 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 01 04:13:29.329037 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application conn.query(q) Jun 01 04:13:29.329037 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 01 04:13:29.329037 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 01 04:13:29.329037 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 01 04:13:29.329037 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result.read() Jun 01 04:13:29.329037 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 01 04:13:29.329037 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 01 04:13:29.329037 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 01 04:13:29.329037 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 01 04:13:29.329791 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 01 04:13:29.329791 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 01 04:13:29.329791 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 01 04:13:29.329791 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 01 04:13:29.329791 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 01 04:13:29.329791 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 01 04:13:29.329791 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [parameters: {'id': 'e638b9914c52492d9fbb07eb1cfd12c5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 01 04:13:29.329791 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 01 04:13:29.329791 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:29.329791 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 04:13:29.329791 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:29.329791 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:29.329791 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:29.329791 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:29.329791 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:29.329791 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:29.330683 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:29.330683 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:29.330683 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:29.330683 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:29.330683 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:29.330683 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:29.330683 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 01 04:13:29.330683 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 01 04:13:29.330683 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:29.330683 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:29.330683 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 01 04:13:29.330683 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 01 04:13:29.330683 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 01 04:13:29.330683 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 01 04:13:29.330683 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 01 04:13:29.330683 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:29.333472 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 236/477] 10.222.0.32 () {60 vars in 1131 bytes} [Wed Jun 1 04:13:29 2022] POST /identity/v3/roles => generated 144 bytes in 239 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:29.339552 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10bdf1-724b-4c85-9a70-40e34f30f3eb None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:29.358384 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:29.425935 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2c76f-eaf9-4f4d-b00d-24a0921d57b8 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:29.458845 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:29.464823 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10bdf1-724b-4c85-9a70-40e34f30f3eb None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:29.465520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590348c7-dc36-4966-9c36-198c94885caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:29.466235 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590348c7-dc36-4966-9c36-198c94885caf None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:29.466522 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590348c7-dc36-4966-9c36-198c94885caf None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:29.466795 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590348c7-dc36-4966-9c36-198c94885caf None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:29.467492 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590348c7-dc36-4966-9c36-198c94885caf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:29.469546 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590348c7-dc36-4966-9c36-198c94885caf None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:29.494581 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 242/478] 10.222.0.32 () {60 vars in 1132 bytes} [Wed Jun 1 04:13:29 2022] POST /identity/v3/users => generated 249 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:13:29.512523 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd25a9b-6ec9-44db-952a-8ecef1f0cb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:29.513802 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd25a9b-6ec9-44db-952a-8ecef1f0cb1d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:29.514327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd25a9b-6ec9-44db-952a-8ecef1f0cb1d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:29.514745 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd25a9b-6ec9-44db-952a-8ecef1f0cb1d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:29.527874 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd25a9b-6ec9-44db-952a-8ecef1f0cb1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:29.536680 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-1dd25a9b-6ec9-44db-952a-8ecef1f0cb1d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 04:13:29.536680 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:29.536680 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:29.536680 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:29.536680 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:29.536680 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:29.536680 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:29.536680 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:29.536680 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:29.536680 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:29.536680 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:29.536680 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:29.536680 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:29.536680 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:29.536680 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:29.536680 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:29.538889 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:29.538889 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:29.538889 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:29.538889 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:29.538889 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:29.538889 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:29.538889 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:29.538889 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:29.538889 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:29.538889 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:29.538889 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:29.538889 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:29.538889 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:29.538889 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:29.538889 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:29.538889 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:29.539871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:29.539871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:29.539871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:29.539871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:29.539871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:29.539871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:29.539871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:29.539871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:29.539871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:29.539871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:29.539871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 04:13:29.539871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:29.542776 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 237/479] 10.222.0.32 () {56 vars in 1114 bytes} [Wed Jun 1 04:13:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:29.550023 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590348c7-dc36-4966-9c36-198c94885caf None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:29.658727 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590348c7-dc36-4966-9c36-198c94885caf None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:29.700405 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f78a2-b1dc-4b71-a556-e4c5f3a22f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:29.701280 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f78a2-b1dc-4b71-a556-e4c5f3a22f1d None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:29.701667 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f78a2-b1dc-4b71-a556-e4c5f3a22f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:29.702074 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f78a2-b1dc-4b71-a556-e4c5f3a22f1d None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:29.702949 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f78a2-b1dc-4b71-a556-e4c5f3a22f1d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:29.703361 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f78a2-b1dc-4b71-a556-e4c5f3a22f1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:29.704872 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f78a2-b1dc-4b71-a556-e4c5f3a22f1d None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:29.715366 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 243/480] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:13:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:31.240438 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6de3c7-ef39-4bd3-9103-33f13f847eb4 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:31.240954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6de3c7-ef39-4bd3-9103-33f13f847eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:31.241037 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6de3c7-ef39-4bd3-9103-33f13f847eb4 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:31.242399 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 238/481] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:31.247892 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776d7b9-9a32-4b82-89ba-2caeaeaba809 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:31.248337 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776d7b9-9a32-4b82-89ba-2caeaeaba809 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:31.248429 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776d7b9-9a32-4b82-89ba-2caeaeaba809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:31.265935 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-2776d7b9-9a32-4b82-89ba-2caeaeaba809 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:31.267164 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-2776d7b9-9a32-4b82-89ba-2caeaeaba809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:31.316153 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:31.345584 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 244/482] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:13:31.383463 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6de3c7-ef39-4bd3-9103-33f13f847eb4 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:31.475431 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:31.509177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6de3c7-ef39-4bd3-9103-33f13f847eb4 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:31.545455 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f9844-1aa1-4c4c-9467-df59c5704a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:31.546322 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f9844-1aa1-4c4c-9467-df59c5704a3e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:31.546609 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f9844-1aa1-4c4c-9467-df59c5704a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:31.546889 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f9844-1aa1-4c4c-9467-df59c5704a3e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:31.558923 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f9844-1aa1-4c4c-9467-df59c5704a3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:31.566808 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-af5f9844-1aa1-4c4c-9467-df59c5704a3e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:13:31.566808 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:31.566808 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:31.566808 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:31.566808 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:31.566808 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:31.566808 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:31.566808 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:31.566808 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:31.566808 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:31.566808 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:31.566808 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:31.566808 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:31.566808 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:31.566808 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:31.566808 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:31.569838 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:31.569838 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:31.569838 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:31.569838 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:31.569838 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:31.569838 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:31.569838 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:31.569838 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:31.569838 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:31.569838 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:31.569838 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:31.569838 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:31.569838 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:31.569838 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:31.569838 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:31.569838 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:31.571910 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:31.571910 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:31.571910 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:31.571910 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:31.571910 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:31.571910 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:31.571910 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:31.571910 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:31.571910 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:31.571910 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:31.571910 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:13:31.571910 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:31.571910 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 239/483] 10.222.0.32 () {56 vars in 1102 bytes} [Wed Jun 1 04:13:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:31.579507 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776d7b9-9a32-4b82-89ba-2caeaeaba809 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:31.696569 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776d7b9-9a32-4b82-89ba-2caeaeaba809 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:31.737552 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93276318-5baf-45a5-bee1-4eb97ab7b058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:31.738158 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93276318-5baf-45a5-bee1-4eb97ab7b058 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:31.738447 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93276318-5baf-45a5-bee1-4eb97ab7b058 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:31.738729 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93276318-5baf-45a5-bee1-4eb97ab7b058 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:31.739478 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93276318-5baf-45a5-bee1-4eb97ab7b058 None admin] RBAC: Adding query filter params (name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:31.739790 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93276318-5baf-45a5-bee1-4eb97ab7b058 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:31.741207 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93276318-5baf-45a5-bee1-4eb97ab7b058 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:31.749892 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 245/484] 10.222.0.32 () {56 vars in 1103 bytes} [Wed Jun 1 04:13:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:31.755659 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f9844-1aa1-4c4c-9467-df59c5704a3e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:31.855947 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa882f7b-1fcc-46fd-a603-a02b030b114b None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:31.856287 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa882f7b-1fcc-46fd-a603-a02b030b114b None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:31.856589 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa882f7b-1fcc-46fd-a603-a02b030b114b None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:31.858829 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 246/485] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:13:31.867879 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d724a1-8f15-41ad-b483-34d0695c9523 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:31.868769 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d724a1-8f15-41ad-b483-34d0695c9523 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:31.869286 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d724a1-8f15-41ad-b483-34d0695c9523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:31.884297 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f9844-1aa1-4c4c-9467-df59c5704a3e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:31.897781 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-d8d724a1-8f15-41ad-b483-34d0695c9523 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:31.899360 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d8d724a1-8f15-41ad-b483-34d0695c9523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:31.934591 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:31.942768 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:31.947220 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0458c-51d0-4277-b6f1-74f4dac4167b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:31.950940 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0458c-51d0-4277-b6f1-74f4dac4167b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:31.951443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0458c-51d0-4277-b6f1-74f4dac4167b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:31.951895 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0458c-51d0-4277-b6f1-74f4dac4167b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:31.978230 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc0458c-51d0-4277-b6f1-74f4dac4167b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:31.980059 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc0458c-51d0-4277-b6f1-74f4dac4167b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:31.998012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 247/486] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 04:13:31.999694 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077e803-29b1-433c-831b-c45d1ec1b3fb None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:32.000165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077e803-29b1-433c-831b-c45d1ec1b3fb None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:32.000617 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077e803-29b1-433c-831b-c45d1ec1b3fb None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:32.002347 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 248/487] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:32.006094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-efc0458c-51d0-4277-b6f1-74f4dac4167b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:32.006094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:32.006094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:32.006094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:32.006094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:32.006094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:32.006094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:32.006094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:32.006094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:32.006094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:32.006094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:32.006094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:32.006094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:13:32.006094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:13:32.006094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:13:32.006936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:13:32.006936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:32.006936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:32.006936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:32.006936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:32.006936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:32.006936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:32.006936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:32.006936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:32.006936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:32.006936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:32.006936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:32.006936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:32.006936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:32.006936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:32.006936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:32.006936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:32.007852 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:13:32.007852 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:13:32.007852 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:32.007852 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:32.007852 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 240/488] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:32.014017 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0458c-51d0-4277-b6f1-74f4dac4167b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:32.014677 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53178c-219c-49bc-b7e9-9f5a1fbe2ccd None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:32.015065 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53178c-219c-49bc-b7e9-9f5a1fbe2ccd None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:32.015484 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53178c-219c-49bc-b7e9-9f5a1fbe2ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:32.039452 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-7b53178c-219c-49bc-b7e9-9f5a1fbe2ccd None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:32.040815 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7b53178c-219c-49bc-b7e9-9f5a1fbe2ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:32.132781 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0458c-51d0-4277-b6f1-74f4dac4167b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:32.133774 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 249/489] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:13:32.138348 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53178c-219c-49bc-b7e9-9f5a1fbe2ccd None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:32.191648 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c511db1-75eb-4e29-adec-b24a99175163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:32.192789 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c511db1-75eb-4e29-adec-b24a99175163 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:32.194270 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c511db1-75eb-4e29-adec-b24a99175163 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:32.194572 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c511db1-75eb-4e29-adec-b24a99175163 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:32.195325 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c511db1-75eb-4e29-adec-b24a99175163 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:32.195638 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c511db1-75eb-4e29-adec-b24a99175163 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:32.197027 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c511db1-75eb-4e29-adec-b24a99175163 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:32.213243 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 241/490] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:32.214189 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c511db1-75eb-4e29-adec-b24a99175163 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:32.263592 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:32.268910 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:32.275340 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53178c-219c-49bc-b7e9-9f5a1fbe2ccd None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:32.316093 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843f6bf-dd18-41e9-933a-a7527a260c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:32.317406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843f6bf-dd18-41e9-933a-a7527a260c6e None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:32.317946 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843f6bf-dd18-41e9-933a-a7527a260c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:32.319249 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843f6bf-dd18-41e9-933a-a7527a260c6e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:32.332085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c511db1-75eb-4e29-adec-b24a99175163 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:32.332782 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843f6bf-dd18-41e9-933a-a7527a260c6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:32.341852 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-4843f6bf-dd18-41e9-933a-a7527a260c6e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:13:32.341852 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:32.341852 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:32.341852 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:32.341852 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:32.341852 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:32.341852 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:32.341852 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:32.341852 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:32.341852 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:32.341852 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:32.341852 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:32.341852 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:32.341852 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:32.341852 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:32.341852 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:32.342845 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:32.342845 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:32.342845 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:32.342845 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:32.342845 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:32.342845 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:32.342845 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:32.342845 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:32.342845 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:32.342845 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:32.342845 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:32.342845 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:32.342845 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:32.342845 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:32.342845 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:32.342845 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:32.343648 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:32.343648 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:32.343648 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:32.343648 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:32.343648 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:32.343648 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:32.343648 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:32.343648 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:32.343648 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:32.343648 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:32.343648 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:13:32.343648 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:32.346184 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 250/491] 10.222.0.32 () {56 vars in 1102 bytes} [Wed Jun 1 04:13:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:32.347184 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843f6bf-dd18-41e9-933a-a7527a260c6e None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:32.370177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e6456-3715-4a23-9749-45759752dbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:32.371013 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e6456-3715-4a23-9749-45759752dbbc None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:32.371293 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e6456-3715-4a23-9749-45759752dbbc None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:32.372027 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e6456-3715-4a23-9749-45759752dbbc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:32.383574 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e6456-3715-4a23-9749-45759752dbbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:32.391802 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-e98e6456-3715-4a23-9749-45759752dbbc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:13:32.391802 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:32.391802 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:32.391802 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:32.391802 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:32.391802 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:32.391802 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:32.391802 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:32.391802 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:32.391802 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:32.391802 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:32.391802 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:32.391802 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:32.391802 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:32.391802 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:32.391802 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:32.392731 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:32.392731 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:32.392731 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:32.392731 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:32.392731 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:32.392731 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:32.392731 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:32.392731 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:32.392731 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:32.392731 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:32.392731 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:32.392731 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:32.392731 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:32.392731 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:32.392731 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:32.392731 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:32.393512 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:32.393512 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:32.393512 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:32.393512 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:32.393512 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:32.393512 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:32.393512 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:32.393512 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:32.393512 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:32.393512 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:32.393512 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:13:32.393512 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:32.398172 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 242/492] 10.222.0.32 () {56 vars in 1102 bytes} [Wed Jun 1 04:13:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:32.399078 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e6456-3715-4a23-9749-45759752dbbc None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:32.462956 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843f6bf-dd18-41e9-933a-a7527a260c6e None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:32.500482 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42f00a-1b72-42b0-9f39-5866a2336214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:32.501153 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e6456-3715-4a23-9749-45759752dbbc None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:32.501870 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42f00a-1b72-42b0-9f39-5866a2336214 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:32.502379 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42f00a-1b72-42b0-9f39-5866a2336214 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:32.502801 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:32.503280 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42f00a-1b72-42b0-9f39-5866a2336214 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:32.514061 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a42f00a-1b72-42b0-9f39-5866a2336214 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:32.516705 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a42f00a-1b72-42b0-9f39-5866a2336214 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:32.534757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-6a42f00a-1b72-42b0-9f39-5866a2336214 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 01 04:13:32.534757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:32.534757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:32.534757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:32.534757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:32.534757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:32.534757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:32.534757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:32.534757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:32.534757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:32.534757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:32.534757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:32.534757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 04:13:32.534757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 04:13:32.534757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 04:13:32.534757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 04:13:32.535702 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:32.535702 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:32.535702 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 04:13:32.535702 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:13:32.535702 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 04:13:32.535702 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:13:32.535702 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:32.535702 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:32.535702 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:32.535702 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:32.535702 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:32.535702 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:32.535702 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:32.535702 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:32.535702 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:32.535702 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:32.535702 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:32.535702 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:32.536599 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:32.536599 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:32.536599 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 04:13:32.536599 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 04:13:32.536599 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 04:13:32.536599 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 04:13:32.536599 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 04:13:32.536599 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 04:13:32.536599 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 01 04:13:32.536599 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:32.538113 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a958003-1d18-42af-b3d6-76ca3271eedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:32.538789 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a958003-1d18-42af-b3d6-76ca3271eedf None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:32.539078 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a958003-1d18-42af-b3d6-76ca3271eedf None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:32.539362 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a958003-1d18-42af-b3d6-76ca3271eedf None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:32.540108 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a958003-1d18-42af-b3d6-76ca3271eedf None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:32.540319 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 251/493] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:13:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:32.540414 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a958003-1d18-42af-b3d6-76ca3271eedf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:32.541420 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42f00a-1b72-42b0-9f39-5866a2336214 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:32.541777 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a958003-1d18-42af-b3d6-76ca3271eedf None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:32.550599 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 243/494] 10.222.0.32 () {56 vars in 1103 bytes} [Wed Jun 1 04:13:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:32.551442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a958003-1d18-42af-b3d6-76ca3271eedf None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:32.566998 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:32.659048 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42f00a-1b72-42b0-9f39-5866a2336214 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:32.661471 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a958003-1d18-42af-b3d6-76ca3271eedf None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:32.694343 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4fb80-cf34-42ad-a91a-9b168d549008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:32.695010 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4fb80-cf34-42ad-a91a-9b168d549008 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:32.695298 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4fb80-cf34-42ad-a91a-9b168d549008 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:32.695579 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4fb80-cf34-42ad-a91a-9b168d549008 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:32.696359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e4fb80-cf34-42ad-a91a-9b168d549008 None admin] RBAC: Adding query filter params (name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:32.696559 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293484c-80c9-4388-b84d-62eb74d6552b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:32.696668 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e4fb80-cf34-42ad-a91a-9b168d549008 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:32.697223 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293484c-80c9-4388-b84d-62eb74d6552b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:32.697506 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293484c-80c9-4388-b84d-62eb74d6552b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:32.697784 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293484c-80c9-4388-b84d-62eb74d6552b None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:32.698061 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e4fb80-cf34-42ad-a91a-9b168d549008 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:32.698653 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293484c-80c9-4388-b84d-62eb74d6552b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:32.698962 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293484c-80c9-4388-b84d-62eb74d6552b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:32.700363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293484c-80c9-4388-b84d-62eb74d6552b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:32.705943 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 252/495] 10.222.0.32 () {56 vars in 1103 bytes} [Wed Jun 1 04:13:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:32.707264 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057475c4-1cd7-4103-9efc-0aaf22646675 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:32.707562 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057475c4-1cd7-4103-9efc-0aaf22646675 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:32.707854 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057475c4-1cd7-4103-9efc-0aaf22646675 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:32.710638 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 253/496] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:32.710638 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057475c4-1cd7-4103-9efc-0aaf22646675 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:32.738097 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 244/497] 10.222.0.32 () {56 vars in 1137 bytes} [Wed Jun 1 04:13:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:32.739416 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dbb8a-7d54-4509-b7ab-13b07884dfab None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:32.739706 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dbb8a-7d54-4509-b7ab-13b07884dfab None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:32.740076 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dbb8a-7d54-4509-b7ab-13b07884dfab None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:32.741758 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 245/498] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:32.742453 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9dbb8a-7d54-4509-b7ab-13b07884dfab None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:32.766228 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:32.796691 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:32.816670 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057475c4-1cd7-4103-9efc-0aaf22646675 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:32.842883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9dbb8a-7d54-4509-b7ab-13b07884dfab None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:32.850531 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32022d57-6008-4d62-85fa-e8c5760088fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:32.851321 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32022d57-6008-4d62-85fa-e8c5760088fc None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:32.851599 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32022d57-6008-4d62-85fa-e8c5760088fc None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:32.851873 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32022d57-6008-4d62-85fa-e8c5760088fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:32.862705 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32022d57-6008-4d62-85fa-e8c5760088fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:32.864153 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32022d57-6008-4d62-85fa-e8c5760088fc None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:32.882027 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3805f41-04ba-4eb0-87ce-ec8f2b822d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:32.882204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-32022d57-6008-4d62-85fa-e8c5760088fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:32.882204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:32.882204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:32.882204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:32.882204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:32.882204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:32.882204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:32.882204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:32.882204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:32.882204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:32.882204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:32.882204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:32.882204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:13:32.882204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:13:32.882204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:13:32.882986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:13:32.882986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:32.882986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:32.882986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:32.882986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:32.882986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:32.882986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:32.882986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:32.882986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:32.882986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:32.882986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:32.882986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:32.882986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:32.882986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:32.882986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:32.882986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:32.882986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:32.883810 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:13:32.883810 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:13:32.883810 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:32.883810 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:32.884020 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3805f41-04ba-4eb0-87ce-ec8f2b822d29 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:32.884020 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3805f41-04ba-4eb0-87ce-ec8f2b822d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:32.884147 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 254/499] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:32.884210 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3805f41-04ba-4eb0-87ce-ec8f2b822d29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:32.884839 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe669f-1f08-4e4a-8bd6-7cc7ae363a74 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:32.884839 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe669f-1f08-4e4a-8bd6-7cc7ae363a74 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:32.885004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe669f-1f08-4e4a-8bd6-7cc7ae363a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:32.894705 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3805f41-04ba-4eb0-87ce-ec8f2b822d29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:32.896173 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3805f41-04ba-4eb0-87ce-ec8f2b822d29 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:32.900907 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-e3fe669f-1f08-4e4a-8bd6-7cc7ae363a74 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:32.902142 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e3fe669f-1f08-4e4a-8bd6-7cc7ae363a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:32.913481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-b3805f41-04ba-4eb0-87ce-ec8f2b822d29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:32.913481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:32.913481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:32.913481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:32.913481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:32.913481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:32.913481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:32.913481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:32.913481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:32.913481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:32.913481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:32.913481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:32.913481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:13:32.913481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:13:32.913481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:13:32.914516 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:13:32.914516 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:32.914516 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:32.914516 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:32.914516 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:32.914516 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:32.914516 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:32.914516 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:32.914516 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:32.914516 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:32.914516 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:32.914516 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:32.914516 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:32.914516 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:32.914516 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:32.914516 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:32.914516 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:32.915397 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:13:32.915397 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:13:32.915397 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:32.915397 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:32.915397 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 246/500] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:32.915652 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3805f41-04ba-4eb0-87ce-ec8f2b822d29 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:32.972175 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 255/501] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:13:32.973626 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d6c9e-fc9e-462d-ae69-a08eb93bc218 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:32.973872 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d6c9e-fc9e-462d-ae69-a08eb93bc218 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:32.974143 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d6c9e-fc9e-462d-ae69-a08eb93bc218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:33.001614 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-226d6c9e-fc9e-462d-ae69-a08eb93bc218 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:33.002874 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-226d6c9e-fc9e-462d-ae69-a08eb93bc218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:33.069317 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:33.078079 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 256/502] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:13:33.078967 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d6c9e-fc9e-462d-ae69-a08eb93bc218 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:33.113451 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:33.140796 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3805f41-04ba-4eb0-87ce-ec8f2b822d29 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:33.180082 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af24968-f33e-4160-ba03-1a38a1eb0709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:33.180749 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af24968-f33e-4160-ba03-1a38a1eb0709 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:33.181023 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af24968-f33e-4160-ba03-1a38a1eb0709 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:33.181297 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af24968-f33e-4160-ba03-1a38a1eb0709 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:33.197629 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d6c9e-fc9e-462d-ae69-a08eb93bc218 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:33.233239 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b1ddc-824d-49da-998f-3c3a116796ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:33.233906 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b1ddc-824d-49da-998f-3c3a116796ea None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:33.234210 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b1ddc-824d-49da-998f-3c3a116796ea None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:33.234486 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b1ddc-824d-49da-998f-3c3a116796ea None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:33.235210 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b1ddc-824d-49da-998f-3c3a116796ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:33.235516 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b1ddc-824d-49da-998f-3c3a116796ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:33.236895 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b1ddc-824d-49da-998f-3c3a116796ea None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:33.249708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 257/503] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:13:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:33.250708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b1ddc-824d-49da-998f-3c3a116796ea None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:33.256769 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af24968-f33e-4160-ba03-1a38a1eb0709 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:33.258284 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af24968-f33e-4160-ba03-1a38a1eb0709 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:33.312217 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:33.335105 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:33.363035 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 247/504] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:13:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 04:13:33.363226 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b1ddc-824d-49da-998f-3c3a116796ea None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:33.364066 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af24968-f33e-4160-ba03-1a38a1eb0709 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:33.401062 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c84455-eddf-4a3b-b71c-0fe6ee670329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:33.401726 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c84455-eddf-4a3b-b71c-0fe6ee670329 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:33.402038 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c84455-eddf-4a3b-b71c-0fe6ee670329 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:33.402321 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c84455-eddf-4a3b-b71c-0fe6ee670329 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:33.403040 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c84455-eddf-4a3b-b71c-0fe6ee670329 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:33.403347 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c84455-eddf-4a3b-b71c-0fe6ee670329 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:33.404718 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c84455-eddf-4a3b-b71c-0fe6ee670329 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:33.417725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 258/505] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:13:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:33.419656 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c84455-eddf-4a3b-b71c-0fe6ee670329 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:33.478034 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af24968-f33e-4160-ba03-1a38a1eb0709 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:33.513367 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5f6aa-7c29-4a6b-9915-e6a45e9b5f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:33.514201 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5f6aa-7c29-4a6b-9915-e6a45e9b5f2b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:33.514480 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5f6aa-7c29-4a6b-9915-e6a45e9b5f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:33.514752 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5f6aa-7c29-4a6b-9915-e6a45e9b5f2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:33.525650 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf5f6aa-7c29-4a6b-9915-e6a45e9b5f2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:33.527156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf5f6aa-7c29-4a6b-9915-e6a45e9b5f2b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:33.536208 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c84455-eddf-4a3b-b71c-0fe6ee670329 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:33.546234 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-bcf5f6aa-7c29-4a6b-9915-e6a45e9b5f2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:33.546234 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:33.546234 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:33.546234 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:33.546234 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:33.546234 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:33.546234 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:33.546234 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:33.546234 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:33.546234 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:33.546234 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:33.546234 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:33.546234 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:13:33.546234 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:13:33.546234 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:13:33.547708 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:13:33.547708 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:33.547708 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:33.547708 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:33.547708 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:33.547708 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:33.547708 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:33.547708 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:33.547708 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:33.547708 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:33.547708 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:33.547708 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:33.547708 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:33.547708 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:33.547708 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:33.547708 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:33.547708 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:33.549156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:13:33.549156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:13:33.549156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:33.549156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:33.549156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 248/506] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:33.549156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5f6aa-7c29-4a6b-9915-e6a45e9b5f2b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:33.555912 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:33.577947 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:33.578363 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763f112-db35-4454-a00a-8aac157f49dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:33.579196 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763f112-db35-4454-a00a-8aac157f49dc None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:33.579452 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763f112-db35-4454-a00a-8aac157f49dc None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:33.579713 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763f112-db35-4454-a00a-8aac157f49dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:33.590702 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763f112-db35-4454-a00a-8aac157f49dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:33.598382 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-4763f112-db35-4454-a00a-8aac157f49dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:13:33.598382 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:33.598382 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:33.598382 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:33.598382 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:33.598382 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:33.598382 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:33.598382 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:33.598382 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:33.598382 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:33.598382 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:33.598382 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:33.598382 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:33.598382 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:33.598382 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:33.598382 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:33.599346 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:33.599346 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:33.599346 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:33.599346 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:33.599346 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:33.599346 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:33.599346 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:33.599346 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:33.599346 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:33.599346 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:33.599346 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:33.599346 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:33.599346 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:33.599346 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:33.599346 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:33.599346 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:33.600718 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:33.600718 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:33.600718 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:33.600718 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:33.600718 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:33.600718 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:33.600718 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:33.600718 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:33.600718 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:33.600718 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:33.600718 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:13:33.600718 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:33.600718 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 259/507] 10.222.0.32 () {56 vars in 1102 bytes} [Wed Jun 1 04:13:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:33.601364 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763f112-db35-4454-a00a-8aac157f49dc None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:33.664343 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5f6aa-7c29-4a6b-9915-e6a45e9b5f2b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:33.702306 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b9693-1e1b-4bd2-bbe4-b58d36743247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:33.703112 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b9693-1e1b-4bd2-bbe4-b58d36743247 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:33.703391 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b9693-1e1b-4bd2-bbe4-b58d36743247 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:33.703667 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b9693-1e1b-4bd2-bbe4-b58d36743247 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:33.711933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b9693-1e1b-4bd2-bbe4-b58d36743247 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:33.713387 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b9693-1e1b-4bd2-bbe4-b58d36743247 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:33.716141 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763f112-db35-4454-a00a-8aac157f49dc None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:33.729635 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-985b9693-1e1b-4bd2-bbe4-b58d36743247 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 01 04:13:33.729635 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:33.729635 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:33.729635 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:33.729635 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:33.729635 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:33.729635 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:33.729635 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:33.729635 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:33.729635 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:33.729635 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:33.729635 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:33.729635 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 04:13:33.729635 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 04:13:33.729635 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 04:13:33.729635 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 04:13:33.730785 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:33.730785 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:33.730785 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 04:13:33.730785 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:13:33.730785 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 04:13:33.730785 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:13:33.730785 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:33.730785 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:33.730785 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:33.730785 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:33.730785 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:33.730785 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:33.730785 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:33.730785 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:33.730785 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:33.730785 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:33.730785 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:33.730785 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:33.731676 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:33.731676 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:33.731676 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 04:13:33.731676 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 04:13:33.731676 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 04:13:33.731676 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 04:13:33.731676 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 04:13:33.731676 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 04:13:33.731676 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 01 04:13:33.731676 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:33.731676 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 249/508] 10.222.0.32 () {56 vars in 1093 bytes} [Wed Jun 1 04:13:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:33.731676 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b9693-1e1b-4bd2-bbe4-b58d36743247 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:33.760663 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306be717-82ae-459c-9125-565afb813081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:33.760663 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306be717-82ae-459c-9125-565afb813081 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:33.760663 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306be717-82ae-459c-9125-565afb813081 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:33.761079 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306be717-82ae-459c-9125-565afb813081 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:33.772099 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306be717-82ae-459c-9125-565afb813081 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:33.773551 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306be717-82ae-459c-9125-565afb813081 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:33.795523 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-306be717-82ae-459c-9125-565afb813081 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:33.795523 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:33.795523 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:33.795523 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:33.795523 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:33.795523 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:33.795523 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:33.795523 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:33.795523 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:33.795523 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:33.795523 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:33.795523 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:33.795523 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:13:33.795523 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:13:33.795523 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:13:33.796490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:13:33.796490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:33.796490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:33.796490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:33.796490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:33.796490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:33.796490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:33.796490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:33.796490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:33.796490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:33.796490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:33.796490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:33.796490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:33.796490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:33.796490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:33.796490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:33.796490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:33.797334 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:13:33.797334 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:13:33.797334 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:33.797334 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:33.797334 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 260/509] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:33.797601 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306be717-82ae-459c-9125-565afb813081 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:33.829345 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:33.837001 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:33.854776 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b9693-1e1b-4bd2-bbe4-b58d36743247 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:33.893045 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9d0c8-28e6-40c7-924c-d5cc0b423076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:33.894036 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9d0c8-28e6-40c7-924c-d5cc0b423076 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:33.894036 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9d0c8-28e6-40c7-924c-d5cc0b423076 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:33.894036 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9d0c8-28e6-40c7-924c-d5cc0b423076 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:33.902916 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9d0c8-28e6-40c7-924c-d5cc0b423076 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:33.904381 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9d0c8-28e6-40c7-924c-d5cc0b423076 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:33.914082 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306be717-82ae-459c-9125-565afb813081 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:33.919223 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-19d9d0c8-28e6-40c7-924c-d5cc0b423076 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 01 04:13:33.919223 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:33.919223 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:33.919223 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:33.919223 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:33.919223 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:33.919223 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:33.919223 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:33.919223 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:33.919223 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:33.919223 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:33.919223 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:33.919223 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 04:13:33.919223 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 04:13:33.919223 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 04:13:33.919223 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 04:13:33.920138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:33.920138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:33.920138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 04:13:33.920138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:13:33.920138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 04:13:33.920138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:13:33.920138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:33.920138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:33.920138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:33.920138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:33.920138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:33.920138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:33.920138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:33.920138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:33.920138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:33.920138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:33.920138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:33.920138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:33.921055 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:33.921055 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:33.921055 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 04:13:33.921055 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 04:13:33.921055 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 04:13:33.921055 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 04:13:33.921055 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 04:13:33.921055 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 04:13:33.921055 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 01 04:13:33.921055 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:33.925086 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 250/510] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:13:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:33.925921 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9d0c8-28e6-40c7-924c-d5cc0b423076 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:33.950676 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67fb467-fc6b-46cb-8dcc-484357488299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:33.952121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fb467-fc6b-46cb-8dcc-484357488299 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:33.952121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fb467-fc6b-46cb-8dcc-484357488299 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:33.952121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fb467-fc6b-46cb-8dcc-484357488299 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:33.952566 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67fb467-fc6b-46cb-8dcc-484357488299 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:33.953097 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67fb467-fc6b-46cb-8dcc-484357488299 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:33.954233 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67fb467-fc6b-46cb-8dcc-484357488299 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:33.967121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 261/511] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:13:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:33.967833 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67fb467-fc6b-46cb-8dcc-484357488299 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:34.031063 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9d0c8-28e6-40c7-924c-d5cc0b423076 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:34.065148 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:34.071871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711fc7f-9ed5-4f1f-be93-bea06339dd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:34.072556 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711fc7f-9ed5-4f1f-be93-bea06339dd25 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:34.074964 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711fc7f-9ed5-4f1f-be93-bea06339dd25 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:34.074964 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711fc7f-9ed5-4f1f-be93-bea06339dd25 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:34.074964 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711fc7f-9ed5-4f1f-be93-bea06339dd25 None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:34.074964 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711fc7f-9ed5-4f1f-be93-bea06339dd25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:34.075568 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711fc7f-9ed5-4f1f-be93-bea06339dd25 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:34.083989 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 251/512] 10.222.0.32 () {56 vars in 1103 bytes} [Wed Jun 1 04:13:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:34.084825 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711fc7f-9ed5-4f1f-be93-bea06339dd25 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:34.087851 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67fb467-fc6b-46cb-8dcc-484357488299 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:34.098182 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:34.127181 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f180132-9f04-4e83-b192-579b4486d4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:34.127758 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f180132-9f04-4e83-b192-579b4486d4df None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:34.128037 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f180132-9f04-4e83-b192-579b4486d4df None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:34.128313 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f180132-9f04-4e83-b192-579b4486d4df None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:34.129155 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f180132-9f04-4e83-b192-579b4486d4df None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:34.129458 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f180132-9f04-4e83-b192-579b4486d4df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:34.130958 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f180132-9f04-4e83-b192-579b4486d4df None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:34.169734 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 262/513] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Jun 1 04:13:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:34.170605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f180132-9f04-4e83-b192-579b4486d4df None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:34.199550 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711fc7f-9ed5-4f1f-be93-bea06339dd25 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:34.239118 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db04927-2138-4153-bfca-9d1925ab2a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:34.239786 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db04927-2138-4153-bfca-9d1925ab2a4c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:34.240072 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db04927-2138-4153-bfca-9d1925ab2a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:34.240406 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db04927-2138-4153-bfca-9d1925ab2a4c None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:34.241131 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db04927-2138-4153-bfca-9d1925ab2a4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:34.241440 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db04927-2138-4153-bfca-9d1925ab2a4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:34.242851 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db04927-2138-4153-bfca-9d1925ab2a4c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:34.255585 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 252/514] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:34.256444 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db04927-2138-4153-bfca-9d1925ab2a4c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:34.286482 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f180132-9f04-4e83-b192-579b4486d4df None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:34.321763 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e7106-a42c-44ce-9c1a-c5bb6525c01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:34.322450 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e7106-a42c-44ce-9c1a-c5bb6525c01a None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:34.322740 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e7106-a42c-44ce-9c1a-c5bb6525c01a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:34.323018 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e7106-a42c-44ce-9c1a-c5bb6525c01a None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:34.323861 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e7106-a42c-44ce-9c1a-c5bb6525c01a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:34.324171 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e7106-a42c-44ce-9c1a-c5bb6525c01a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:34.325035 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:34.325615 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e7106-a42c-44ce-9c1a-c5bb6525c01a None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:34.344096 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 263/515] 10.222.0.32 () {56 vars in 1137 bytes} [Wed Jun 1 04:13:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:34.344939 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e7106-a42c-44ce-9c1a-c5bb6525c01a None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:34.350655 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:34.364554 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db04927-2138-4153-bfca-9d1925ab2a4c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:34.404292 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953979c3-efda-4d40-9a9e-63fecb2d2c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:34.404866 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953979c3-efda-4d40-9a9e-63fecb2d2c65 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:34.405150 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953979c3-efda-4d40-9a9e-63fecb2d2c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:34.405425 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953979c3-efda-4d40-9a9e-63fecb2d2c65 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:34.406182 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953979c3-efda-4d40-9a9e-63fecb2d2c65 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:34.407644 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953979c3-efda-4d40-9a9e-63fecb2d2c65 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:34.429204 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 253/516] 10.222.0.32 () {60 vars in 1132 bytes} [Wed Jun 1 04:13:34 2022] POST /identity/v3/users => generated 247 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:13:34.430340 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953979c3-efda-4d40-9a9e-63fecb2d2c65 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:34.473130 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e7106-a42c-44ce-9c1a-c5bb6525c01a None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:34.519758 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee5e99-0867-40e1-81f0-780705917450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:34.520586 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee5e99-0867-40e1-81f0-780705917450 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:34.520873 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee5e99-0867-40e1-81f0-780705917450 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:34.521156 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee5e99-0867-40e1-81f0-780705917450 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:34.535003 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee5e99-0867-40e1-81f0-780705917450 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:34.536529 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee5e99-0867-40e1-81f0-780705917450 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:34.558224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-32ee5e99-0867-40e1-81f0-780705917450 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:34.558224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:34.558224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:34.558224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:34.558224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:34.558224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:34.558224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:34.558224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:34.558224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:34.558224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:34.558224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:34.558224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:34.558224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:13:34.558224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:13:34.558224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:13:34.559163 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:13:34.559163 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:34.559163 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:34.559163 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:34.559163 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:34.559163 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:34.559163 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:34.559163 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:34.559163 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:34.559163 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:34.559163 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:34.559163 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:34.559163 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:34.559163 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:34.559163 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:34.559163 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:34.559163 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:34.559994 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:13:34.559994 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:13:34.559994 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:34.559994 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:34.559994 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 264/517] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:34.563006 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee5e99-0867-40e1-81f0-780705917450 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:34.583501 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953979c3-efda-4d40-9a9e-63fecb2d2c65 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:34.617547 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:34.630762 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a3c0f-5935-4e8a-8f36-a0cff558423d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:34.631947 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a3c0f-5935-4e8a-8f36-a0cff558423d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:34.632240 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a3c0f-5935-4e8a-8f36-a0cff558423d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:34.632522 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a3c0f-5935-4e8a-8f36-a0cff558423d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:34.636739 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:34.705317 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee5e99-0867-40e1-81f0-780705917450 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:34.719757 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a3c0f-5935-4e8a-8f36-a0cff558423d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:34.721935 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a3c0f-5935-4e8a-8f36-a0cff558423d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:34.747018 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e32f0-ecc3-4461-bfe3-ae4e2f7698c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:34.747829 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e32f0-ecc3-4461-bfe3-ae4e2f7698c4 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:34.748104 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e32f0-ecc3-4461-bfe3-ae4e2f7698c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:34.748386 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e32f0-ecc3-4461-bfe3-ae4e2f7698c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:34.755478 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e32f0-ecc3-4461-bfe3-ae4e2f7698c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:34.757482 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e32f0-ecc3-4461-bfe3-ae4e2f7698c4 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:34.773421 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-af5e32f0-ecc3-4461-bfe3-ae4e2f7698c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:13:34.773421 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:34.773421 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:34.773421 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:34.773421 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:34.773421 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:34.773421 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:34.773421 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:34.773421 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:34.773421 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:34.773421 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:34.773421 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:34.773421 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 04:13:34.773421 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 04:13:34.773421 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 04:13:34.774548 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 04:13:34.774548 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:34.774548 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:34.774548 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:34.774548 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:34.774548 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:34.774548 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:34.774548 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:34.774548 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:34.774548 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:34.774548 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:34.774548 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:34.774548 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:34.774548 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:34.774548 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:34.774548 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:34.774548 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:34.775427 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 04:13:34.775427 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 04:13:34.775427 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 04:13:34.775427 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 04:13:34.775427 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 04:13:34.775427 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 04:13:34.775427 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:13:34.775427 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:34.775427 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 265/518] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:13:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:34.775886 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e32f0-ecc3-4461-bfe3-ae4e2f7698c4 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:34.832310 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 254/519] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:13:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 04:13:34.833174 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a3c0f-5935-4e8a-8f36-a0cff558423d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:34.866498 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:34.891539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e32f0-ecc3-4461-bfe3-ae4e2f7698c4 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:34.910020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:34.932324 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18840d4b-7b7b-442c-869c-a67c2498d78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:34.933063 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18840d4b-7b7b-442c-869c-a67c2498d78a None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:34.933350 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18840d4b-7b7b-442c-869c-a67c2498d78a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:34.933628 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18840d4b-7b7b-442c-869c-a67c2498d78a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:34.952433 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a3c0f-5935-4e8a-8f36-a0cff558423d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:34.989416 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13061d23-0f33-4733-a5bc-0d016b0e1eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:34.992022 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13061d23-0f33-4733-a5bc-0d016b0e1eff None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:34.992022 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13061d23-0f33-4733-a5bc-0d016b0e1eff None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:34.992022 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13061d23-0f33-4733-a5bc-0d016b0e1eff None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:34.993255 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13061d23-0f33-4733-a5bc-0d016b0e1eff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:34.993794 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13061d23-0f33-4733-a5bc-0d016b0e1eff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:34.996259 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13061d23-0f33-4733-a5bc-0d016b0e1eff None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:35.008406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18840d4b-7b7b-442c-869c-a67c2498d78a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:35.016211 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18840d4b-7b7b-442c-869c-a67c2498d78a None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:35.016406 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 255/520] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:35.016406 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13061d23-0f33-4733-a5bc-0d016b0e1eff None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:35.117811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:35.130226 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 266/521] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:13:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 04:13:35.130226 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18840d4b-7b7b-442c-869c-a67c2498d78a None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:35.141821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13061d23-0f33-4733-a5bc-0d016b0e1eff None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:35.142025 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:35.187040 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bba9c-c647-44dd-9f36-b051ddfd5104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:35.188241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bba9c-c647-44dd-9f36-b051ddfd5104 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:35.188241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bba9c-c647-44dd-9f36-b051ddfd5104 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:35.188241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bba9c-c647-44dd-9f36-b051ddfd5104 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:35.189013 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8bba9c-c647-44dd-9f36-b051ddfd5104 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:35.189316 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8bba9c-c647-44dd-9f36-b051ddfd5104 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:35.190785 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8bba9c-c647-44dd-9f36-b051ddfd5104 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:35.210005 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 256/522] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Jun 1 04:13:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:35.214916 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bba9c-c647-44dd-9f36-b051ddfd5104 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:35.255821 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18840d4b-7b7b-442c-869c-a67c2498d78a None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:35.296357 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937fbfd3-281d-4a7b-8797-a1d6fbbe3831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:35.297160 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fbfd3-281d-4a7b-8797-a1d6fbbe3831 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:35.297440 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fbfd3-281d-4a7b-8797-a1d6fbbe3831 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:35.297770 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fbfd3-281d-4a7b-8797-a1d6fbbe3831 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:35.311117 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937fbfd3-281d-4a7b-8797-a1d6fbbe3831 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:35.312579 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937fbfd3-281d-4a7b-8797-a1d6fbbe3831 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:35.329934 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bba9c-c647-44dd-9f36-b051ddfd5104 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:35.333967 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-937fbfd3-281d-4a7b-8797-a1d6fbbe3831 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:35.333967 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:35.333967 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:35.333967 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:35.333967 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:35.333967 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:35.333967 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:35.333967 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:35.333967 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:35.333967 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:35.333967 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:35.333967 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:35.333967 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:13:35.333967 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:13:35.333967 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:13:35.335738 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:13:35.335738 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:35.335738 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:35.335738 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:35.335738 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:35.335738 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:35.335738 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:35.335738 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:35.335738 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:35.335738 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:35.335738 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:35.335738 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:35.335738 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:35.335738 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:35.335738 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:35.335738 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:35.335738 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:35.336598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:13:35.336598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:13:35.336598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:35.336598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:35.336598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 267/523] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:35.336598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937fbfd3-281d-4a7b-8797-a1d6fbbe3831 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:35.372798 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d4b86-3d85-4dad-b5c3-ff66594c8163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:35.374013 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d4b86-3d85-4dad-b5c3-ff66594c8163 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:35.374013 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d4b86-3d85-4dad-b5c3-ff66594c8163 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:35.374188 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d4b86-3d85-4dad-b5c3-ff66594c8163 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:35.383271 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d4b86-3d85-4dad-b5c3-ff66594c8163 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:35.384256 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d4b86-3d85-4dad-b5c3-ff66594c8163 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:35.400238 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-d51d4b86-3d85-4dad-b5c3-ff66594c8163 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 01 04:13:35.400238 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:35.400238 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:35.400238 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:35.400238 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:35.400238 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:35.400238 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:35.400238 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:35.400238 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:35.400238 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:35.400238 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:35.400238 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:35.400238 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 04:13:35.400238 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 04:13:35.400238 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 04:13:35.400238 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 04:13:35.401191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:35.401191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:35.401191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 04:13:35.401191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:13:35.401191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 04:13:35.401191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:13:35.401191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:35.401191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:35.401191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:35.401191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:35.401191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:35.401191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:35.401191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:35.401191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:35.401191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:35.401191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:35.401191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:35.401191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:35.402715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:35.402715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:35.402715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 04:13:35.402715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 04:13:35.402715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 04:13:35.402715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 04:13:35.402715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 04:13:35.402715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 04:13:35.402715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 01 04:13:35.402715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:35.402715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 257/524] 10.222.0.32 () {56 vars in 1102 bytes} [Wed Jun 1 04:13:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:35.402715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d4b86-3d85-4dad-b5c3-ff66594c8163 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:35.408179 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:35.425565 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:35.470757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937fbfd3-281d-4a7b-8797-a1d6fbbe3831 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:35.524615 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e58e72-7ef5-4689-8f66-492d560aa177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:35.525278 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e58e72-7ef5-4689-8f66-492d560aa177 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:35.525627 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e58e72-7ef5-4689-8f66-492d560aa177 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:35.525989 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e58e72-7ef5-4689-8f66-492d560aa177 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:35.538106 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e58e72-7ef5-4689-8f66-492d560aa177 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:35.539578 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e58e72-7ef5-4689-8f66-492d560aa177 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:35.542344 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d4b86-3d85-4dad-b5c3-ff66594c8163 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:35.558527 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-59e58e72-7ef5-4689-8f66-492d560aa177 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:35.558527 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:35.558527 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:35.558527 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:35.558527 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:35.558527 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:35.558527 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:35.558527 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:35.558527 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:35.558527 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:35.558527 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:35.558527 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:35.558527 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:13:35.558527 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:13:35.558527 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:13:35.559561 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:13:35.559561 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:35.559561 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:35.559561 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:35.559561 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:35.559561 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:35.559561 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:35.559561 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:35.559561 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:35.559561 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:35.559561 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:35.559561 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:35.559561 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:35.559561 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:35.559561 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:35.559561 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:35.559561 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:35.560560 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:13:35.560560 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:13:35.560560 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:35.560560 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:35.562129 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 268/525] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:35.563160 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e58e72-7ef5-4689-8f66-492d560aa177 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:35.587420 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c3836-8d04-4cf3-8797-a72ae512626c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:35.587712 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c3836-8d04-4cf3-8797-a72ae512626c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:35.588023 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c3836-8d04-4cf3-8797-a72ae512626c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:35.588299 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c3836-8d04-4cf3-8797-a72ae512626c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:35.589112 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c3836-8d04-4cf3-8797-a72ae512626c None admin] RBAC: Adding query filter params (role.id=5e94b8f2c0b1418e8d2a18e4fe08d4f9, scope.project.id=31d68f64d21647688074554062952074, user.id=7ac83171b9284163a71cc729cef076f0) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:35.589426 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c3836-8d04-4cf3-8797-a72ae512626c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:35.590967 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c3836-8d04-4cf3-8797-a72ae512626c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:35.598877 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 258/526] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:13:35 2022] GET /identity/v3/role_assignments?user.id=7ac83171b9284163a71cc729cef076f0&scope.project.id=31d68f64d21647688074554062952074&role.id=5e94b8f2c0b1418e8d2a18e4fe08d4f9 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:35.607659 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c3836-8d04-4cf3-8797-a72ae512626c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:35.729786 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:35.743042 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e58e72-7ef5-4689-8f66-492d560aa177 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:35.768881 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:35.807094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c3836-8d04-4cf3-8797-a72ae512626c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:35.808518 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d53a2b-fd6e-497a-8ab2-caf26ad2ba66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:35.809801 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d53a2b-fd6e-497a-8ab2-caf26ad2ba66 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:35.810450 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d53a2b-fd6e-497a-8ab2-caf26ad2ba66 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:35.811513 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d53a2b-fd6e-497a-8ab2-caf26ad2ba66 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:35.812927 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d53a2b-fd6e-497a-8ab2-caf26ad2ba66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:35.814456 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d53a2b-fd6e-497a-8ab2-caf26ad2ba66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:35.817414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d53a2b-fd6e-497a-8ab2-caf26ad2ba66 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:35.834936 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 269/527] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:35.835812 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d53a2b-fd6e-497a-8ab2-caf26ad2ba66 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:35.875457 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d2cb8-0877-4eaa-9ad4-31f08e08c002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:35.876145 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d2cb8-0877-4eaa-9ad4-31f08e08c002 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:35.876425 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d2cb8-0877-4eaa-9ad4-31f08e08c002 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:35.876698 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d2cb8-0877-4eaa-9ad4-31f08e08c002 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:35.877541 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d2cb8-0877-4eaa-9ad4-31f08e08c002 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:35.877847 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d2cb8-0877-4eaa-9ad4-31f08e08c002 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:35.879313 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d2cb8-0877-4eaa-9ad4-31f08e08c002 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:35.905732 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 259/528] 10.222.0.32 () {56 vars in 1139 bytes} [Wed Jun 1 04:13:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:35.906952 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d2cb8-0877-4eaa-9ad4-31f08e08c002 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:35.963062 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d53a2b-fd6e-497a-8ab2-caf26ad2ba66 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:36.000945 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3ee80-a0e2-413a-9d91-769d8f0a59e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:36.001609 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3ee80-a0e2-413a-9d91-769d8f0a59e9 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:36.001888 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3ee80-a0e2-413a-9d91-769d8f0a59e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:36.002234 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3ee80-a0e2-413a-9d91-769d8f0a59e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:36.002946 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3ee80-a0e2-413a-9d91-769d8f0a59e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:36.003299 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3ee80-a0e2-413a-9d91-769d8f0a59e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:36.004731 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3ee80-a0e2-413a-9d91-769d8f0a59e9 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:36.022476 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 270/529] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:36.022476 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3ee80-a0e2-413a-9d91-769d8f0a59e9 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:36.063833 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d2cb8-0877-4eaa-9ad4-31f08e08c002 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:36.067030 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:36.098676 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:36.108855 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac77200-b730-451b-b256-896cf009dd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:36.110327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac77200-b730-451b-b256-896cf009dd53 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:36.110327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac77200-b730-451b-b256-896cf009dd53 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:36.110327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac77200-b730-451b-b256-896cf009dd53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:36.118138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac77200-b730-451b-b256-896cf009dd53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:36.119646 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac77200-b730-451b-b256-896cf009dd53 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:36.134560 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-7ac77200-b730-451b-b256-896cf009dd53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:13:36.134560 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:36.134560 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:36.134560 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:36.134560 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:36.134560 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:36.134560 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:36.134560 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:36.134560 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:36.134560 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:36.134560 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:36.134560 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:36.134560 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 04:13:36.134560 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 04:13:36.134560 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 04:13:36.135440 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 04:13:36.135440 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:36.135440 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:36.135440 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:36.135440 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:36.135440 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:36.135440 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:36.135440 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:36.135440 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:36.135440 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:36.135440 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:36.135440 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:36.135440 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:36.135440 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:36.135440 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:36.135440 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:36.135440 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:36.136304 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 04:13:36.136304 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 04:13:36.136304 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 04:13:36.136304 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 04:13:36.136304 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 04:13:36.136304 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 04:13:36.136304 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:13:36.136304 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:36.136304 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 260/530] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:13:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:36.137225 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac77200-b730-451b-b256-896cf009dd53 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:36.150660 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3ee80-a0e2-413a-9d91-769d8f0a59e9 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:36.197615 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cb8bb-1ba3-41a7-98fd-167da6a0c632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:36.198676 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cb8bb-1ba3-41a7-98fd-167da6a0c632 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:36.199279 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cb8bb-1ba3-41a7-98fd-167da6a0c632 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:36.199705 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cb8bb-1ba3-41a7-98fd-167da6a0c632 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:36.247291 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac77200-b730-451b-b256-896cf009dd53 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:36.283590 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61cb8bb-1ba3-41a7-98fd-167da6a0c632 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:36.285253 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61cb8bb-1ba3-41a7-98fd-167da6a0c632 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:36.291114 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c715df0-f5df-4dcd-86a4-02646d44ea12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:36.292131 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c715df0-f5df-4dcd-86a4-02646d44ea12 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:36.292553 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c715df0-f5df-4dcd-86a4-02646d44ea12 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:36.293004 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c715df0-f5df-4dcd-86a4-02646d44ea12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:36.302791 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c715df0-f5df-4dcd-86a4-02646d44ea12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:36.304705 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c715df0-f5df-4dcd-86a4-02646d44ea12 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:36.320502 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-4c715df0-f5df-4dcd-86a4-02646d44ea12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:13:36.320502 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:36.320502 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:36.320502 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:36.320502 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:36.320502 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:36.320502 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:36.320502 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:36.320502 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:36.320502 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:36.320502 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:36.320502 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:36.320502 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 04:13:36.320502 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 04:13:36.320502 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 04:13:36.321396 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 04:13:36.321396 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:36.321396 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:36.321396 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:36.321396 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:36.321396 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:36.321396 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:36.321396 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:36.321396 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:36.321396 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:36.321396 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:36.321396 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:36.321396 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:36.321396 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:36.321396 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:36.321396 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:36.321396 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:36.322275 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 04:13:36.322275 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 04:13:36.322275 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 04:13:36.322275 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 04:13:36.322275 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 04:13:36.322275 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 04:13:36.322275 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:13:36.322275 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:36.326529 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 261/531] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:13:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:36.327493 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c715df0-f5df-4dcd-86a4-02646d44ea12 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:36.338347 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:36.381114 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:36.424905 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 271/532] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:13:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 04:13:36.426144 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cb8bb-1ba3-41a7-98fd-167da6a0c632 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:36.447881 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c715df0-f5df-4dcd-86a4-02646d44ea12 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:36.489341 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60a373-64ca-4ecc-8318-eab656af5cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:36.490430 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60a373-64ca-4ecc-8318-eab656af5cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:36.490430 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60a373-64ca-4ecc-8318-eab656af5cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:36.490758 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60a373-64ca-4ecc-8318-eab656af5cd7 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:36.491498 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb60a373-64ca-4ecc-8318-eab656af5cd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:36.491810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb60a373-64ca-4ecc-8318-eab656af5cd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:36.493411 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb60a373-64ca-4ecc-8318-eab656af5cd7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:36.512596 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 262/533] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Jun 1 04:13:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:36.513702 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60a373-64ca-4ecc-8318-eab656af5cd7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:36.558010 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cb8bb-1ba3-41a7-98fd-167da6a0c632 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:36.594377 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20d34a-9baf-48da-a173-49dbdbc2f5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:36.594730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20d34a-9baf-48da-a173-49dbdbc2f5eb None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:36.595006 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20d34a-9baf-48da-a173-49dbdbc2f5eb None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:36.595282 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20d34a-9baf-48da-a173-49dbdbc2f5eb None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:36.596126 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20d34a-9baf-48da-a173-49dbdbc2f5eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:36.596473 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20d34a-9baf-48da-a173-49dbdbc2f5eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:36.598197 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20d34a-9baf-48da-a173-49dbdbc2f5eb None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:36.614363 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:36.621414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 272/534] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Jun 1 04:13:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:36.622611 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20d34a-9baf-48da-a173-49dbdbc2f5eb None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:36.659735 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60a373-64ca-4ecc-8318-eab656af5cd7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:36.674804 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:36.705955 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2f232-551e-40fe-8cc0-2621bb95aa8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:36.707156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2f232-551e-40fe-8cc0-2621bb95aa8a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:36.707669 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2f232-551e-40fe-8cc0-2621bb95aa8a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:36.708197 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2f232-551e-40fe-8cc0-2621bb95aa8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:36.721919 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2f232-551e-40fe-8cc0-2621bb95aa8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:36.723907 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2f232-551e-40fe-8cc0-2621bb95aa8a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:36.743623 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-23f2f232-551e-40fe-8cc0-2621bb95aa8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:36.743623 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:36.743623 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:36.743623 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:36.743623 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:36.743623 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:36.743623 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:36.743623 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:36.743623 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:36.743623 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:36.743623 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:36.743623 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:36.743623 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:13:36.743623 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:13:36.743623 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:13:36.744535 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:13:36.744535 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:36.744535 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:36.744535 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:36.744535 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:36.744535 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:36.744535 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:36.744535 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:36.744535 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:36.744535 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:36.744535 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:36.744535 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:36.744535 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:36.744535 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:36.744535 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:36.744535 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:36.744535 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:36.745379 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:13:36.745379 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:13:36.745379 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:36.745379 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:36.747448 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 263/535] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:36.748605 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2f232-551e-40fe-8cc0-2621bb95aa8a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:36.787973 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20d34a-9baf-48da-a173-49dbdbc2f5eb None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:36.839198 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910aa6a1-e3f7-4ce1-938f-6544657af666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:36.839885 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910aa6a1-e3f7-4ce1-938f-6544657af666 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:36.840172 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910aa6a1-e3f7-4ce1-938f-6544657af666 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:36.840452 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910aa6a1-e3f7-4ce1-938f-6544657af666 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:36.841325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910aa6a1-e3f7-4ce1-938f-6544657af666 None admin] RBAC: Adding query filter params (role.id=5e94b8f2c0b1418e8d2a18e4fe08d4f9, scope.project.id=31d68f64d21647688074554062952074, user.id=79d614f85f5541d3babbb41468cbf55c) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:36.841638 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910aa6a1-e3f7-4ce1-938f-6544657af666 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:36.843168 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910aa6a1-e3f7-4ce1-938f-6544657af666 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:36.851828 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 273/536] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:13:36 2022] GET /identity/v3/role_assignments?user.id=79d614f85f5541d3babbb41468cbf55c&scope.project.id=31d68f64d21647688074554062952074&role.id=5e94b8f2c0b1418e8d2a18e4fe08d4f9 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:36.851828 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910aa6a1-e3f7-4ce1-938f-6544657af666 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:36.885499 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2f232-551e-40fe-8cc0-2621bb95aa8a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:36.930810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e6185-75ba-47ad-ad01-d9a73a6771b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:36.931688 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e6185-75ba-47ad-ad01-d9a73a6771b4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:36.932223 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e6185-75ba-47ad-ad01-d9a73a6771b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:36.932611 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e6185-75ba-47ad-ad01-d9a73a6771b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:36.933651 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e6185-75ba-47ad-ad01-d9a73a6771b4 None admin] RBAC: Adding query filter params (role.id=5e94b8f2c0b1418e8d2a18e4fe08d4f9, scope.project.id=31d68f64d21647688074554062952074, user.id=c1fbe41fbc1e4ac4964e3a5a417b6253) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:36.934107 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e6185-75ba-47ad-ad01-d9a73a6771b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:36.935720 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e6185-75ba-47ad-ad01-d9a73a6771b4 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:36.943488 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 264/537] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:13:36 2022] GET /identity/v3/role_assignments?user.id=c1fbe41fbc1e4ac4964e3a5a417b6253&scope.project.id=31d68f64d21647688074554062952074&role.id=5e94b8f2c0b1418e8d2a18e4fe08d4f9 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:36.945095 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4de48-37eb-4c6e-90f9-456a19487d9f None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:36.945528 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4de48-37eb-4c6e-90f9-456a19487d9f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:36.945910 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4de48-37eb-4c6e-90f9-456a19487d9f None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:36.947984 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 265/538] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:36.953942 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d93cf-0971-45d0-987a-f49aa34e17b3 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:36.954626 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d93cf-0971-45d0-987a-f49aa34e17b3 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:36.955111 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d93cf-0971-45d0-987a-f49aa34e17b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:36.982022 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:36.995763 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-5d5d93cf-0971-45d0-987a-f49aa34e17b3 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:36.997097 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5d5d93cf-0971-45d0-987a-f49aa34e17b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:37.042256 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:37.064109 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910aa6a1-e3f7-4ce1-938f-6544657af666 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:37.131257 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f4b1f-f0df-4bd1-8af0-1d8682b7318a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:37.131866 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f4b1f-f0df-4bd1-8af0-1d8682b7318a None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:37.132318 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f4b1f-f0df-4bd1-8af0-1d8682b7318a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:37.132604 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f4b1f-f0df-4bd1-8af0-1d8682b7318a None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:37.133397 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f4b1f-f0df-4bd1-8af0-1d8682b7318a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:37.133713 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f4b1f-f0df-4bd1-8af0-1d8682b7318a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:37.135309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f4b1f-f0df-4bd1-8af0-1d8682b7318a None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:37.140403 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 266/539] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 04:13:37.149228 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 274/540] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:37.156621 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d93cf-0971-45d0-987a-f49aa34e17b3 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:37.166721 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f4b1f-f0df-4bd1-8af0-1d8682b7318a None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:37.316673 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d93cf-0971-45d0-987a-f49aa34e17b3 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:37.355705 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd9bc9-581f-4633-aaee-2648b3a3a4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:37.356515 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd9bc9-581f-4633-aaee-2648b3a3a4b1 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:37.356797 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd9bc9-581f-4633-aaee-2648b3a3a4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:37.357072 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd9bc9-581f-4633-aaee-2648b3a3a4b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:37.364642 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd9bc9-581f-4633-aaee-2648b3a3a4b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:37.366198 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd9bc9-581f-4633-aaee-2648b3a3a4b1 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:37.390983 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f4b1f-f0df-4bd1-8af0-1d8682b7318a None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:37.393735 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-7fbd9bc9-581f-4633-aaee-2648b3a3a4b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:13:37.393735 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:37.393735 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:37.393735 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:37.393735 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:37.393735 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:37.393735 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:37.393735 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:37.393735 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:37.393735 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:37.393735 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:37.393735 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:37.393735 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 04:13:37.393735 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 04:13:37.393735 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 04:13:37.394831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 04:13:37.394831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:37.394831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:37.394831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:37.394831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:37.394831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:37.394831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:37.394831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:37.394831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:37.394831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:37.394831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:37.394831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:37.394831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:37.394831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:37.394831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:37.394831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:37.394831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:37.396041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 04:13:37.396041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 04:13:37.396041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 04:13:37.396041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 04:13:37.396041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 04:13:37.396041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 04:13:37.396041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:13:37.396041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:37.396041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 267/541] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:13:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:37.401360 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd9bc9-581f-4633-aaee-2648b3a3a4b1 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:37.422379 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:37.442364 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:37.466718 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18fb70d-5c38-40d5-89e2-8b5a04948dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:37.467539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fb70d-5c38-40d5-89e2-8b5a04948dee None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:37.467825 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fb70d-5c38-40d5-89e2-8b5a04948dee None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:37.468104 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fb70d-5c38-40d5-89e2-8b5a04948dee None admin] PATH_INFO: `/v3/roles/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:37.493572 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18fb70d-5c38-40d5-89e2-8b5a04948dee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:37.501464 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-f18fb70d-5c38-40d5-89e2-8b5a04948dee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:13:37.501464 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:37.501464 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:37.501464 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:37.501464 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:37.501464 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:37.501464 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:37.501464 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:37.501464 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:37.501464 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:37.501464 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:37.501464 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:37.501464 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:37.501464 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:37.501464 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:37.501464 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:37.502414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:37.502414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:37.502414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:37.502414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:37.502414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:37.502414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:37.502414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:37.502414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:37.502414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:37.502414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:37.502414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:37.502414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:37.502414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:37.502414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:37.502414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:37.502414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:37.503201 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:37.503201 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:37.503201 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:37.503201 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:37.503201 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:37.503201 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:37.503201 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:37.503201 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:37.503201 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:37.503201 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:37.503201 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:13:37.503201 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:37.507138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd9bc9-581f-4633-aaee-2648b3a3a4b1 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:37.515231 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 275/542] 10.222.0.32 () {56 vars in 1102 bytes} [Wed Jun 1 04:13:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:37.521302 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18fb70d-5c38-40d5-89e2-8b5a04948dee None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:37.546403 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa109ff6-94c9-4213-b7b7-d9cf3a1b8a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:37.547069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa109ff6-94c9-4213-b7b7-d9cf3a1b8a60 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:37.547351 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa109ff6-94c9-4213-b7b7-d9cf3a1b8a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:37.547624 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa109ff6-94c9-4213-b7b7-d9cf3a1b8a60 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:37.548921 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa109ff6-94c9-4213-b7b7-d9cf3a1b8a60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:37.548921 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa109ff6-94c9-4213-b7b7-d9cf3a1b8a60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:37.550283 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa109ff6-94c9-4213-b7b7-d9cf3a1b8a60 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:37.563993 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 268/543] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Jun 1 04:13:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:13:37.569620 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa109ff6-94c9-4213-b7b7-d9cf3a1b8a60 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:37.642550 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:37.672665 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa109ff6-94c9-4213-b7b7-d9cf3a1b8a60 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:37.716336 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c1d6b-91f0-4c73-a6da-cac41a449821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:37.717004 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c1d6b-91f0-4c73-a6da-cac41a449821 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:37.717285 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c1d6b-91f0-4c73-a6da-cac41a449821 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:37.717560 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c1d6b-91f0-4c73-a6da-cac41a449821 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:37.718424 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c1d6b-91f0-4c73-a6da-cac41a449821 None admin] RBAC: Adding query filter params (role.id=5e94b8f2c0b1418e8d2a18e4fe08d4f9, scope.project.id=31d68f64d21647688074554062952074, user.id=dca5f9455ef349738adf4569fe5ed165) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:37.718734 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c1d6b-91f0-4c73-a6da-cac41a449821 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:37.720181 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c1d6b-91f0-4c73-a6da-cac41a449821 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:37.720292 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18fb70d-5c38-40d5-89e2-8b5a04948dee None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:37.727473 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 269/544] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:13:37 2022] GET /identity/v3/role_assignments?user.id=dca5f9455ef349738adf4569fe5ed165&scope.project.id=31d68f64d21647688074554062952074&role.id=5e94b8f2c0b1418e8d2a18e4fe08d4f9 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:13:37.791832 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c1a69e-6891-428d-9e10-6c624cfc37bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:37.792556 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1a69e-6891-428d-9e10-6c624cfc37bf None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:37.792845 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1a69e-6891-428d-9e10-6c624cfc37bf None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:37.793126 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1a69e-6891-428d-9e10-6c624cfc37bf None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:37.793919 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c1a69e-6891-428d-9e10-6c624cfc37bf None admin] RBAC: Adding query filter params (name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:37.794265 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c1a69e-6891-428d-9e10-6c624cfc37bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:37.795725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c1a69e-6891-428d-9e10-6c624cfc37bf None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:37.812091 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c1d6b-91f0-4c73-a6da-cac41a449821 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:37.812613 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 276/545] 10.222.0.32 () {56 vars in 1103 bytes} [Wed Jun 1 04:13:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:37.994326 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c1d6b-91f0-4c73-a6da-cac41a449821 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:38.054206 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5b5bb-a6c4-4eef-a9c7-a2c862ce0143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:38.055606 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5b5bb-a6c4-4eef-a9c7-a2c862ce0143 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:38.056119 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5b5bb-a6c4-4eef-a9c7-a2c862ce0143 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:38.056631 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5b5bb-a6c4-4eef-a9c7-a2c862ce0143 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:38.069358 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:38.075867 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f5b5bb-a6c4-4eef-a9c7-a2c862ce0143 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:38.079941 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f5b5bb-a6c4-4eef-a9c7-a2c862ce0143 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:38.113118 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-85f5b5bb-a6c4-4eef-a9c7-a2c862ce0143 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:38.113118 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:38.113118 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:38.113118 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:38.113118 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:38.113118 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:38.113118 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:38.113118 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:38.113118 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:38.113118 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:38.113118 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:38.113118 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:38.113118 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:13:38.113118 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:13:38.113118 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:13:38.114041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:13:38.114041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:38.114041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:38.114041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:38.114041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:38.114041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:38.114041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:38.114041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:38.114041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:38.114041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:38.114041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:38.114041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:38.114041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:38.114041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:38.114041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:38.114041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:38.114041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:38.114895 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:13:38.114895 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:13:38.114895 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:38.114895 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:38.116039 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 270/546] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:38.123684 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c1a69e-6891-428d-9e10-6c624cfc37bf None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:38.211322 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:38.264902 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8eb0d0-4753-44ba-be9d-358fb276bd79 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:38.265584 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8eb0d0-4753-44ba-be9d-358fb276bd79 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:38.266096 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8eb0d0-4753-44ba-be9d-358fb276bd79 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:38.267696 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 271/547] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:13:38.283521 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de005254-041b-44d5-800d-abd11bf1e790 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:38.283835 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de005254-041b-44d5-800d-abd11bf1e790 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:38.284076 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de005254-041b-44d5-800d-abd11bf1e790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:38.287424 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c1a69e-6891-428d-9e10-6c624cfc37bf None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:38.307935 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-de005254-041b-44d5-800d-abd11bf1e790 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:38.309136 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-de005254-041b-44d5-800d-abd11bf1e790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:38.332403 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378640d-e196-4774-a2a6-913219d04393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:38.333444 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378640d-e196-4774-a2a6-913219d04393 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:38.334017 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378640d-e196-4774-a2a6-913219d04393 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:38.334519 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378640d-e196-4774-a2a6-913219d04393 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:38.335451 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8378640d-e196-4774-a2a6-913219d04393 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:38.335956 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8378640d-e196-4774-a2a6-913219d04393 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:38.337540 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8378640d-e196-4774-a2a6-913219d04393 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:38.360370 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 277/548] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:13:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:38.366143 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378640d-e196-4774-a2a6-913219d04393 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:38.383523 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 272/549] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:13:38.428492 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de005254-041b-44d5-800d-abd11bf1e790 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:38.545454 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de005254-041b-44d5-800d-abd11bf1e790 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:38.570369 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:38.587147 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56e816-65c3-47f3-9894-0a89e8ee0a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:38.589097 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56e816-65c3-47f3-9894-0a89e8ee0a43 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:38.589399 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56e816-65c3-47f3-9894-0a89e8ee0a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:38.589672 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56e816-65c3-47f3-9894-0a89e8ee0a43 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:38.596021 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378640d-e196-4774-a2a6-913219d04393 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:38.603898 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:38.617279 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a56e816-65c3-47f3-9894-0a89e8ee0a43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:38.639327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-9a56e816-65c3-47f3-9894-0a89e8ee0a43 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:13:38.639327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:38.639327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:38.639327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:38.639327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:38.639327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:38.639327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:38.639327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:38.639327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:38.639327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:38.639327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:38.639327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:38.639327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:38.639327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:38.639327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:38.639327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:38.640443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:38.640443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:38.640443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:38.640443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:38.640443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:38.640443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:38.640443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:38.640443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:38.640443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:38.640443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:38.640443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:38.640443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:38.640443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:38.640443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:38.640443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:38.640443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:38.641447 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:38.641447 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:38.641447 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:38.641447 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:38.641447 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:38.641447 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:38.641447 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:38.641447 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:38.641447 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:38.641447 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:38.641447 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:13:38.641447 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:38.644268 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 273/550] 10.222.0.32 () {56 vars in 1102 bytes} [Wed Jun 1 04:13:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:38.649695 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56e816-65c3-47f3-9894-0a89e8ee0a43 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:38.653163 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e918558-dd3c-4401-873d-17120cb8da6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:38.654283 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e918558-dd3c-4401-873d-17120cb8da6c None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:38.654710 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e918558-dd3c-4401-873d-17120cb8da6c None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:38.655152 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e918558-dd3c-4401-873d-17120cb8da6c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:38.664643 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e918558-dd3c-4401-873d-17120cb8da6c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:38.666332 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e918558-dd3c-4401-873d-17120cb8da6c None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:38.684098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-8e918558-dd3c-4401-873d-17120cb8da6c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 01 04:13:38.684098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:38.684098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:38.684098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:38.684098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:38.684098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:38.684098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:38.684098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:38.684098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:38.684098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:38.684098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:38.684098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:38.684098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 04:13:38.684098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 04:13:38.684098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 04:13:38.684098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 04:13:38.685121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:38.685121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:38.685121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 04:13:38.685121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:13:38.685121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 04:13:38.685121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:13:38.685121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:38.685121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:38.685121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:38.685121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:38.685121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:38.685121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:38.685121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:38.685121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:38.685121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:38.685121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:38.685121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:38.685121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:38.686226 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:38.686226 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:38.686226 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 04:13:38.686226 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 04:13:38.686226 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 04:13:38.686226 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 04:13:38.686226 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 04:13:38.686226 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 04:13:38.686226 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 01 04:13:38.686226 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:38.688996 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 278/551] 10.222.0.32 () {56 vars in 1096 bytes} [Wed Jun 1 04:13:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:38.694990 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e918558-dd3c-4401-873d-17120cb8da6c None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:38.855916 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56e816-65c3-47f3-9894-0a89e8ee0a43 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:38.865127 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e918558-dd3c-4401-873d-17120cb8da6c None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:38.917011 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecb854-adc5-43f3-922f-e8f9a0305631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:38.917698 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecb854-adc5-43f3-922f-e8f9a0305631 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:38.919087 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecb854-adc5-43f3-922f-e8f9a0305631 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:38.919373 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecb854-adc5-43f3-922f-e8f9a0305631 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:38.920129 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecb854-adc5-43f3-922f-e8f9a0305631 None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:38.920438 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecb854-adc5-43f3-922f-e8f9a0305631 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:38.921814 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecb854-adc5-43f3-922f-e8f9a0305631 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:38.929449 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11744f3-baaa-4f5a-b6e3-c95d7b742458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:38.930156 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11744f3-baaa-4f5a-b6e3-c95d7b742458 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:38.933195 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11744f3-baaa-4f5a-b6e3-c95d7b742458 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:38.933480 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11744f3-baaa-4f5a-b6e3-c95d7b742458 None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:38.934627 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11744f3-baaa-4f5a-b6e3-c95d7b742458 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:38.934942 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11744f3-baaa-4f5a-b6e3-c95d7b742458 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:38.936381 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11744f3-baaa-4f5a-b6e3-c95d7b742458 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:38.942884 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 274/552] 10.222.0.32 () {56 vars in 1103 bytes} [Wed Jun 1 04:13:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:38.948647 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecb854-adc5-43f3-922f-e8f9a0305631 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:38.979211 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 279/553] 10.222.0.32 () {56 vars in 1135 bytes} [Wed Jun 1 04:13:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:38.981407 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11744f3-baaa-4f5a-b6e3-c95d7b742458 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:39.024043 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:39.032803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:39.133408 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11744f3-baaa-4f5a-b6e3-c95d7b742458 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:39.168297 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecb854-adc5-43f3-922f-e8f9a0305631 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:39.206621 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289cc1fa-25a1-4470-907a-a6c984d843fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:39.207443 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289cc1fa-25a1-4470-907a-a6c984d843fa None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:39.207733 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289cc1fa-25a1-4470-907a-a6c984d843fa None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:39.207913 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c52a0-3890-4e9a-a561-02ad52106fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:39.208115 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289cc1fa-25a1-4470-907a-a6c984d843fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:39.208681 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c52a0-3890-4e9a-a561-02ad52106fee None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:39.209038 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c52a0-3890-4e9a-a561-02ad52106fee None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:39.209798 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c52a0-3890-4e9a-a561-02ad52106fee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:39.227372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c52a0-3890-4e9a-a561-02ad52106fee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:39.229616 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c52a0-3890-4e9a-a561-02ad52106fee None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:39.252498 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-6f0c52a0-3890-4e9a-a561-02ad52106fee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:39.252498 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:39.252498 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:39.252498 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:39.252498 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:39.252498 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:39.252498 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:39.252498 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:39.252498 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:39.252498 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:39.252498 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:39.252498 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:39.252498 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:13:39.252498 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:13:39.252498 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:13:39.253456 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:13:39.253456 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:39.253456 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:39.253456 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:39.253456 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:39.253456 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:39.253456 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:39.253456 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:39.253456 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:39.253456 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:39.253456 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:39.253456 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:39.253456 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:39.253456 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:39.253456 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:39.253456 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:39.253456 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:39.254627 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:13:39.254627 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:13:39.254627 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:39.254627 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:39.254627 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 275/554] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:13:39.260426 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c52a0-3890-4e9a-a561-02ad52106fee None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:39.342141 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289cc1fa-25a1-4470-907a-a6c984d843fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:39.342141 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289cc1fa-25a1-4470-907a-a6c984d843fa None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:39.362234 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:39.456751 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:39.476177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c52a0-3890-4e9a-a561-02ad52106fee None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:39.499589 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 280/555] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:13:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 04:13:39.507353 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289cc1fa-25a1-4470-907a-a6c984d843fa None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:39.553422 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f9611-13a6-41ed-aba7-07a3f711843a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:39.554473 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f9611-13a6-41ed-aba7-07a3f711843a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:39.555531 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f9611-13a6-41ed-aba7-07a3f711843a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:39.556188 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f9611-13a6-41ed-aba7-07a3f711843a None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:39.559096 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f9611-13a6-41ed-aba7-07a3f711843a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:39.559656 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f9611-13a6-41ed-aba7-07a3f711843a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:39.561244 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f9611-13a6-41ed-aba7-07a3f711843a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:39.587116 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 276/556] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:39.590879 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f9611-13a6-41ed-aba7-07a3f711843a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:39.667219 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289cc1fa-25a1-4470-907a-a6c984d843fa None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:39.692711 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:39.706840 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd38b3-9ac4-4a59-93d7-6fa1da3de26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:39.707663 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd38b3-9ac4-4a59-93d7-6fa1da3de26a None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:39.707954 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd38b3-9ac4-4a59-93d7-6fa1da3de26a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:39.708234 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd38b3-9ac4-4a59-93d7-6fa1da3de26a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:39.719771 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd38b3-9ac4-4a59-93d7-6fa1da3de26a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:39.721341 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd38b3-9ac4-4a59-93d7-6fa1da3de26a None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:39.722894 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f9611-13a6-41ed-aba7-07a3f711843a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:39.740982 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-c0bd38b3-9ac4-4a59-93d7-6fa1da3de26a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:39.740982 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:39.740982 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:39.740982 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:39.740982 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:39.740982 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:39.740982 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:39.740982 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:39.740982 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:39.740982 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:39.740982 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:39.740982 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:39.740982 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:13:39.740982 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:13:39.740982 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:13:39.742406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:13:39.742406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:39.742406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:39.742406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:39.742406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:39.742406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:39.742406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:39.742406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:39.742406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:39.742406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:39.742406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:39.742406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:39.742406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:39.742406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:39.742406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:39.742406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:39.742406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:39.743682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:13:39.743682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:13:39.743682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:39.743682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:39.743682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 281/557] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:39.744155 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a0f99-d066-4ef1-a34d-5cdd6d9b5312 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:39.745320 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a0f99-d066-4ef1-a34d-5cdd6d9b5312 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:39.745320 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a0f99-d066-4ef1-a34d-5cdd6d9b5312 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:39.746314 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 282/558] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:39.750588 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a0f99-d066-4ef1-a34d-5cdd6d9b5312 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:39.766182 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446a864-ef4d-43d6-8678-41ce4395447a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:39.767021 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446a864-ef4d-43d6-8678-41ce4395447a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:39.767398 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446a864-ef4d-43d6-8678-41ce4395447a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:39.767678 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446a864-ef4d-43d6-8678-41ce4395447a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:39.775836 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446a864-ef4d-43d6-8678-41ce4395447a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:39.777278 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446a864-ef4d-43d6-8678-41ce4395447a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:39.792609 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-6446a864-ef4d-43d6-8678-41ce4395447a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 01 04:13:39.792609 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:39.792609 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:39.792609 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:39.792609 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:39.792609 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:39.792609 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:39.792609 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:39.792609 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:39.792609 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:39.792609 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:39.792609 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:39.792609 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 04:13:39.792609 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 04:13:39.792609 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 04:13:39.792609 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 04:13:39.793589 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:39.793589 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:39.793589 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 04:13:39.793589 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:13:39.793589 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 04:13:39.793589 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:13:39.793589 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:39.793589 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:39.793589 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:39.793589 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:39.793589 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:39.793589 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:39.793589 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:39.793589 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:39.793589 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:39.793589 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:39.793589 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:39.793589 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:39.795069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:39.795069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:39.795069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 04:13:39.795069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 04:13:39.795069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 04:13:39.795069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 04:13:39.795069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 04:13:39.795069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 04:13:39.795069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 01 04:13:39.795069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:39.795069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 277/559] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:13:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:39.795069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074583a9-221e-4b37-936e-630e36c20a3a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:39.795723 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074583a9-221e-4b37-936e-630e36c20a3a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:39.795723 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074583a9-221e-4b37-936e-630e36c20a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:39.813928 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-074583a9-221e-4b37-936e-630e36c20a3a None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:39.815093 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-074583a9-221e-4b37-936e-630e36c20a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:39.823146 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:39.877997 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a0f99-d066-4ef1-a34d-5cdd6d9b5312 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:39.886796 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 278/560] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:13:39.888330 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540224a-d7b5-4d71-83ee-0b6fbf3e5d27 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:39.888622 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540224a-d7b5-4d71-83ee-0b6fbf3e5d27 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:39.888895 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540224a-d7b5-4d71-83ee-0b6fbf3e5d27 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:39.894391 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 279/561] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:39.895229 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540224a-d7b5-4d71-83ee-0b6fbf3e5d27 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:39.924319 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1121667-fcf8-4ded-b92b-ee183b001478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:39.925132 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1121667-fcf8-4ded-b92b-ee183b001478 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:39.925419 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1121667-fcf8-4ded-b92b-ee183b001478 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:39.925701 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1121667-fcf8-4ded-b92b-ee183b001478 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:39.926461 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1121667-fcf8-4ded-b92b-ee183b001478 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:39.926771 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1121667-fcf8-4ded-b92b-ee183b001478 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:39.928208 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1121667-fcf8-4ded-b92b-ee183b001478 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:39.940428 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 283/562] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:39.941717 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274961a8-d198-41f2-93f1-b5ce6386b054 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:39.942034 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274961a8-d198-41f2-93f1-b5ce6386b054 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:39.942321 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274961a8-d198-41f2-93f1-b5ce6386b054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:39.960511 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-274961a8-d198-41f2-93f1-b5ce6386b054 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:39.961642 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-274961a8-d198-41f2-93f1-b5ce6386b054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:39.988948 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:40.015429 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540224a-d7b5-4d71-83ee-0b6fbf3e5d27 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:40.035302 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 284/563] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:13:40.046196 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274961a8-d198-41f2-93f1-b5ce6386b054 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:40.063023 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b666072-133e-4b37-b197-7c85e3aff167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:40.063764 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b666072-133e-4b37-b197-7c85e3aff167 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:40.064055 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b666072-133e-4b37-b197-7c85e3aff167 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:40.064335 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b666072-133e-4b37-b197-7c85e3aff167 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:40.065227 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b666072-133e-4b37-b197-7c85e3aff167 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:40.065544 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b666072-133e-4b37-b197-7c85e3aff167 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:40.067012 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b666072-133e-4b37-b197-7c85e3aff167 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:40.088112 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:40.093124 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 280/564] 10.222.0.32 () {56 vars in 1137 bytes} [Wed Jun 1 04:13:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:40.095037 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b666072-133e-4b37-b197-7c85e3aff167 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:40.158508 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274961a8-d198-41f2-93f1-b5ce6386b054 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:40.195493 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42020c2a-f551-4fd8-83c1-86c9d3e7161d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:40.196431 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42020c2a-f551-4fd8-83c1-86c9d3e7161d None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:40.196766 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42020c2a-f551-4fd8-83c1-86c9d3e7161d None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:40.197108 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42020c2a-f551-4fd8-83c1-86c9d3e7161d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:40.205656 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b666072-133e-4b37-b197-7c85e3aff167 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:40.208824 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42020c2a-f551-4fd8-83c1-86c9d3e7161d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:40.217420 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-42020c2a-f551-4fd8-83c1-86c9d3e7161d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:13:40.217420 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:40.217420 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:40.217420 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:40.217420 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:40.217420 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:40.217420 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:40.217420 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:40.217420 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:40.217420 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:40.217420 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:40.217420 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:40.217420 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:40.217420 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:40.217420 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:40.217420 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:40.218408 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:40.218408 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:40.218408 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:40.218408 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:40.218408 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:40.218408 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:40.218408 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:40.218408 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:40.218408 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:40.218408 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:40.218408 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:40.218408 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:40.218408 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:40.218408 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:40.218408 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:40.218408 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:40.219232 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:40.219232 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:40.219232 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:40.219232 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:40.219232 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:40.219232 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:40.219232 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:40.219232 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:40.219232 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:40.219232 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:40.219232 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:13:40.219232 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:40.225062 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 285/565] 10.222.0.32 () {56 vars in 1102 bytes} [Wed Jun 1 04:13:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:40.225062 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42020c2a-f551-4fd8-83c1-86c9d3e7161d None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:40.242771 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77214a-16b3-4972-88fb-8b4bbf386813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:40.243825 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77214a-16b3-4972-88fb-8b4bbf386813 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:40.244106 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77214a-16b3-4972-88fb-8b4bbf386813 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:40.244379 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77214a-16b3-4972-88fb-8b4bbf386813 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:40.251919 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:40.253590 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77214a-16b3-4972-88fb-8b4bbf386813 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:40.255432 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77214a-16b3-4972-88fb-8b4bbf386813 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:40.273432 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-af77214a-16b3-4972-88fb-8b4bbf386813 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:13:40.273432 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:40.273432 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:40.273432 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:40.273432 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:40.273432 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:40.273432 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:40.273432 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:40.273432 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:40.273432 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:40.273432 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:40.273432 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:40.273432 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 04:13:40.273432 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 04:13:40.273432 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 04:13:40.274395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 04:13:40.274395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:40.274395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:40.274395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:40.274395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:40.274395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:40.274395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:40.274395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:40.274395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:40.274395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:40.274395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:40.274395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:40.274395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:40.274395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:40.274395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:40.274395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:40.274395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:40.280547 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 04:13:40.280547 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 04:13:40.280547 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 04:13:40.280547 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 04:13:40.280547 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 04:13:40.280547 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 04:13:40.280547 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:13:40.280547 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:40.280547 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 281/566] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:13:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:40.280547 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77214a-16b3-4972-88fb-8b4bbf386813 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:40.333358 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42020c2a-f551-4fd8-83c1-86c9d3e7161d None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:40.343694 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:40.369185 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ea020-0c1c-4a66-a5e2-190453d00271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:40.370003 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ea020-0c1c-4a66-a5e2-190453d00271 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:40.370288 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ea020-0c1c-4a66-a5e2-190453d00271 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:40.370568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ea020-0c1c-4a66-a5e2-190453d00271 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:40.381728 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ea020-0c1c-4a66-a5e2-190453d00271 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:40.388290 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77214a-16b3-4972-88fb-8b4bbf386813 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:40.389522 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-807ea020-0c1c-4a66-a5e2-190453d00271 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:13:40.389522 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:40.389522 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:40.389522 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:40.389522 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:40.389522 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:40.389522 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:40.389522 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:40.389522 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:40.389522 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:40.389522 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:40.389522 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:40.389522 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:40.389522 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:40.389522 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:40.389522 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:40.390438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:40.390438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:40.390438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:40.390438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:40.390438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:40.390438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:40.390438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:40.390438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:40.390438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:40.390438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:40.390438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:40.390438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:40.390438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:40.390438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:40.390438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:40.390438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:40.391272 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:40.391272 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:40.391272 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:40.391272 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:40.391272 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:40.391272 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:40.391272 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:40.391272 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:40.391272 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:40.391272 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:40.391272 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:13:40.391272 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:40.391272 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 286/567] 10.222.0.32 () {56 vars in 1102 bytes} [Wed Jun 1 04:13:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:40.391985 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ea020-0c1c-4a66-a5e2-190453d00271 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:40.424263 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43566c3-6947-44db-8d42-852bf27d4de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:40.425053 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43566c3-6947-44db-8d42-852bf27d4de1 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:40.425335 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43566c3-6947-44db-8d42-852bf27d4de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:40.425638 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43566c3-6947-44db-8d42-852bf27d4de1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:40.436591 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43566c3-6947-44db-8d42-852bf27d4de1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:40.438071 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43566c3-6947-44db-8d42-852bf27d4de1 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:40.455634 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-d43566c3-6947-44db-8d42-852bf27d4de1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:40.455634 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:40.455634 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:40.455634 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:40.455634 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:40.455634 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:40.455634 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:40.455634 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:40.455634 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:40.455634 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:40.455634 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:40.455634 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:40.455634 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:13:40.455634 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:13:40.455634 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:13:40.456715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:13:40.456715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:40.456715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:40.456715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:40.456715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:40.456715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:40.456715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:40.456715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:40.456715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:40.456715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:40.456715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:40.456715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:40.456715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:40.456715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:40.456715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:40.456715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:40.456715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:40.458059 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:13:40.458059 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:13:40.458059 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:40.458059 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:40.458059 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 282/568] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:40.458059 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43566c3-6947-44db-8d42-852bf27d4de1 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:40.481996 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:40.499143 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ea020-0c1c-4a66-a5e2-190453d00271 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:40.532201 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23cdf0-80ad-4eaa-afca-eed12d22243b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:40.532861 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23cdf0-80ad-4eaa-afca-eed12d22243b None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:40.533142 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23cdf0-80ad-4eaa-afca-eed12d22243b None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:40.533416 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23cdf0-80ad-4eaa-afca-eed12d22243b None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:40.534189 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de23cdf0-80ad-4eaa-afca-eed12d22243b None admin] RBAC: Adding query filter params (name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:40.534499 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de23cdf0-80ad-4eaa-afca-eed12d22243b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:40.535853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de23cdf0-80ad-4eaa-afca-eed12d22243b None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:40.544507 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 287/569] 10.222.0.32 () {56 vars in 1103 bytes} [Wed Jun 1 04:13:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:40.545754 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf46322-93e1-4242-99ed-118a35d4424c None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:40.546072 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf46322-93e1-4242-99ed-118a35d4424c None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:40.546362 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf46322-93e1-4242-99ed-118a35d4424c None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:40.547583 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 288/570] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:40.548280 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf46322-93e1-4242-99ed-118a35d4424c None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:40.558320 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43566c3-6947-44db-8d42-852bf27d4de1 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:40.571180 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:40.591590 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605da92-6ad7-42d0-87f2-48ddbeba5724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:40.592248 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605da92-6ad7-42d0-87f2-48ddbeba5724 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:40.592531 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605da92-6ad7-42d0-87f2-48ddbeba5724 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:40.592809 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605da92-6ad7-42d0-87f2-48ddbeba5724 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:40.593589 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0605da92-6ad7-42d0-87f2-48ddbeba5724 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:40.593897 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0605da92-6ad7-42d0-87f2-48ddbeba5724 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:40.595352 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0605da92-6ad7-42d0-87f2-48ddbeba5724 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:40.607994 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 283/571] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Jun 1 04:13:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:40.608834 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605da92-6ad7-42d0-87f2-48ddbeba5724 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:40.667406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf46322-93e1-4242-99ed-118a35d4424c None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:40.700647 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c76453-7f92-4ff2-88f9-f2ea089ec5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:40.701304 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c76453-7f92-4ff2-88f9-f2ea089ec5f7 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:40.701595 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c76453-7f92-4ff2-88f9-f2ea089ec5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:40.701868 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c76453-7f92-4ff2-88f9-f2ea089ec5f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:40.702631 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c76453-7f92-4ff2-88f9-f2ea089ec5f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:40.702933 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c76453-7f92-4ff2-88f9-f2ea089ec5f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:40.704290 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c76453-7f92-4ff2-88f9-f2ea089ec5f7 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:40.710805 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605da92-6ad7-42d0-87f2-48ddbeba5724 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:40.713184 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 289/572] 10.222.0.32 () {56 vars in 1103 bytes} [Wed Jun 1 04:13:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:40.714156 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c76453-7f92-4ff2-88f9-f2ea089ec5f7 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:40.727672 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:40.748621 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337ce26-5d4c-4b46-bb8f-b1a161e5d12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:40.749290 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337ce26-5d4c-4b46-bb8f-b1a161e5d12b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:40.749570 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337ce26-5d4c-4b46-bb8f-b1a161e5d12b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:40.749846 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337ce26-5d4c-4b46-bb8f-b1a161e5d12b None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:40.750601 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337ce26-5d4c-4b46-bb8f-b1a161e5d12b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:40.750903 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337ce26-5d4c-4b46-bb8f-b1a161e5d12b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:40.752279 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337ce26-5d4c-4b46-bb8f-b1a161e5d12b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:40.763895 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 284/573] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:40.765283 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f83b7e-5c5c-4f1c-8696-87a6821dc324 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:40.765576 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f83b7e-5c5c-4f1c-8696-87a6821dc324 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:40.765854 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f83b7e-5c5c-4f1c-8696-87a6821dc324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:40.782263 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d4f83b7e-5c5c-4f1c-8696-87a6821dc324 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:40.783463 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d4f83b7e-5c5c-4f1c-8696-87a6821dc324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:40.810079 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:40.823114 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c76453-7f92-4ff2-88f9-f2ea089ec5f7 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:40.851478 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 285/574] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:13:40.852079 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f83b7e-5c5c-4f1c-8696-87a6821dc324 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:40.872076 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d62b2-3714-4f13-a83f-90ea4846c292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:40.873040 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d62b2-3714-4f13-a83f-90ea4846c292 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:40.873322 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d62b2-3714-4f13-a83f-90ea4846c292 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:40.873603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d62b2-3714-4f13-a83f-90ea4846c292 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:40.884623 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7d62b2-3714-4f13-a83f-90ea4846c292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:40.886089 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7d62b2-3714-4f13-a83f-90ea4846c292 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:40.902817 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-6f7d62b2-3714-4f13-a83f-90ea4846c292 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:40.902817 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:40.902817 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:40.902817 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:40.902817 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:40.902817 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:40.902817 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:40.902817 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:40.902817 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:40.902817 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:40.902817 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:40.902817 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:40.902817 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:13:40.902817 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:13:40.902817 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:13:40.903916 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:13:40.903916 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:40.903916 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:40.903916 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:40.903916 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:40.903916 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:40.903916 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:40.903916 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:40.903916 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:40.903916 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:40.903916 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:40.903916 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:40.903916 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:40.903916 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:40.903916 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:40.903916 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:40.903916 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:40.904815 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:13:40.904815 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:13:40.904815 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:40.904815 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:40.904815 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 290/575] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:40.904815 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d62b2-3714-4f13-a83f-90ea4846c292 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:40.957524 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f83b7e-5c5c-4f1c-8696-87a6821dc324 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:40.964670 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:40.992590 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba1260-4604-4b2e-9585-925e6c8141e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:40.993243 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba1260-4604-4b2e-9585-925e6c8141e3 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:40.993525 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba1260-4604-4b2e-9585-925e6c8141e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:40.993801 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba1260-4604-4b2e-9585-925e6c8141e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:40.994652 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba1260-4604-4b2e-9585-925e6c8141e3 None admin] RBAC: Adding query filter params (role.id=5e94b8f2c0b1418e8d2a18e4fe08d4f9, scope.project.id=31d68f64d21647688074554062952074, user.id=413c6613b4ec4e53aeeaf6828c807273) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:40.994989 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba1260-4604-4b2e-9585-925e6c8141e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:40.996442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba1260-4604-4b2e-9585-925e6c8141e3 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:41.002039 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 286/576] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:13:40 2022] GET /identity/v3/role_assignments?user.id=413c6613b4ec4e53aeeaf6828c807273&scope.project.id=31d68f64d21647688074554062952074&role.id=5e94b8f2c0b1418e8d2a18e4fe08d4f9 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:41.002758 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba1260-4604-4b2e-9585-925e6c8141e3 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:41.005873 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d62b2-3714-4f13-a83f-90ea4846c292 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:41.042455 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:41.047590 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5326c9-8029-4f79-8301-d5e1e0312d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:41.048409 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5326c9-8029-4f79-8301-d5e1e0312d47 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:41.048693 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5326c9-8029-4f79-8301-d5e1e0312d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:41.048968 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5326c9-8029-4f79-8301-d5e1e0312d47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:41.061860 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5326c9-8029-4f79-8301-d5e1e0312d47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:41.063296 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5326c9-8029-4f79-8301-d5e1e0312d47 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:41.082685 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-eb5326c9-8029-4f79-8301-d5e1e0312d47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:41.082685 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:41.082685 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:41.082685 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:41.082685 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:41.082685 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:41.082685 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:41.082685 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:41.082685 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:41.082685 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:41.082685 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:41.082685 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:41.082685 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:13:41.082685 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:13:41.082685 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:13:41.083759 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:13:41.083759 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:41.083759 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:41.083759 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:41.083759 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:41.083759 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:41.083759 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:41.083759 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:41.083759 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:41.083759 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:41.083759 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:41.083759 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:41.083759 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:41.083759 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:41.083759 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:41.083759 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:41.083759 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:41.084649 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:13:41.084649 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:13:41.084649 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:41.084649 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:41.084649 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 291/577] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:41.084930 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5326c9-8029-4f79-8301-d5e1e0312d47 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:41.140565 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba1260-4604-4b2e-9585-925e6c8141e3 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:41.183586 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd252c6-5662-49ae-83bc-075a90886149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:41.184147 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd252c6-5662-49ae-83bc-075a90886149 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:41.184427 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd252c6-5662-49ae-83bc-075a90886149 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:41.184701 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd252c6-5662-49ae-83bc-075a90886149 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:41.192483 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd252c6-5662-49ae-83bc-075a90886149 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:41.194807 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd252c6-5662-49ae-83bc-075a90886149 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:41.209357 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-efd252c6-5662-49ae-83bc-075a90886149 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:13:41.209357 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:41.209357 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:41.209357 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:41.209357 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:41.209357 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:41.209357 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:41.209357 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:41.209357 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:41.209357 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:41.209357 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:41.209357 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:41.209357 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 04:13:41.209357 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 04:13:41.209357 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 04:13:41.210319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 04:13:41.210319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:41.210319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:41.210319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:41.210319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:41.210319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:41.210319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:41.210319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:41.210319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:41.210319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:41.210319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:41.210319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:41.210319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:41.210319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:41.210319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:41.210319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:41.210319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:41.217713 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 04:13:41.217713 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 04:13:41.217713 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 04:13:41.217713 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 04:13:41.217713 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 04:13:41.217713 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 04:13:41.217713 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:13:41.217713 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:41.217713 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 287/578] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:13:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:41.217713 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd252c6-5662-49ae-83bc-075a90886149 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:41.240431 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5326c9-8029-4f79-8301-d5e1e0312d47 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:41.255192 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:41.279434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f012cdd-841d-4c81-8ad6-46a0eca5365f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:41.280247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f012cdd-841d-4c81-8ad6-46a0eca5365f None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:41.280526 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f012cdd-841d-4c81-8ad6-46a0eca5365f None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:41.280794 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f012cdd-841d-4c81-8ad6-46a0eca5365f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:41.292300 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f012cdd-841d-4c81-8ad6-46a0eca5365f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:41.300359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-4f012cdd-841d-4c81-8ad6-46a0eca5365f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:13:41.300359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:41.300359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:41.300359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:41.300359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:41.300359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:41.300359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:41.300359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:41.300359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:41.300359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:41.300359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:41.300359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:41.300359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:41.300359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:41.300359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:41.300359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:41.306987 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:41.306987 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:41.306987 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:41.306987 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:41.306987 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:41.306987 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:41.306987 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:41.306987 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:41.306987 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:41.306987 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:41.306987 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:41.306987 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:41.306987 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:41.306987 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:41.306987 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:41.306987 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:41.308026 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:41.308026 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:41.308026 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:41.308026 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:41.308026 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:41.308026 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:41.308026 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:41.308026 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:41.308026 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:41.308026 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:41.308026 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:13:41.308026 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:41.308026 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 292/579] 10.222.0.32 () {56 vars in 1102 bytes} [Wed Jun 1 04:13:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:41.308026 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f012cdd-841d-4c81-8ad6-46a0eca5365f None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:41.325895 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:41.342643 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd252c6-5662-49ae-83bc-075a90886149 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:41.381003 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc40b08-0955-4faa-bd8b-07768b77323b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:41.381906 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc40b08-0955-4faa-bd8b-07768b77323b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:41.382228 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc40b08-0955-4faa-bd8b-07768b77323b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:41.382510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc40b08-0955-4faa-bd8b-07768b77323b None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:41.383249 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc40b08-0955-4faa-bd8b-07768b77323b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:41.383557 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc40b08-0955-4faa-bd8b-07768b77323b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:41.384965 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc40b08-0955-4faa-bd8b-07768b77323b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:41.398403 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 288/580] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:41.403449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc40b08-0955-4faa-bd8b-07768b77323b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:41.416566 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f012cdd-841d-4c81-8ad6-46a0eca5365f None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:41.453332 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd563ad8-5461-4213-9822-0b640e5b3c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:41.454018 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd563ad8-5461-4213-9822-0b640e5b3c06 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:41.454310 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd563ad8-5461-4213-9822-0b640e5b3c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:41.454586 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd563ad8-5461-4213-9822-0b640e5b3c06 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:41.455809 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd563ad8-5461-4213-9822-0b640e5b3c06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:41.456134 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd563ad8-5461-4213-9822-0b640e5b3c06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:41.457515 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd563ad8-5461-4213-9822-0b640e5b3c06 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:41.475876 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 293/581] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:41.475876 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd563ad8-5461-4213-9822-0b640e5b3c06 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:41.504457 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:41.531059 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc40b08-0955-4faa-bd8b-07768b77323b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:41.574855 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f913b88-482e-4dd5-8145-f55f376d6c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:41.575523 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f913b88-482e-4dd5-8145-f55f376d6c12 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:41.575803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f913b88-482e-4dd5-8145-f55f376d6c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:41.576075 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f913b88-482e-4dd5-8145-f55f376d6c12 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:41.576852 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f913b88-482e-4dd5-8145-f55f376d6c12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:41.577392 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f913b88-482e-4dd5-8145-f55f376d6c12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:41.578631 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f913b88-482e-4dd5-8145-f55f376d6c12 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:41.583478 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd563ad8-5461-4213-9822-0b640e5b3c06 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:41.591346 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 289/582] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Jun 1 04:13:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:41.592162 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f913b88-482e-4dd5-8145-f55f376d6c12 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:41.601755 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:41.628337 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d992d4-82d8-4d48-b611-358250f7547f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:41.629015 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d992d4-82d8-4d48-b611-358250f7547f None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:41.629302 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d992d4-82d8-4d48-b611-358250f7547f None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:41.629613 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d992d4-82d8-4d48-b611-358250f7547f None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:41.630359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d992d4-82d8-4d48-b611-358250f7547f None admin] RBAC: Adding query filter params (name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:41.631843 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d992d4-82d8-4d48-b611-358250f7547f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:41.632574 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d992d4-82d8-4d48-b611-358250f7547f None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:41.641303 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 294/583] 10.222.0.32 () {56 vars in 1103 bytes} [Wed Jun 1 04:13:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:41.642096 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d992d4-82d8-4d48-b611-358250f7547f None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:41.713191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f913b88-482e-4dd5-8145-f55f376d6c12 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:41.746845 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:41.753343 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f706e-f8d5-4ea1-b248-f19c185d3fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:41.754201 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f706e-f8d5-4ea1-b248-f19c185d3fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:41.754489 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f706e-f8d5-4ea1-b248-f19c185d3fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:41.754781 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f706e-f8d5-4ea1-b248-f19c185d3fb1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:41.756228 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d992d4-82d8-4d48-b611-358250f7547f None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:41.765328 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8f706e-f8d5-4ea1-b248-f19c185d3fb1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:41.767149 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8f706e-f8d5-4ea1-b248-f19c185d3fb1 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:41.784526 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-bf8f706e-f8d5-4ea1-b248-f19c185d3fb1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 01 04:13:41.784526 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:41.784526 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:41.784526 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:41.784526 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:41.784526 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:41.784526 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:41.784526 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:41.784526 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:41.784526 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:41.784526 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:41.784526 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:41.784526 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 04:13:41.784526 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 04:13:41.784526 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 04:13:41.784526 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 04:13:41.785698 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:41.785698 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:41.785698 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 04:13:41.785698 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:13:41.785698 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 04:13:41.785698 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:13:41.785698 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:41.785698 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:41.785698 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:41.785698 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:41.785698 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:41.785698 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:41.785698 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:41.785698 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:41.785698 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:41.785698 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:41.785698 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:41.785698 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:41.786905 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:41.786905 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:41.786905 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 04:13:41.786905 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 04:13:41.786905 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 04:13:41.786905 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 04:13:41.786905 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 04:13:41.786905 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 04:13:41.786905 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 01 04:13:41.786905 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:41.792784 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 290/584] 10.222.0.32 () {56 vars in 1093 bytes} [Wed Jun 1 04:13:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:41.792784 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f706e-f8d5-4ea1-b248-f19c185d3fb1 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:41.811217 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492cde6-2922-4842-be72-6dd07974a122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:41.812280 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492cde6-2922-4842-be72-6dd07974a122 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:41.812965 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492cde6-2922-4842-be72-6dd07974a122 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:41.813254 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492cde6-2922-4842-be72-6dd07974a122 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:41.823205 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492cde6-2922-4842-be72-6dd07974a122 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:41.824726 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492cde6-2922-4842-be72-6dd07974a122 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:41.842234 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-6492cde6-2922-4842-be72-6dd07974a122 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 01 04:13:41.842234 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:41.842234 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:41.842234 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:41.842234 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:41.842234 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:41.842234 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:41.842234 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:41.842234 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:41.842234 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:41.842234 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:41.842234 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:41.842234 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 04:13:41.842234 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 04:13:41.842234 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 04:13:41.842234 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 04:13:41.843223 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:41.843223 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:41.843223 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 04:13:41.843223 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:13:41.843223 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 04:13:41.843223 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:13:41.843223 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:41.843223 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:41.843223 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:41.843223 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:41.843223 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:41.843223 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:41.843223 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:41.843223 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:41.843223 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:41.843223 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:41.843223 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:41.843223 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:41.844165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:41.844165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:41.844165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 04:13:41.844165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 04:13:41.844165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 04:13:41.844165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 04:13:41.844165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 04:13:41.844165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 04:13:41.844165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 01 04:13:41.844165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:41.844165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 295/585] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:13:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:41.844764 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492cde6-2922-4842-be72-6dd07974a122 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:41.875091 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:41.921373 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f706e-f8d5-4ea1-b248-f19c185d3fb1 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:41.962927 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e81650-eeb3-444b-8c32-ef5809809137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:41.963852 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e81650-eeb3-444b-8c32-ef5809809137 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:41.964160 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e81650-eeb3-444b-8c32-ef5809809137 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:41.964416 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e81650-eeb3-444b-8c32-ef5809809137 None admin] PATH_INFO: `/v3/projects/31d68f64d21647688074554062952074/users/7ac83171b9284163a71cc729cef076f0/roles/5e94b8f2c0b1418e8d2a18e4fe08d4f9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:41.976238 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492cde6-2922-4842-be72-6dd07974a122 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:41.984144 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e81650-eeb3-444b-8c32-ef5809809137 None admin] RBAC: Authorizing `identity:create_grant(project_id=31d68f64d21647688074554062952074, user_id=7ac83171b9284163a71cc729cef076f0, role_id=5e94b8f2c0b1418e8d2a18e4fe08d4f9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:41.986889 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e81650-eeb3-444b-8c32-ef5809809137 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:42.004131 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 291/586] 10.222.0.32 () {58 vars in 1439 bytes} [Wed Jun 1 04:13:41 2022] PUT /identity/v3/projects/31d68f64d21647688074554062952074/users/7ac83171b9284163a71cc729cef076f0/roles/5e94b8f2c0b1418e8d2a18e4fe08d4f9 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:13:42.005297 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e81650-eeb3-444b-8c32-ef5809809137 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:42.030928 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0a9af-cb42-4255-8f30-529b74670e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:42.032284 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0a9af-cb42-4255-8f30-529b74670e8d None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:42.032879 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0a9af-cb42-4255-8f30-529b74670e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:42.033398 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0a9af-cb42-4255-8f30-529b74670e8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:42.047336 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0a9af-cb42-4255-8f30-529b74670e8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:42.049462 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0a9af-cb42-4255-8f30-529b74670e8d None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:42.071315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-3dd0a9af-cb42-4255-8f30-529b74670e8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:42.071315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:42.071315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:42.071315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:42.071315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:42.071315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:42.071315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:42.071315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:42.071315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:42.071315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:42.071315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:42.071315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:42.071315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:13:42.071315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:13:42.071315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:13:42.072287 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:13:42.072287 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:42.072287 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:42.072287 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:42.072287 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:42.072287 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:42.072287 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:42.072287 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:42.072287 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:42.072287 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:42.072287 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:42.072287 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:42.072287 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:42.072287 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:42.072287 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:42.072287 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:42.072287 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:42.073173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:13:42.073173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:13:42.073173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:42.073173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:42.075697 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 296/587] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:42.076893 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0a9af-cb42-4255-8f30-529b74670e8d None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:42.091835 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:42.146189 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e81650-eeb3-444b-8c32-ef5809809137 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:42.183057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:42.221684 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d5dcc-e9f1-4730-930c-8e365d59fb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:42.223425 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d5dcc-e9f1-4730-930c-8e365d59fb87 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:42.224802 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d5dcc-e9f1-4730-930c-8e365d59fb87 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:42.225483 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d5dcc-e9f1-4730-930c-8e365d59fb87 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:42.227528 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d5dcc-e9f1-4730-930c-8e365d59fb87 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:42.228496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d5dcc-e9f1-4730-930c-8e365d59fb87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:42.231906 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d5dcc-e9f1-4730-930c-8e365d59fb87 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:42.234649 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0a9af-cb42-4255-8f30-529b74670e8d None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:42.260508 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 292/588] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Jun 1 04:13:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:42.261387 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d5dcc-e9f1-4730-930c-8e365d59fb87 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:42.290593 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df28b5-ddc6-4141-8d21-d02c7e39618d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:42.291415 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df28b5-ddc6-4141-8d21-d02c7e39618d None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:42.291874 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df28b5-ddc6-4141-8d21-d02c7e39618d None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:42.291979 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df28b5-ddc6-4141-8d21-d02c7e39618d None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:42.292917 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df28b5-ddc6-4141-8d21-d02c7e39618d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:42.293499 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df28b5-ddc6-4141-8d21-d02c7e39618d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:42.294756 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df28b5-ddc6-4141-8d21-d02c7e39618d None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:42.319014 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 297/589] 10.222.0.32 () {56 vars in 1137 bytes} [Wed Jun 1 04:13:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:42.320376 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df28b5-ddc6-4141-8d21-d02c7e39618d None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:42.385148 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d5dcc-e9f1-4730-930c-8e365d59fb87 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:42.393440 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:42.435005 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df28b5-ddc6-4141-8d21-d02c7e39618d None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:42.439320 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466ff4a-9ef9-4cd6-be53-210a6a435e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:42.440423 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466ff4a-9ef9-4cd6-be53-210a6a435e42 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:42.440910 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466ff4a-9ef9-4cd6-be53-210a6a435e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:42.441381 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466ff4a-9ef9-4cd6-be53-210a6a435e42 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:42.442385 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466ff4a-9ef9-4cd6-be53-210a6a435e42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:42.443654 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466ff4a-9ef9-4cd6-be53-210a6a435e42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:42.446768 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466ff4a-9ef9-4cd6-be53-210a6a435e42 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:42.466119 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 293/590] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:42.467598 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466ff4a-9ef9-4cd6-be53-210a6a435e42 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:42.473303 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b6f29-5664-4071-bdf5-c9b093762188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:42.474139 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b6f29-5664-4071-bdf5-c9b093762188 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:42.475047 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b6f29-5664-4071-bdf5-c9b093762188 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:42.475329 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b6f29-5664-4071-bdf5-c9b093762188 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:42.486788 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b6f29-5664-4071-bdf5-c9b093762188 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:42.488341 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b6f29-5664-4071-bdf5-c9b093762188 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:42.507115 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-c42b6f29-5664-4071-bdf5-c9b093762188 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:42.507115 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:42.507115 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:42.507115 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:42.507115 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:42.507115 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:42.507115 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:42.507115 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:42.507115 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:42.507115 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:42.507115 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:42.507115 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:42.507115 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:13:42.507115 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:13:42.507115 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:13:42.508621 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:13:42.508621 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:42.508621 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:42.508621 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:42.508621 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:42.508621 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:42.508621 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:42.508621 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:42.508621 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:42.508621 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:42.508621 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:42.508621 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:42.508621 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:42.508621 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:42.508621 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:42.508621 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:42.508621 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:42.509492 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:13:42.509492 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:13:42.509492 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:42.509492 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:42.512939 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 298/591] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:42.513850 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b6f29-5664-4071-bdf5-c9b093762188 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:42.518718 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:42.623257 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b6f29-5664-4071-bdf5-c9b093762188 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:42.636590 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466ff4a-9ef9-4cd6-be53-210a6a435e42 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:42.641466 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:42.661483 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f403e0-ab76-4676-a1cb-1d0b0909b600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:42.662966 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f403e0-ab76-4676-a1cb-1d0b0909b600 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:42.663354 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f403e0-ab76-4676-a1cb-1d0b0909b600 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:42.663679 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f403e0-ab76-4676-a1cb-1d0b0909b600 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:42.671767 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f403e0-ab76-4676-a1cb-1d0b0909b600 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:42.673250 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f403e0-ab76-4676-a1cb-1d0b0909b600 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:42.689199 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-67f403e0-ab76-4676-a1cb-1d0b0909b600 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 01 04:13:42.689199 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:42.689199 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:42.689199 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:42.689199 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:42.689199 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:42.689199 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:42.689199 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:42.689199 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:42.689199 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:42.689199 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:42.689199 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:42.689199 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 04:13:42.689199 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 04:13:42.689199 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 04:13:42.689199 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 04:13:42.691061 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:42.691061 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:42.691061 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 04:13:42.691061 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:13:42.691061 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 04:13:42.691061 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:13:42.691061 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:42.691061 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:42.691061 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:42.691061 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:42.691061 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:42.691061 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:42.691061 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:42.691061 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:42.691061 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:42.691061 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:42.691061 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:42.691061 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:42.692883 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:42.692883 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:42.692883 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 04:13:42.692883 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 04:13:42.692883 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 04:13:42.692883 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 04:13:42.692883 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 04:13:42.692883 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 04:13:42.692883 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 01 04:13:42.692883 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:42.695340 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 299/592] 10.222.0.32 () {56 vars in 1102 bytes} [Wed Jun 1 04:13:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:42.696219 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f403e0-ab76-4676-a1cb-1d0b0909b600 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:42.716130 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d52eeb-d11c-49d3-966c-04620fba9e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:42.717614 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d52eeb-d11c-49d3-966c-04620fba9e16 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:42.718399 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d52eeb-d11c-49d3-966c-04620fba9e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:42.718887 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d52eeb-d11c-49d3-966c-04620fba9e16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:42.736860 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d52eeb-d11c-49d3-966c-04620fba9e16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:42.739460 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d52eeb-d11c-49d3-966c-04620fba9e16 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:42.766110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-16d52eeb-d11c-49d3-966c-04620fba9e16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:42.766110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:42.766110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:42.766110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:42.766110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:42.766110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:42.766110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:42.766110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:42.766110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:42.766110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:42.766110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:42.766110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:42.766110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:13:42.766110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:13:42.766110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:13:42.767094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:13:42.767094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:42.767094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:42.767094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:42.767094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:42.767094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:42.767094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:42.767094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:42.767094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:42.767094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:42.767094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:42.767094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:42.767094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:42.767094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:42.767094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:42.767094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:42.767094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:42.767987 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:13:42.767987 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:13:42.767987 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:42.767987 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:42.775722 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 294/593] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:42.775722 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d52eeb-d11c-49d3-966c-04620fba9e16 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:42.834642 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f403e0-ab76-4676-a1cb-1d0b0909b600 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:42.877066 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:42.887719 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e081d-b424-4136-8ba4-d7d90537f57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:42.889006 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e081d-b424-4136-8ba4-d7d90537f57b None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:42.889785 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e081d-b424-4136-8ba4-d7d90537f57b None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:42.890705 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e081d-b424-4136-8ba4-d7d90537f57b None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:42.891930 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e081d-b424-4136-8ba4-d7d90537f57b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:42.892456 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e081d-b424-4136-8ba4-d7d90537f57b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:42.893300 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d52eeb-d11c-49d3-966c-04620fba9e16 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:42.894326 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e081d-b424-4136-8ba4-d7d90537f57b None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:42.917334 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 300/594] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:42.918328 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e081d-b424-4136-8ba4-d7d90537f57b None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:42.943913 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a567f-0db7-42b5-90ed-ba04bf89298a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:42.945481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a567f-0db7-42b5-90ed-ba04bf89298a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:42.946290 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a567f-0db7-42b5-90ed-ba04bf89298a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:42.946817 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a567f-0db7-42b5-90ed-ba04bf89298a None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:42.948574 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a567f-0db7-42b5-90ed-ba04bf89298a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:42.949392 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a567f-0db7-42b5-90ed-ba04bf89298a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:42.951908 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a567f-0db7-42b5-90ed-ba04bf89298a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:42.959832 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:42.982733 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 295/595] 10.222.0.32 () {56 vars in 1139 bytes} [Wed Jun 1 04:13:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:42.984000 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a567f-0db7-42b5-90ed-ba04bf89298a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:43.050849 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e081d-b424-4136-8ba4-d7d90537f57b None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:43.104099 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1baa7e-d4a6-403f-8961-5ae4ffe14e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:43.105495 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1baa7e-d4a6-403f-8961-5ae4ffe14e62 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:43.106063 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1baa7e-d4a6-403f-8961-5ae4ffe14e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:43.106824 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1baa7e-d4a6-403f-8961-5ae4ffe14e62 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:43.108486 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1baa7e-d4a6-403f-8961-5ae4ffe14e62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:43.109103 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1baa7e-d4a6-403f-8961-5ae4ffe14e62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:43.111012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1baa7e-d4a6-403f-8961-5ae4ffe14e62 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:43.126805 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a567f-0db7-42b5-90ed-ba04bf89298a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:43.130200 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 301/596] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:43.131360 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1baa7e-d4a6-403f-8961-5ae4ffe14e62 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:43.181166 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892bdfd6-9906-4f65-ae7d-25b8b9069344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:43.183001 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bdfd6-9906-4f65-ae7d-25b8b9069344 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:43.183458 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bdfd6-9906-4f65-ae7d-25b8b9069344 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:43.183889 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bdfd6-9906-4f65-ae7d-25b8b9069344 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:43.193559 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892bdfd6-9906-4f65-ae7d-25b8b9069344 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:43.195718 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892bdfd6-9906-4f65-ae7d-25b8b9069344 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:43.215936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-892bdfd6-9906-4f65-ae7d-25b8b9069344 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:13:43.215936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:43.215936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:43.215936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:43.215936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:43.215936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:43.215936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:43.215936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:43.215936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:43.215936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:43.215936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:43.215936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:43.215936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 04:13:43.215936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 04:13:43.215936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 04:13:43.216989 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 04:13:43.216989 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:43.216989 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:43.216989 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:43.216989 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:43.216989 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:43.216989 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:43.216989 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:43.216989 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:43.216989 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:43.216989 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:43.216989 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:43.216989 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:43.216989 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:43.216989 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:43.216989 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:43.216989 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:43.217876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 04:13:43.217876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 04:13:43.217876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 04:13:43.217876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 04:13:43.217876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 04:13:43.217876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 04:13:43.217876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:13:43.217876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:43.225016 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 296/597] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:13:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:43.225016 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892bdfd6-9906-4f65-ae7d-25b8b9069344 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:43.235066 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:43.275849 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:43.284552 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1baa7e-d4a6-403f-8961-5ae4ffe14e62 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:43.333614 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc58a1-dab5-46aa-96c0-7b7dc5de1fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:43.335568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc58a1-dab5-46aa-96c0-7b7dc5de1fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:43.336196 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc58a1-dab5-46aa-96c0-7b7dc5de1fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:43.337201 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc58a1-dab5-46aa-96c0-7b7dc5de1fb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:43.350865 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc58a1-dab5-46aa-96c0-7b7dc5de1fb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:43.353113 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc58a1-dab5-46aa-96c0-7b7dc5de1fb8 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:43.368517 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892bdfd6-9906-4f65-ae7d-25b8b9069344 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:43.375244 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-eabc58a1-dab5-46aa-96c0-7b7dc5de1fb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:43.375244 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:43.375244 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:43.375244 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:43.375244 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:43.375244 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:43.375244 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:43.375244 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:43.375244 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:43.375244 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:43.375244 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:43.375244 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:43.375244 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:13:43.375244 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:13:43.375244 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:13:43.376708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:13:43.376708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:43.376708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:43.376708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:43.376708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:43.376708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:43.376708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:43.376708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:43.376708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:43.376708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:43.376708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:43.376708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:43.376708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:43.376708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:43.376708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:43.376708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:43.376708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:43.378761 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:13:43.378761 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:13:43.378761 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:43.378761 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:43.378761 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 302/598] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:43.378761 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc58a1-dab5-46aa-96c0-7b7dc5de1fb8 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:43.422698 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ab1f1-964d-4782-a873-6e658c507b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:43.423424 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ab1f1-964d-4782-a873-6e658c507b28 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:43.423711 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ab1f1-964d-4782-a873-6e658c507b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:43.424147 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ab1f1-964d-4782-a873-6e658c507b28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:43.431955 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ab1f1-964d-4782-a873-6e658c507b28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:43.433415 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ab1f1-964d-4782-a873-6e658c507b28 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:43.449537 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-b16ab1f1-964d-4782-a873-6e658c507b28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:13:43.449537 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:43.449537 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:43.449537 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:43.449537 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:43.449537 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:43.449537 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:43.449537 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:43.449537 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:43.449537 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:43.449537 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:43.449537 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:43.449537 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 04:13:43.449537 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 04:13:43.449537 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 04:13:43.450675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 04:13:43.450675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:43.450675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:43.450675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:43.450675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:43.450675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:43.450675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:43.450675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:43.450675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:43.450675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:43.450675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:43.450675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:43.450675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:43.450675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:43.450675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:43.450675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:43.450675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:43.451631 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 04:13:43.451631 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 04:13:43.451631 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 04:13:43.451631 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 04:13:43.451631 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 04:13:43.451631 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 04:13:43.451631 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:13:43.451631 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:43.451631 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 297/599] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:13:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:43.452737 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00319f-05bb-4d72-8119-fdeef7cfd4aa None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:43.452854 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00319f-05bb-4d72-8119-fdeef7cfd4aa None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:43.453054 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00319f-05bb-4d72-8119-fdeef7cfd4aa None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:43.454472 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 298/600] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:43.458186 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00319f-05bb-4d72-8119-fdeef7cfd4aa None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:43.509725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc58a1-dab5-46aa-96c0-7b7dc5de1fb8 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:43.524885 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:43.546469 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0761d-f681-439b-9820-eabf00c489bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:43.547241 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0761d-f681-439b-9820-eabf00c489bc None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:43.547533 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0761d-f681-439b-9820-eabf00c489bc None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:43.547815 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0761d-f681-439b-9820-eabf00c489bc None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:43.548597 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd0761d-f681-439b-9820-eabf00c489bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:43.548906 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd0761d-f681-439b-9820-eabf00c489bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:43.550362 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd0761d-f681-439b-9820-eabf00c489bc None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:43.563327 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 303/601] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Jun 1 04:13:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:43.569013 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0761d-f681-439b-9820-eabf00c489bc None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:43.571421 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00319f-05bb-4d72-8119-fdeef7cfd4aa None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:43.580829 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:43.607147 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d2fb1-d4f9-49e7-ab77-8cfdb1bb8273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:43.607815 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d2fb1-d4f9-49e7-ab77-8cfdb1bb8273 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:43.608138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d2fb1-d4f9-49e7-ab77-8cfdb1bb8273 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:43.608379 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d2fb1-d4f9-49e7-ab77-8cfdb1bb8273 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:43.609094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d2fb1-d4f9-49e7-ab77-8cfdb1bb8273 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:43.609401 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d2fb1-d4f9-49e7-ab77-8cfdb1bb8273 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:43.610797 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d2fb1-d4f9-49e7-ab77-8cfdb1bb8273 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:43.627234 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 299/602] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:43.627234 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1c1e4-e973-4c9a-b4cb-0115f063708e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:43.627234 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1c1e4-e973-4c9a-b4cb-0115f063708e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:43.627234 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1c1e4-e973-4c9a-b4cb-0115f063708e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:43.641287 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-6fe1c1e4-e973-4c9a-b4cb-0115f063708e None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:43.642506 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6fe1c1e4-e973-4c9a-b4cb-0115f063708e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:43.681073 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0761d-f681-439b-9820-eabf00c489bc None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:43.714009 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 300/603] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:13:43.714009 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1c1e4-e973-4c9a-b4cb-0115f063708e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:43.730984 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af655fa-07d2-4b91-b5ed-cb79f70fee05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:43.731919 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af655fa-07d2-4b91-b5ed-cb79f70fee05 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:43.732346 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af655fa-07d2-4b91-b5ed-cb79f70fee05 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:43.732765 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af655fa-07d2-4b91-b5ed-cb79f70fee05 None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:43.733688 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af655fa-07d2-4b91-b5ed-cb79f70fee05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:43.734234 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af655fa-07d2-4b91-b5ed-cb79f70fee05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:43.735822 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af655fa-07d2-4b91-b5ed-cb79f70fee05 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:43.750288 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 304/604] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Jun 1 04:13:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:43.751466 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af655fa-07d2-4b91-b5ed-cb79f70fee05 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:43.786327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:43.830022 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:43.842178 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1c1e4-e973-4c9a-b4cb-0115f063708e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:43.871331 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af655fa-07d2-4b91-b5ed-cb79f70fee05 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:43.882656 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be641c-2aaa-4be9-b03e-ef1f141cdf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:43.883577 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be641c-2aaa-4be9-b03e-ef1f141cdf66 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:43.883862 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be641c-2aaa-4be9-b03e-ef1f141cdf66 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:43.884126 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be641c-2aaa-4be9-b03e-ef1f141cdf66 None admin] PATH_INFO: `/v3/projects/31d68f64d21647688074554062952074/users/79d614f85f5541d3babbb41468cbf55c/roles/5e94b8f2c0b1418e8d2a18e4fe08d4f9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:43.901152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be641c-2aaa-4be9-b03e-ef1f141cdf66 None admin] RBAC: Authorizing `identity:create_grant(project_id=31d68f64d21647688074554062952074, user_id=79d614f85f5541d3babbb41468cbf55c, role_id=5e94b8f2c0b1418e8d2a18e4fe08d4f9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:43.902798 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be641c-2aaa-4be9-b03e-ef1f141cdf66 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:43.911632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832aae3-bae0-4ef8-9a8f-dc7674bd5fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:43.912991 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832aae3-bae0-4ef8-9a8f-dc7674bd5fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:43.913281 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832aae3-bae0-4ef8-9a8f-dc7674bd5fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:43.913564 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832aae3-bae0-4ef8-9a8f-dc7674bd5fb1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:43.918247 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 301/605] 10.222.0.32 () {58 vars in 1439 bytes} [Wed Jun 1 04:13:43 2022] PUT /identity/v3/projects/31d68f64d21647688074554062952074/users/79d614f85f5541d3babbb41468cbf55c/roles/5e94b8f2c0b1418e8d2a18e4fe08d4f9 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:13:43.919234 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be641c-2aaa-4be9-b03e-ef1f141cdf66 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:43.928476 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832aae3-bae0-4ef8-9a8f-dc7674bd5fb1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:43.930101 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832aae3-bae0-4ef8-9a8f-dc7674bd5fb1 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:43.946184 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-e832aae3-bae0-4ef8-9a8f-dc7674bd5fb1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:13:43.946184 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:43.946184 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:43.946184 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:43.946184 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:43.946184 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:43.946184 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:43.946184 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:43.946184 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:43.946184 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:43.946184 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:43.946184 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:43.946184 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 04:13:43.946184 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 04:13:43.946184 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 04:13:43.947444 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 04:13:43.947444 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:43.947444 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:43.947444 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:43.947444 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:43.947444 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:43.947444 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:43.947444 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:43.947444 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:43.947444 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:43.947444 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:43.947444 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:43.947444 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:43.947444 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:43.947444 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:43.947444 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:43.947444 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:43.948536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 04:13:43.948536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 04:13:43.948536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 04:13:43.948536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 04:13:43.948536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 04:13:43.948536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 04:13:43.948536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:13:43.948536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:43.952387 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 305/606] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:13:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:43.953345 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832aae3-bae0-4ef8-9a8f-dc7674bd5fb1 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:44.097415 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be641c-2aaa-4be9-b03e-ef1f141cdf66 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:44.102321 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:44.107504 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832aae3-bae0-4ef8-9a8f-dc7674bd5fb1 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:44.140089 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:44.153814 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a7d79-5522-4980-8b8f-a646dff1fd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:44.154257 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a6d19-817c-46ff-8258-371d3f0a17fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:44.155099 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a7d79-5522-4980-8b8f-a646dff1fd30 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:44.155215 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a6d19-817c-46ff-8258-371d3f0a17fe None admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:44.155425 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a6d19-817c-46ff-8258-371d3f0a17fe None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:44.155700 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a6d19-817c-46ff-8258-371d3f0a17fe None admin] PATH_INFO: `/v3/projects/31d68f64d21647688074554062952074/users/c1fbe41fbc1e4ac4964e3a5a417b6253/roles/5e94b8f2c0b1418e8d2a18e4fe08d4f9` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:44.155889 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a7d79-5522-4980-8b8f-a646dff1fd30 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:44.156310 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a7d79-5522-4980-8b8f-a646dff1fd30 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:44.170873 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a7d79-5522-4980-8b8f-a646dff1fd30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:44.176770 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a6d19-817c-46ff-8258-371d3f0a17fe None admin] RBAC: Authorizing `identity:create_grant(project_id=31d68f64d21647688074554062952074, user_id=c1fbe41fbc1e4ac4964e3a5a417b6253, role_id=5e94b8f2c0b1418e8d2a18e4fe08d4f9)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:44.178580 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a6d19-817c-46ff-8258-371d3f0a17fe None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:44.178810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-173a7d79-5522-4980-8b8f-a646dff1fd30 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:13:44.178810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:44.178810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:44.178810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:44.178810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:44.178810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:44.178810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:44.178810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:44.178810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:44.178810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:44.178810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:44.178810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:44.178810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:44.178810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:44.178810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:44.178810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:44.179883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:44.179883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:44.179883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:44.179883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:44.179883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:44.179883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:44.179883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:44.179883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:44.179883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:44.179883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:44.179883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:44.179883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:44.179883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:44.179883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:44.179883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:44.179883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:44.180762 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:44.180762 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:44.180762 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:44.180762 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:44.180762 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:44.180762 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:44.180762 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:44.180762 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:44.180762 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:44.180762 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:44.180762 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:13:44.180762 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:44.185717 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 302/607] 10.222.0.32 () {56 vars in 1102 bytes} [Wed Jun 1 04:13:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:44.186651 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a7d79-5522-4980-8b8f-a646dff1fd30 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:44.201020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 306/608] 10.222.0.32 () {58 vars in 1439 bytes} [Wed Jun 1 04:13:43 2022] PUT /identity/v3/projects/31d68f64d21647688074554062952074/users/c1fbe41fbc1e4ac4964e3a5a417b6253/roles/5e94b8f2c0b1418e8d2a18e4fe08d4f9 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:13:44.202189 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a6d19-817c-46ff-8258-371d3f0a17fe None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:44.343801 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a7d79-5522-4980-8b8f-a646dff1fd30 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:44.361890 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a6d19-817c-46ff-8258-371d3f0a17fe None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:44.416278 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a011e-dbda-4964-ba12-39f4e26bb430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:44.417794 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a011e-dbda-4964-ba12-39f4e26bb430 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:44.419036 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a011e-dbda-4964-ba12-39f4e26bb430 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:44.420538 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a011e-dbda-4964-ba12-39f4e26bb430 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:44.422794 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a011e-dbda-4964-ba12-39f4e26bb430 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:44.423608 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a011e-dbda-4964-ba12-39f4e26bb430 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:44.428193 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a011e-dbda-4964-ba12-39f4e26bb430 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:44.440091 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f38fc-e58e-448f-812b-8f10a85a0359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:44.441233 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f38fc-e58e-448f-812b-8f10a85a0359 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:44.441735 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f38fc-e58e-448f-812b-8f10a85a0359 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:44.442326 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f38fc-e58e-448f-812b-8f10a85a0359 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:44.444011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f38fc-e58e-448f-812b-8f10a85a0359 None admin] RBAC: Adding query filter params (name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:44.444563 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f38fc-e58e-448f-812b-8f10a85a0359 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:44.447478 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f38fc-e58e-448f-812b-8f10a85a0359 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:44.460938 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 303/609] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Jun 1 04:13:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:44.465439 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 307/610] 10.222.0.32 () {56 vars in 1103 bytes} [Wed Jun 1 04:13:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:44.467191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bfed7-174e-4c2c-869d-9bcb635e24f1 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:44.467907 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bfed7-174e-4c2c-869d-9bcb635e24f1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:44.468597 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bfed7-174e-4c2c-869d-9bcb635e24f1 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:44.471830 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 304/611] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:44 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:44.477892 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a5d87-8f54-40be-b8c9-f4adec28b0fe None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:44.478315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a5d87-8f54-40be-b8c9-f4adec28b0fe None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:44.478600 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a5d87-8f54-40be-b8c9-f4adec28b0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:44.479799 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bfed7-174e-4c2c-869d-9bcb635e24f1 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:44.508188 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-d44a5d87-8f54-40be-b8c9-f4adec28b0fe None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:44.509420 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d44a5d87-8f54-40be-b8c9-f4adec28b0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:44.529176 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:44.561678 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:44.620708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 308/612] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 04:13:44.622433 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a5d87-8f54-40be-b8c9-f4adec28b0fe None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:44.624221 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bfed7-174e-4c2c-869d-9bcb635e24f1 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:44.672637 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77249bd3-3e0b-45aa-92ee-08340f98827e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:44.673502 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77249bd3-3e0b-45aa-92ee-08340f98827e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:44.673829 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77249bd3-3e0b-45aa-92ee-08340f98827e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:44.674148 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77249bd3-3e0b-45aa-92ee-08340f98827e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:44.688973 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77249bd3-3e0b-45aa-92ee-08340f98827e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:44.691244 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77249bd3-3e0b-45aa-92ee-08340f98827e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:44.717340 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-77249bd3-3e0b-45aa-92ee-08340f98827e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:44.717340 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:44.717340 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:44.717340 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:44.717340 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:44.717340 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:44.717340 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:44.717340 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:44.717340 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:44.717340 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:44.717340 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:44.717340 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:44.717340 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:13:44.717340 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:13:44.717340 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:13:44.718309 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:13:44.718309 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:44.718309 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:44.718309 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:44.718309 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:44.718309 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:44.718309 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:44.718309 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:44.718309 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:44.718309 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:44.718309 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:44.718309 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:44.718309 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:44.718309 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:44.718309 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:44.718309 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:44.718309 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:44.719184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:13:44.719184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:13:44.719184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:44.719184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:44.719184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 305/613] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:44.719960 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77249bd3-3e0b-45aa-92ee-08340f98827e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:44.752546 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a5d87-8f54-40be-b8c9-f4adec28b0fe None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:44.801516 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771defa-2c11-4d8d-a5ca-a16eef7dfde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:44.803004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771defa-2c11-4d8d-a5ca-a16eef7dfde0 None admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:44.803287 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771defa-2c11-4d8d-a5ca-a16eef7dfde0 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:44.803564 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771defa-2c11-4d8d-a5ca-a16eef7dfde0 None admin] PATH_INFO: `/v3/projects/31d68f64d21647688074554062952074/users/dca5f9455ef349738adf4569fe5ed165/roles/5e94b8f2c0b1418e8d2a18e4fe08d4f9` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:44.823496 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c771defa-2c11-4d8d-a5ca-a16eef7dfde0 None admin] RBAC: Authorizing `identity:create_grant(project_id=31d68f64d21647688074554062952074, user_id=dca5f9455ef349738adf4569fe5ed165, role_id=5e94b8f2c0b1418e8d2a18e4fe08d4f9)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:44.826110 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c771defa-2c11-4d8d-a5ca-a16eef7dfde0 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:44.829271 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:44.851146 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 309/614] 10.222.0.32 () {58 vars in 1439 bytes} [Wed Jun 1 04:13:44 2022] PUT /identity/v3/projects/31d68f64d21647688074554062952074/users/dca5f9455ef349738adf4569fe5ed165/roles/5e94b8f2c0b1418e8d2a18e4fe08d4f9 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:13:44.852175 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771defa-2c11-4d8d-a5ca-a16eef7dfde0 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:44.877047 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77249bd3-3e0b-45aa-92ee-08340f98827e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:44.885957 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:44.971500 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4774f9-6a91-4a89-be86-528bc57acb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:44.972902 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4774f9-6a91-4a89-be86-528bc57acb8d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:44.973502 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4774f9-6a91-4a89-be86-528bc57acb8d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:44.974010 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4774f9-6a91-4a89-be86-528bc57acb8d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:44.993936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4774f9-6a91-4a89-be86-528bc57acb8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:45.014135 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-db4774f9-6a91-4a89-be86-528bc57acb8d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:13:45.014135 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:45.014135 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:45.014135 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:45.014135 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:45.014135 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:45.014135 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:45.014135 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:45.014135 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:45.014135 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:45.014135 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:45.014135 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:45.014135 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:45.014135 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:45.014135 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:45.014135 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:45.015993 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:45.015993 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:45.015993 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:45.015993 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:45.015993 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:45.015993 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:45.015993 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:45.015993 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:45.015993 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:45.015993 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:45.015993 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:45.015993 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:45.015993 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:45.015993 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:45.015993 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:45.015993 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:45.017221 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:45.017221 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:45.017221 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:45.017221 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:45.017221 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:45.017221 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:45.017221 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:45.017221 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:45.017221 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:45.017221 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:45.017221 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:13:45.017221 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:45.017221 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 306/615] 10.222.0.32 () {56 vars in 1102 bytes} [Wed Jun 1 04:13:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:45.022525 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4774f9-6a91-4a89-be86-528bc57acb8d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:45.135749 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4774f9-6a91-4a89-be86-528bc57acb8d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:45.173707 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943255e4-7056-42c7-979a-ee524f2e4c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:45.174429 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943255e4-7056-42c7-979a-ee524f2e4c03 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:45.174706 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943255e4-7056-42c7-979a-ee524f2e4c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:45.174987 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943255e4-7056-42c7-979a-ee524f2e4c03 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:45.175753 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943255e4-7056-42c7-979a-ee524f2e4c03 None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:45.176058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943255e4-7056-42c7-979a-ee524f2e4c03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:45.178661 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943255e4-7056-42c7-979a-ee524f2e4c03 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:45.189033 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 307/616] 10.222.0.32 () {56 vars in 1103 bytes} [Wed Jun 1 04:13:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:45.189571 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:45.196942 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943255e4-7056-42c7-979a-ee524f2e4c03 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:45.226032 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771defa-2c11-4d8d-a5ca-a16eef7dfde0 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:45.300470 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc9eec-0233-42dd-9382-78aa10f0e7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:45.301642 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc9eec-0233-42dd-9382-78aa10f0e7f5 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:45.303940 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc9eec-0233-42dd-9382-78aa10f0e7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:45.304461 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc9eec-0233-42dd-9382-78aa10f0e7f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:45.305799 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc9eec-0233-42dd-9382-78aa10f0e7f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:45.306421 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc9eec-0233-42dd-9382-78aa10f0e7f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:45.308906 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc9eec-0233-42dd-9382-78aa10f0e7f5 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:45.324134 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943255e4-7056-42c7-979a-ee524f2e4c03 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:45.324493 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 310/617] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 472 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:45.331942 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc9eec-0233-42dd-9382-78aa10f0e7f5 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:45.418378 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738356b2-52f7-4c02-9bbc-4ac44c627ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:45.420109 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738356b2-52f7-4c02-9bbc-4ac44c627ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:45.420586 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738356b2-52f7-4c02-9bbc-4ac44c627ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:45.421062 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738356b2-52f7-4c02-9bbc-4ac44c627ec0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:45.460700 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738356b2-52f7-4c02-9bbc-4ac44c627ec0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:45.462976 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738356b2-52f7-4c02-9bbc-4ac44c627ec0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:45.496048 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-738356b2-52f7-4c02-9bbc-4ac44c627ec0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:45.496048 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:45.496048 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:45.496048 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:45.496048 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:45.496048 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:45.496048 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:45.496048 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:45.496048 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:45.496048 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:45.496048 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:45.496048 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:45.496048 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:13:45.496048 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:13:45.496048 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:13:45.497028 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:13:45.497028 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:45.497028 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:45.497028 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:45.497028 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:45.497028 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:45.497028 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:45.497028 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:45.497028 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:45.497028 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:45.497028 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:45.497028 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:45.497028 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:45.497028 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:45.497028 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:45.497028 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:45.497028 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:45.497914 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:13:45.497914 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:13:45.497914 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:45.497914 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:45.508826 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 308/618] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:13:45.517028 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738356b2-52f7-4c02-9bbc-4ac44c627ec0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:45.554342 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:45.592172 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc9eec-0233-42dd-9382-78aa10f0e7f5 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:45.625990 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:45.666293 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c2ad7-63dc-4f36-b3fc-a46e6d3205d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:45.667664 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c2ad7-63dc-4f36-b3fc-a46e6d3205d5 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:45.670760 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c2ad7-63dc-4f36-b3fc-a46e6d3205d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:45.671255 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c2ad7-63dc-4f36-b3fc-a46e6d3205d5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:45.697696 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c2ad7-63dc-4f36-b3fc-a46e6d3205d5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:45.700500 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c2ad7-63dc-4f36-b3fc-a46e6d3205d5 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:45.707073 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738356b2-52f7-4c02-9bbc-4ac44c627ec0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:45.737625 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-c49c2ad7-63dc-4f36-b3fc-a46e6d3205d5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 01 04:13:45.737625 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:45.737625 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:45.737625 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:45.737625 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:45.737625 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:45.737625 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:45.737625 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:45.737625 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:45.737625 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:45.737625 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:45.737625 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:45.737625 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 04:13:45.737625 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 04:13:45.737625 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 04:13:45.737625 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 04:13:45.738671 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:45.738671 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:45.738671 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 04:13:45.738671 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:13:45.738671 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 04:13:45.738671 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:13:45.738671 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:45.738671 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:45.738671 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:45.738671 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:45.738671 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:45.738671 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:45.738671 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:45.738671 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:45.738671 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:45.738671 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:45.738671 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:45.738671 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:45.739603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:45.739603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:45.739603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 04:13:45.739603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 04:13:45.739603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 04:13:45.739603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 04:13:45.739603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 04:13:45.739603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 04:13:45.739603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 01 04:13:45.739603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:45.740753 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 311/619] 10.222.0.32 () {56 vars in 1096 bytes} [Wed Jun 1 04:13:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 409 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:13:45.748385 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c2ad7-63dc-4f36-b3fc-a46e6d3205d5 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:45.806525 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8e704-62a0-4f7b-8782-9219ff7defe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:45.807334 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8e704-62a0-4f7b-8782-9219ff7defe7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:45.809690 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8e704-62a0-4f7b-8782-9219ff7defe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:45.810189 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8e704-62a0-4f7b-8782-9219ff7defe7 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:45.811439 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8e704-62a0-4f7b-8782-9219ff7defe7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:45.811948 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8e704-62a0-4f7b-8782-9219ff7defe7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:45.814482 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8e704-62a0-4f7b-8782-9219ff7defe7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:45.837605 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 309/620] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:13:45.845795 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8e704-62a0-4f7b-8782-9219ff7defe7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:46.030939 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8e704-62a0-4f7b-8782-9219ff7defe7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:46.053089 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:46.095375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e47634-abc2-4108-9722-3821fb4de0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:46.096542 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e47634-abc2-4108-9722-3821fb4de0bb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:46.096965 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e47634-abc2-4108-9722-3821fb4de0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:46.097384 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e47634-abc2-4108-9722-3821fb4de0bb None admin] PATH_INFO: `/v3/users/glance` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:46.102218 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c2ad7-63dc-4f36-b3fc-a46e6d3205d5 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:46.111141 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e47634-abc2-4108-9722-3821fb4de0bb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:46.113871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e47634-abc2-4108-9722-3821fb4de0bb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:46.152496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-a5e47634-abc2-4108-9722-3821fb4de0bb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 01 04:13:46.152496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:46.152496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:46.152496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:46.152496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:46.152496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:46.152496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:46.152496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:46.152496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:46.152496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:46.152496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:46.152496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:46.152496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 04:13:46.152496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 04:13:46.152496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 04:13:46.152496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 04:13:46.153549 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:46.153549 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:46.153549 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 04:13:46.153549 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:13:46.153549 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 04:13:46.153549 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:13:46.153549 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:46.153549 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:46.153549 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:46.153549 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:46.153549 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:46.153549 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:46.153549 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:46.153549 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:46.153549 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:46.153549 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:46.153549 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:46.153549 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:46.154538 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:46.154538 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:46.154538 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 04:13:46.154538 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 04:13:46.154538 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 04:13:46.154538 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 04:13:46.154538 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 04:13:46.154538 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 04:13:46.154538 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 01 04:13:46.154538 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:46.159449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 310/621] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:13:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:46.166921 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3147c-401d-401f-aeb5-c521f2a107f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:46.168109 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3147c-401d-401f-aeb5-c521f2a107f3 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:46.168387 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3147c-401d-401f-aeb5-c521f2a107f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:46.168668 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3147c-401d-401f-aeb5-c521f2a107f3 None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:46.169527 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f3147c-401d-401f-aeb5-c521f2a107f3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:46.169836 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f3147c-401d-401f-aeb5-c521f2a107f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:46.171328 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f3147c-401d-401f-aeb5-c521f2a107f3 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:46.178054 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e47634-abc2-4108-9722-3821fb4de0bb None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:46.195766 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:46.214025 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 312/622] 10.222.0.32 () {56 vars in 1135 bytes} [Wed Jun 1 04:13:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 465 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:13:46.222203 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3147c-401d-401f-aeb5-c521f2a107f3 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:46.375622 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3147c-401d-401f-aeb5-c521f2a107f3 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:46.417805 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd94bb-7af4-47a1-966f-cc2cb55e9e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:46.418950 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd94bb-7af4-47a1-966f-cc2cb55e9e3c None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:46.419385 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd94bb-7af4-47a1-966f-cc2cb55e9e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:46.419811 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd94bb-7af4-47a1-966f-cc2cb55e9e3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:46.433378 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd94bb-7af4-47a1-966f-cc2cb55e9e3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:46.435676 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd94bb-7af4-47a1-966f-cc2cb55e9e3c None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:46.459606 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-14fd94bb-7af4-47a1-966f-cc2cb55e9e3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:46.459606 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:46.459606 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:46.459606 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:46.459606 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:46.459606 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:46.459606 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:46.459606 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:46.459606 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:46.459606 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:46.459606 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:46.459606 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:46.459606 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:13:46.459606 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:13:46.459606 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:13:46.460639 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:13:46.460639 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:46.460639 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:46.460639 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:46.460639 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:46.460639 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:46.460639 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:46.460639 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:46.460639 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:46.460639 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:46.460639 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:46.460639 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:46.460639 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:46.460639 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:46.460639 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:46.460639 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:46.460639 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:46.461534 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:13:46.461534 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:13:46.461534 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:46.461534 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:46.464015 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 313/623] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:46.471544 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd94bb-7af4-47a1-966f-cc2cb55e9e3c None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:46.507459 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e47634-abc2-4108-9722-3821fb4de0bb None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:46.612966 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc537c5-a0e3-4b82-8b71-d508143f86ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:46.614166 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc537c5-a0e3-4b82-8b71-d508143f86ab None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:46.614642 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc537c5-a0e3-4b82-8b71-d508143f86ab None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:46.615152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc537c5-a0e3-4b82-8b71-d508143f86ab None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:46.616678 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc537c5-a0e3-4b82-8b71-d508143f86ab None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:46.617183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc537c5-a0e3-4b82-8b71-d508143f86ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:46.623747 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc537c5-a0e3-4b82-8b71-d508143f86ab None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:46.654088 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:46.684848 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 311/624] 10.222.0.32 () {56 vars in 1137 bytes} [Wed Jun 1 04:13:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 511 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:46.694686 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc537c5-a0e3-4b82-8b71-d508143f86ab None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:46.757081 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:46.817439 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd94bb-7af4-47a1-966f-cc2cb55e9e3c None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:46.914627 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc537c5-a0e3-4b82-8b71-d508143f86ab None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:46.956253 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe01c2-9d86-4abb-bee5-a37d2dd954a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:46.957328 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe01c2-9d86-4abb-bee5-a37d2dd954a4 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:46.957781 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe01c2-9d86-4abb-bee5-a37d2dd954a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:46.958264 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe01c2-9d86-4abb-bee5-a37d2dd954a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:46.960116 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe01c2-9d86-4abb-bee5-a37d2dd954a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:46.960627 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe01c2-9d86-4abb-bee5-a37d2dd954a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:46.963150 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe01c2-9d86-4abb-bee5-a37d2dd954a4 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:46.984071 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2751b-4881-48fd-9f65-4cdcf75c1cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:46.985359 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2751b-4881-48fd-9f65-4cdcf75c1cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:46.985828 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2751b-4881-48fd-9f65-4cdcf75c1cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:46.986349 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2751b-4881-48fd-9f65-4cdcf75c1cb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:47.013920 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 314/625] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 543 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:47.023318 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe01c2-9d86-4abb-bee5-a37d2dd954a4 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:47.124280 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2751b-4881-48fd-9f65-4cdcf75c1cb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:47.127160 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2751b-4881-48fd-9f65-4cdcf75c1cb6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:47.182553 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:47.334945 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 312/626] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:13:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 04:13:47.345246 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2751b-4881-48fd-9f65-4cdcf75c1cb6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:47.356184 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe01c2-9d86-4abb-bee5-a37d2dd954a4 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:47.384187 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:47.492183 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c34a5-6288-4def-8846-6bea68b46603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:47.493015 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c34a5-6288-4def-8846-6bea68b46603 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:47.493320 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c34a5-6288-4def-8846-6bea68b46603 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:47.493580 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c34a5-6288-4def-8846-6bea68b46603 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:47.518945 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c34a5-6288-4def-8846-6bea68b46603 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:47.520452 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c34a5-6288-4def-8846-6bea68b46603 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:47.548047 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2751b-4881-48fd-9f65-4cdcf75c1cb6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:47.550080 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-332c34a5-6288-4def-8846-6bea68b46603 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:13:47.550080 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:47.550080 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:47.550080 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:47.550080 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:47.550080 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:47.550080 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:47.550080 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:47.550080 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:47.550080 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:47.550080 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:47.550080 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:47.550080 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 04:13:47.550080 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 04:13:47.550080 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 04:13:47.551704 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 04:13:47.551704 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:47.551704 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:47.551704 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:47.551704 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:47.551704 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:47.551704 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:47.551704 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:47.551704 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:47.551704 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:47.551704 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:47.551704 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:47.551704 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:47.551704 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:47.551704 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:47.551704 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:47.551704 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:47.553526 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 04:13:47.553526 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 04:13:47.553526 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 04:13:47.553526 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 04:13:47.553526 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 04:13:47.553526 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 04:13:47.553526 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:13:47.553526 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:47.558618 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 315/627] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:13:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 536 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:47.567021 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c34a5-6288-4def-8846-6bea68b46603 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:47.610311 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:47.619580 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30d948-0bf2-4a52-9e42-57434a300afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:47.620835 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30d948-0bf2-4a52-9e42-57434a300afb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:47.621312 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30d948-0bf2-4a52-9e42-57434a300afb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:47.621788 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30d948-0bf2-4a52-9e42-57434a300afb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:47.643168 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a30d948-0bf2-4a52-9e42-57434a300afb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:47.646695 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a30d948-0bf2-4a52-9e42-57434a300afb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:47.684337 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-9a30d948-0bf2-4a52-9e42-57434a300afb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:47.684337 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:47.684337 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:47.684337 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:47.684337 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:47.684337 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:47.684337 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:47.684337 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:47.684337 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:47.684337 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:47.684337 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:47.684337 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:47.684337 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:13:47.684337 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:13:47.684337 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:13:47.686112 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:13:47.686112 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:47.686112 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:47.686112 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:47.686112 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:47.686112 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:47.686112 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:47.686112 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:47.686112 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:47.686112 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:47.686112 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:47.686112 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:47.686112 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:47.686112 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:47.686112 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:47.686112 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:47.686112 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:47.687278 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:13:47.687278 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:13:47.687278 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:47.687278 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:47.687278 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 313/628] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:13:47.698230 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30d948-0bf2-4a52-9e42-57434a300afb None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:47.925908 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c34a5-6288-4def-8846-6bea68b46603 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:47.953069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30d948-0bf2-4a52-9e42-57434a300afb None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:48.009533 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e350c1a-00fc-4c3b-a344-2ed0542b7aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:48.011650 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e350c1a-00fc-4c3b-a344-2ed0542b7aaf None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:48.012124 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e350c1a-00fc-4c3b-a344-2ed0542b7aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:48.012673 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e350c1a-00fc-4c3b-a344-2ed0542b7aaf None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:48.015307 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e350c1a-00fc-4c3b-a344-2ed0542b7aaf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:48.016016 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e350c1a-00fc-4c3b-a344-2ed0542b7aaf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:48.018950 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e350c1a-00fc-4c3b-a344-2ed0542b7aaf None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:48.033454 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c7f47-372c-480a-81d9-c98a66892008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:48.034959 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c7f47-372c-480a-81d9-c98a66892008 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:48.035185 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 316/629] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Jun 1 04:13:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:48.036110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c7f47-372c-480a-81d9-c98a66892008 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:48.036449 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ae9ae-45aa-44ce-9e89-573ba71fc246 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:48.037286 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ae9ae-45aa-44ce-9e89-573ba71fc246 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:48.037570 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ae9ae-45aa-44ce-9e89-573ba71fc246 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:48.038198 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c7f47-372c-480a-81d9-c98a66892008 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:48.044599 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 317/630] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:48.044842 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c7f47-372c-480a-81d9-c98a66892008 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:48.044842 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c7f47-372c-480a-81d9-c98a66892008 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:48.045073 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ae9ae-45aa-44ce-9e89-573ba71fc246 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:48.049188 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c7f47-372c-480a-81d9-c98a66892008 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:48.064494 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 314/631] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:13:48.065957 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90276049-6979-4d21-b15b-0d02c113af89 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:48.066288 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90276049-6979-4d21-b15b-0d02c113af89 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:48.066569 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90276049-6979-4d21-b15b-0d02c113af89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:48.087757 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-90276049-6979-4d21-b15b-0d02c113af89 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:48.088977 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-90276049-6979-4d21-b15b-0d02c113af89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:48.114887 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:48.145563 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:48.194812 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 315/632] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:13:48.196646 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90276049-6979-4d21-b15b-0d02c113af89 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:48.243187 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ae9ae-45aa-44ce-9e89-573ba71fc246 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:48.298678 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649ed16-f974-4a6f-ae23-7b7d61d7158e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:48.299924 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649ed16-f974-4a6f-ae23-7b7d61d7158e None admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:48.300394 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649ed16-f974-4a6f-ae23-7b7d61d7158e None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:48.300849 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649ed16-f974-4a6f-ae23-7b7d61d7158e None admin] PATH_INFO: `/v3/projects/31d68f64d21647688074554062952074/users/413c6613b4ec4e53aeeaf6828c807273/roles/5e94b8f2c0b1418e8d2a18e4fe08d4f9` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:48.326193 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649ed16-f974-4a6f-ae23-7b7d61d7158e None admin] RBAC: Authorizing `identity:create_grant(project_id=31d68f64d21647688074554062952074, user_id=413c6613b4ec4e53aeeaf6828c807273, role_id=5e94b8f2c0b1418e8d2a18e4fe08d4f9)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:48.328618 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649ed16-f974-4a6f-ae23-7b7d61d7158e None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:48.349002 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 318/633] 10.222.0.32 () {58 vars in 1439 bytes} [Wed Jun 1 04:13:48 2022] PUT /identity/v3/projects/31d68f64d21647688074554062952074/users/413c6613b4ec4e53aeeaf6828c807273/roles/5e94b8f2c0b1418e8d2a18e4fe08d4f9 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:13:48.351472 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b602d7-c810-4f78-a853-62fbac9e1093 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:48.351945 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b602d7-c810-4f78-a853-62fbac9e1093 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:48.352380 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b602d7-c810-4f78-a853-62fbac9e1093 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:48.358082 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 319/634] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:48.358082 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b602d7-c810-4f78-a853-62fbac9e1093 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:48.369671 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90276049-6979-4d21-b15b-0d02c113af89 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:48.426305 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280f0d8-0404-46fb-bc92-b5e7850894e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:48.428527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280f0d8-0404-46fb-bc92-b5e7850894e5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:48.429328 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280f0d8-0404-46fb-bc92-b5e7850894e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:48.430117 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280f0d8-0404-46fb-bc92-b5e7850894e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:48.443612 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280f0d8-0404-46fb-bc92-b5e7850894e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:48.446870 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280f0d8-0404-46fb-bc92-b5e7850894e5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:48.472058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-5280f0d8-0404-46fb-bc92-b5e7850894e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:13:48.472058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:48.472058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:48.472058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:48.472058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:48.472058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:48.472058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:48.472058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:48.472058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:48.472058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:48.472058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:48.472058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:48.472058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 04:13:48.472058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 04:13:48.472058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 04:13:48.473820 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 04:13:48.473820 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:48.473820 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:48.473820 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:48.473820 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:48.473820 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:48.473820 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:48.473820 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:48.473820 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:48.473820 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:48.473820 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:48.473820 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:48.473820 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:48.473820 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:48.473820 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:48.473820 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:48.473820 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:48.475530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 04:13:48.475530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 04:13:48.475530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 04:13:48.475530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 04:13:48.475530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 04:13:48.475530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 04:13:48.475530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:13:48.475530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:48.480088 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 316/635] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:13:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:48.482871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adef5c-9ebd-4bee-976e-0ea555d9424f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:48.483847 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adef5c-9ebd-4bee-976e-0ea555d9424f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:48.484614 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adef5c-9ebd-4bee-976e-0ea555d9424f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:48.486581 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:48.513450 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b602d7-c810-4f78-a853-62fbac9e1093 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:48.516823 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c0adef5c-9ebd-4bee-976e-0ea555d9424f None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:48.519394 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c0adef5c-9ebd-4bee-976e-0ea555d9424f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:48.562987 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23609e33-b78c-4404-bb37-a080067ef4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:48.563809 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23609e33-b78c-4404-bb37-a080067ef4f8 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:48.564083 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23609e33-b78c-4404-bb37-a080067ef4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:48.564388 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23609e33-b78c-4404-bb37-a080067ef4f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:48.565958 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:48.583375 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23609e33-b78c-4404-bb37-a080067ef4f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:48.596012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-23609e33-b78c-4404-bb37-a080067ef4f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:13:48.596012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:48.596012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:48.596012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:48.596012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:48.596012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:48.596012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:48.596012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:48.596012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:48.596012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:48.596012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:48.596012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:48.596012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:48.596012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:48.596012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:48.596012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:48.598093 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:48.598093 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:48.598093 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:48.598093 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:48.598093 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:48.598093 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:48.598093 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:48.598093 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:48.598093 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:48.598093 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:48.598093 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:48.598093 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:48.598093 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:48.598093 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:48.598093 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:48.598093 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:48.600380 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:48.600380 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:48.600380 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:48.600380 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:48.600380 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:48.600380 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:48.600380 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:48.600380 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:48.600380 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:48.600380 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:48.600380 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:13:48.600380 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:48.602448 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 320/636] 10.222.0.32 () {56 vars in 1102 bytes} [Wed Jun 1 04:13:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:48.603373 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23609e33-b78c-4404-bb37-a080067ef4f8 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:48.667116 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 317/637] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:13:48.667390 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adef5c-9ebd-4bee-976e-0ea555d9424f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:48.778830 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23609e33-b78c-4404-bb37-a080067ef4f8 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:48.809436 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adef5c-9ebd-4bee-976e-0ea555d9424f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:48.843689 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704308c-65bb-49a8-a290-33a2ff4c5e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:48.845297 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704308c-65bb-49a8-a290-33a2ff4c5e62 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:48.846166 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704308c-65bb-49a8-a290-33a2ff4c5e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:48.847056 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704308c-65bb-49a8-a290-33a2ff4c5e62 None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:48.849597 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c704308c-65bb-49a8-a290-33a2ff4c5e62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:48.850586 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c704308c-65bb-49a8-a290-33a2ff4c5e62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:48.850740 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5f480-872d-48dd-8414-2421dc18a094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:48.851331 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5f480-872d-48dd-8414-2421dc18a094 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:48.851611 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5f480-872d-48dd-8414-2421dc18a094 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:48.851889 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5f480-872d-48dd-8414-2421dc18a094 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:48.852646 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5f480-872d-48dd-8414-2421dc18a094 None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:48.853007 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5f480-872d-48dd-8414-2421dc18a094 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:48.854379 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5f480-872d-48dd-8414-2421dc18a094 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:48.855550 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c704308c-65bb-49a8-a290-33a2ff4c5e62 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:48.869357 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 318/638] 10.222.0.32 () {56 vars in 1103 bytes} [Wed Jun 1 04:13:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:48.870356 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5f480-872d-48dd-8414-2421dc18a094 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:48.875396 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:48.882249 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 321/639] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Jun 1 04:13:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:48.883710 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704308c-65bb-49a8-a290-33a2ff4c5e62 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:48.901710 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:49.009273 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5f480-872d-48dd-8414-2421dc18a094 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:49.051263 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704308c-65bb-49a8-a290-33a2ff4c5e62 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:49.074987 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9630a0-2c2a-4068-9047-0a2109bf647e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:49.076282 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9630a0-2c2a-4068-9047-0a2109bf647e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:49.076753 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9630a0-2c2a-4068-9047-0a2109bf647e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:49.077324 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9630a0-2c2a-4068-9047-0a2109bf647e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:49.095674 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07d6cf-7794-4ef5-a16f-12ec3a465e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:49.096763 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07d6cf-7794-4ef5-a16f-12ec3a465e94 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:49.097201 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07d6cf-7794-4ef5-a16f-12ec3a465e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:49.097625 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07d6cf-7794-4ef5-a16f-12ec3a465e94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:49.098087 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9630a0-2c2a-4068-9047-0a2109bf647e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:49.110934 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec07d6cf-7794-4ef5-a16f-12ec3a465e94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:49.112749 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec07d6cf-7794-4ef5-a16f-12ec3a465e94 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:49.113703 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-bc9630a0-2c2a-4068-9047-0a2109bf647e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:13:49.113703 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:49.113703 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:49.113703 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:49.113703 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:49.113703 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:49.113703 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:49.113703 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:49.113703 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:49.113703 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:49.113703 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:49.113703 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:49.113703 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:49.113703 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:49.113703 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:49.113703 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:49.114874 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:49.114874 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:49.114874 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:49.114874 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:49.114874 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:49.114874 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:49.114874 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:49.114874 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:49.114874 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:49.114874 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:49.114874 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:49.114874 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:49.114874 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:49.114874 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:49.114874 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:49.114874 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:49.115864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:49.115864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:49.115864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:49.115864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:49.115864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:49.115864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:49.115864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:49.115864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:49.115864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:49.115864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:49.115864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:13:49.115864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:49.122092 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 319/640] 10.222.0.32 () {56 vars in 1102 bytes} [Wed Jun 1 04:13:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:49.122092 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9630a0-2c2a-4068-9047-0a2109bf647e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:49.143743 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-ec07d6cf-7794-4ef5-a16f-12ec3a465e94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:49.143743 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:49.143743 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:49.143743 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:49.143743 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:49.143743 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:49.143743 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:49.143743 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:49.143743 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:49.143743 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:49.143743 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:49.143743 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:49.143743 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:13:49.143743 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:13:49.143743 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:13:49.144889 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:13:49.144889 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:49.144889 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:49.144889 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:49.144889 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:49.144889 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:49.144889 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:49.144889 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:49.144889 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:49.144889 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:49.144889 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:49.144889 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:49.144889 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:49.144889 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:49.144889 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:49.144889 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:49.144889 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:49.146044 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:13:49.146044 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:13:49.146044 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:49.146044 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:49.152275 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 322/641] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:49.155807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d576e8-dcd5-4fd1-a7a0-f2b76b42fb19 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:49.155807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d576e8-dcd5-4fd1-a7a0-f2b76b42fb19 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:49.155807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d576e8-dcd5-4fd1-a7a0-f2b76b42fb19 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:49.158707 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 323/642] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:49.160184 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d576e8-dcd5-4fd1-a7a0-f2b76b42fb19 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:49.245309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:49.257257 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:49.292225 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9630a0-2c2a-4068-9047-0a2109bf647e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:49.321471 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d576e8-dcd5-4fd1-a7a0-f2b76b42fb19 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:49.340076 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc826f1-833b-445e-ba28-797e09a783fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:49.340891 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc826f1-833b-445e-ba28-797e09a783fd None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:49.341265 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc826f1-833b-445e-ba28-797e09a783fd None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:49.341681 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc826f1-833b-445e-ba28-797e09a783fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:49.342887 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc826f1-833b-445e-ba28-797e09a783fd None admin] RBAC: Adding query filter params (role.id=5e94b8f2c0b1418e8d2a18e4fe08d4f9, scope.project.id=31d68f64d21647688074554062952074, user.id=7ac83171b9284163a71cc729cef076f0) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:49.343208 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc826f1-833b-445e-ba28-797e09a783fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:49.344677 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc826f1-833b-445e-ba28-797e09a783fd None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:49.352411 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 320/643] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:13:49 2022] GET /identity/v3/role_assignments?user.id=7ac83171b9284163a71cc729cef076f0&scope.project.id=31d68f64d21647688074554062952074&role.id=5e94b8f2c0b1418e8d2a18e4fe08d4f9 => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:49.353850 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc826f1-833b-445e-ba28-797e09a783fd None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:49.413883 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844047bb-6075-4380-a91a-ca4fdfe495a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:49.417162 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844047bb-6075-4380-a91a-ca4fdfe495a5 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:49.418261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844047bb-6075-4380-a91a-ca4fdfe495a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:49.418989 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844047bb-6075-4380-a91a-ca4fdfe495a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:49.421566 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844047bb-6075-4380-a91a-ca4fdfe495a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:49.422436 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844047bb-6075-4380-a91a-ca4fdfe495a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:49.426894 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844047bb-6075-4380-a91a-ca4fdfe495a5 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:49.449558 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 324/644] 10.222.0.32 () {56 vars in 1103 bytes} [Wed Jun 1 04:13:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:49.452774 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754a82f-8f90-4473-9574-c8fc0a65d8fa None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:49.453538 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754a82f-8f90-4473-9574-c8fc0a65d8fa None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:49.454887 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754a82f-8f90-4473-9574-c8fc0a65d8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:49.495119 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-d754a82f-8f90-4473-9574-c8fc0a65d8fa None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:49.499190 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d754a82f-8f90-4473-9574-c8fc0a65d8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:49.556190 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc826f1-833b-445e-ba28-797e09a783fd None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:49.624652 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f102ee-8ab8-419f-a012-0c9d072d336b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:49.625776 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f102ee-8ab8-419f-a012-0c9d072d336b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:49.626397 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f102ee-8ab8-419f-a012-0c9d072d336b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:49.626970 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f102ee-8ab8-419f-a012-0c9d072d336b None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:49.628419 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f102ee-8ab8-419f-a012-0c9d072d336b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:49.628990 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f102ee-8ab8-419f-a012-0c9d072d336b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:49.631739 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f102ee-8ab8-419f-a012-0c9d072d336b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:49.654035 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 321/645] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:49.655684 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f102ee-8ab8-419f-a012-0c9d072d336b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:49.657395 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 325/646] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:13:49.663941 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754a82f-8f90-4473-9574-c8fc0a65d8fa None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:49.682555 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:49.760128 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:49.854610 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754a82f-8f90-4473-9574-c8fc0a65d8fa None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:49.882864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f102ee-8ab8-419f-a012-0c9d072d336b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:49.929136 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47dd223-ab99-4508-a69a-e04d4c7d23d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:49.931286 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47dd223-ab99-4508-a69a-e04d4c7d23d4 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:49.932066 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47dd223-ab99-4508-a69a-e04d4c7d23d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:49.932965 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47dd223-ab99-4508-a69a-e04d4c7d23d4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:49.948565 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829cc4f-5e45-47e4-9fc6-a780e6f5dd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:49.949853 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829cc4f-5e45-47e4-9fc6-a780e6f5dd2e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:49.950518 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829cc4f-5e45-47e4-9fc6-a780e6f5dd2e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:49.950791 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829cc4f-5e45-47e4-9fc6-a780e6f5dd2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:49.952805 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47dd223-ab99-4508-a69a-e04d4c7d23d4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:49.956614 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47dd223-ab99-4508-a69a-e04d4c7d23d4 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:49.969421 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829cc4f-5e45-47e4-9fc6-a780e6f5dd2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:49.972035 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829cc4f-5e45-47e4-9fc6-a780e6f5dd2e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:49.991461 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-a47dd223-ab99-4508-a69a-e04d4c7d23d4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 01 04:13:49.991461 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:49.991461 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:49.991461 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:49.991461 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:49.991461 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:49.991461 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:49.991461 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:49.991461 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:49.991461 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:49.991461 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:49.991461 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:49.991461 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 04:13:49.991461 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 04:13:49.991461 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 04:13:49.991461 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 04:13:49.993436 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:49.993436 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:49.993436 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 04:13:49.993436 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:13:49.993436 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 04:13:49.993436 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:13:49.993436 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:49.993436 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:49.993436 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:49.993436 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:49.993436 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:49.993436 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:49.993436 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:49.993436 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:49.993436 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:49.993436 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:49.993436 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:49.993436 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:49.995367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:49.995367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:49.995367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 04:13:49.995367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 04:13:49.995367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 04:13:49.995367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 04:13:49.995367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 04:13:49.995367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 04:13:49.995367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 01 04:13:49.995367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:50.000069 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 326/647] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:13:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:50.002183 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47dd223-ab99-4508-a69a-e04d4c7d23d4 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:50.013152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-a829cc4f-5e45-47e4-9fc6-a780e6f5dd2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:50.013152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:50.013152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:50.013152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:50.013152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:50.013152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:50.013152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:50.013152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:50.013152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:50.013152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:50.013152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:50.013152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:50.013152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:13:50.013152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:13:50.013152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:13:50.015395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:13:50.015395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:50.015395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:50.015395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:50.015395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:50.015395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:50.015395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:50.015395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:50.015395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:50.015395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:50.015395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:50.015395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:50.015395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:50.015395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:50.015395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:50.015395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:50.015395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:50.018243 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:13:50.018243 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:13:50.018243 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:50.018243 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:50.022321 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 322/648] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:50.024689 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829cc4f-5e45-47e4-9fc6-a780e6f5dd2e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:50.170441 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:50.231837 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47dd223-ab99-4508-a69a-e04d4c7d23d4 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:50.238523 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:50.288358 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829cc4f-5e45-47e4-9fc6-a780e6f5dd2e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:50.312557 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe9236-0a58-411a-91bb-18e697ad0e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:50.315372 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe9236-0a58-411a-91bb-18e697ad0e0e None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:50.316180 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe9236-0a58-411a-91bb-18e697ad0e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:50.317312 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe9236-0a58-411a-91bb-18e697ad0e0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:50.345532 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe9236-0a58-411a-91bb-18e697ad0e0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:50.355771 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fac44d-5590-43b8-b676-b9bb49d2b08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:50.357381 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fac44d-5590-43b8-b676-b9bb49d2b08e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:50.358268 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fac44d-5590-43b8-b676-b9bb49d2b08e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:50.359092 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fac44d-5590-43b8-b676-b9bb49d2b08e None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:50.360162 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-03fe9236-0a58-411a-91bb-18e697ad0e0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:13:50.360162 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:50.360162 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:50.360162 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:50.360162 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:50.360162 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:50.360162 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:50.360162 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:50.360162 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:50.360162 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:50.360162 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:50.360162 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:50.360162 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:50.360162 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:50.360162 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:50.360162 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:50.361934 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:50.361934 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:50.361934 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:50.361934 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:50.361934 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:50.361934 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:50.361934 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:50.361934 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:50.361934 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:50.361934 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:50.361934 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:50.361934 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:50.361934 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:50.361934 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:50.361934 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:50.361934 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:50.364361 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:50.364361 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:50.364361 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:50.364361 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:50.364361 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:50.364361 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:50.364361 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:50.364361 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:50.364361 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:50.364361 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:50.364361 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:13:50.364361 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:50.364361 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 327/649] 10.222.0.32 () {56 vars in 1102 bytes} [Wed Jun 1 04:13:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:50.364361 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe9236-0a58-411a-91bb-18e697ad0e0e None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:50.368180 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fac44d-5590-43b8-b676-b9bb49d2b08e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:50.369157 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fac44d-5590-43b8-b676-b9bb49d2b08e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:50.374625 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fac44d-5590-43b8-b676-b9bb49d2b08e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:50.421181 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 323/650] 10.222.0.32 () {56 vars in 1137 bytes} [Wed Jun 1 04:13:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:50.423648 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fac44d-5590-43b8-b676-b9bb49d2b08e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:50.595221 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe9236-0a58-411a-91bb-18e697ad0e0e None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:50.652447 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fac44d-5590-43b8-b676-b9bb49d2b08e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:50.674728 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2463540-4346-4a0a-b5a8-d0a1d92750e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:50.676491 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2463540-4346-4a0a-b5a8-d0a1d92750e9 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:50.677527 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2463540-4346-4a0a-b5a8-d0a1d92750e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:50.678131 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2463540-4346-4a0a-b5a8-d0a1d92750e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:50.679688 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2463540-4346-4a0a-b5a8-d0a1d92750e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:50.680317 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2463540-4346-4a0a-b5a8-d0a1d92750e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:50.683040 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2463540-4346-4a0a-b5a8-d0a1d92750e9 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:50.695628 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:50.713994 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 328/651] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:50.715672 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2463540-4346-4a0a-b5a8-d0a1d92750e9 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:50.735559 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072dc16-5262-4357-878d-59505ab0d437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:50.736713 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072dc16-5262-4357-878d-59505ab0d437 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:50.737221 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072dc16-5262-4357-878d-59505ab0d437 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:50.737722 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072dc16-5262-4357-878d-59505ab0d437 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:50.739455 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072dc16-5262-4357-878d-59505ab0d437 None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:50.740349 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072dc16-5262-4357-878d-59505ab0d437 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:50.743223 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072dc16-5262-4357-878d-59505ab0d437 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:50.760264 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 324/652] 10.222.0.32 () {56 vars in 1103 bytes} [Wed Jun 1 04:13:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:50.761928 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072dc16-5262-4357-878d-59505ab0d437 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:50.772903 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:50.946936 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2463540-4346-4a0a-b5a8-d0a1d92750e9 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:50.967971 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072dc16-5262-4357-878d-59505ab0d437 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:50.995402 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8ba4a-3920-4450-a8fd-fdad5588c285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:50.996353 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8ba4a-3920-4450-a8fd-fdad5588c285 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:50.997059 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8ba4a-3920-4450-a8fd-fdad5588c285 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:50.997492 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8ba4a-3920-4450-a8fd-fdad5588c285 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:51.037799 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cf75c-2e19-405f-a0c0-fbf0491f4e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:51.039344 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cf75c-2e19-405f-a0c0-fbf0491f4e66 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:51.039950 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cf75c-2e19-405f-a0c0-fbf0491f4e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:51.040519 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cf75c-2e19-405f-a0c0-fbf0491f4e66 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:51.056405 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540cf75c-2e19-405f-a0c0-fbf0491f4e66 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:51.059302 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540cf75c-2e19-405f-a0c0-fbf0491f4e66 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:51.086875 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-540cf75c-2e19-405f-a0c0-fbf0491f4e66 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 01 04:13:51.086875 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:51.086875 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:51.086875 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:51.086875 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:51.086875 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:51.086875 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:51.086875 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:51.086875 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:51.086875 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:51.086875 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:51.086875 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:51.086875 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 04:13:51.086875 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 04:13:51.086875 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 04:13:51.086875 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 04:13:51.088057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:51.088057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:51.088057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 04:13:51.088057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:13:51.088057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 04:13:51.088057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:13:51.088057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:51.088057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:51.088057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:51.088057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:51.088057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:51.088057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:51.088057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:51.088057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:51.088057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:51.088057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:51.088057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:51.088057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:51.089260 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:51.089260 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:51.089260 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 04:13:51.089260 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 04:13:51.089260 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 04:13:51.089260 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 04:13:51.089260 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 04:13:51.089260 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 04:13:51.089260 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 01 04:13:51.089260 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:51.090769 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c8ba4a-3920-4450-a8fd-fdad5588c285 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:51.092459 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c8ba4a-3920-4450-a8fd-fdad5588c285 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:51.098636 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 325/653] 10.222.0.32 () {56 vars in 1093 bytes} [Wed Jun 1 04:13:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:51.100737 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cf75c-2e19-405f-a0c0-fbf0491f4e66 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:51.125051 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:51.206663 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:51.235714 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 329/654] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:13:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 04:13:51.237283 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8ba4a-3920-4450-a8fd-fdad5588c285 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:51.343088 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cf75c-2e19-405f-a0c0-fbf0491f4e66 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:51.404346 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a48847-7fdd-4e64-81d8-28c45550da09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:51.405727 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a48847-7fdd-4e64-81d8-28c45550da09 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:51.406235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a48847-7fdd-4e64-81d8-28c45550da09 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:51.406675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a48847-7fdd-4e64-81d8-28c45550da09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:51.425635 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a48847-7fdd-4e64-81d8-28c45550da09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:51.428633 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a48847-7fdd-4e64-81d8-28c45550da09 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:51.449258 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8ba4a-3920-4450-a8fd-fdad5588c285 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:51.462646 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-d8a48847-7fdd-4e64-81d8-28c45550da09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:51.462646 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:51.462646 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:51.462646 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:51.462646 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:51.462646 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:51.462646 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:51.462646 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:51.462646 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:51.462646 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:51.462646 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:51.462646 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:51.462646 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:13:51.462646 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:13:51.462646 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:13:51.463610 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:13:51.463610 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:51.463610 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:51.463610 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:51.463610 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:51.463610 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:51.463610 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:51.463610 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:51.463610 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:51.463610 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:51.463610 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:51.463610 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:51.463610 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:51.463610 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:51.463610 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:51.463610 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:51.463610 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:51.464505 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:13:51.464505 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:13:51.464505 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:51.464505 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:51.465630 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 326/655] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:51.467482 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a48847-7fdd-4e64-81d8-28c45550da09 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:51.484883 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:51.500426 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aeaaa4-1264-4c95-a20a-9e3e74e2e35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:51.501490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aeaaa4-1264-4c95-a20a-9e3e74e2e35d None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:51.502306 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aeaaa4-1264-4c95-a20a-9e3e74e2e35d None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:51.502835 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aeaaa4-1264-4c95-a20a-9e3e74e2e35d None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:51.503901 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aeaaa4-1264-4c95-a20a-9e3e74e2e35d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:51.504484 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aeaaa4-1264-4c95-a20a-9e3e74e2e35d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:51.507092 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aeaaa4-1264-4c95-a20a-9e3e74e2e35d None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:51.532364 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 330/656] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Jun 1 04:13:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:51.533799 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aeaaa4-1264-4c95-a20a-9e3e74e2e35d None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:51.667744 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:51.686389 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a48847-7fdd-4e64-81d8-28c45550da09 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:51.710926 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aeaaa4-1264-4c95-a20a-9e3e74e2e35d None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:51.748213 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf44667-460e-4871-b4cc-bebcaa8378a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:51.750401 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf44667-460e-4871-b4cc-bebcaa8378a4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:51.750849 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf44667-460e-4871-b4cc-bebcaa8378a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:51.751309 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf44667-460e-4871-b4cc-bebcaa8378a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:51.765005 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f140b-fe4f-426a-a414-602effd51726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:51.765959 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f140b-fe4f-426a-a414-602effd51726 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:51.766423 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f140b-fe4f-426a-a414-602effd51726 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:51.766846 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f140b-fe4f-426a-a414-602effd51726 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:51.767990 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f140b-fe4f-426a-a414-602effd51726 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:51.768466 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f140b-fe4f-426a-a414-602effd51726 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:51.770540 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf44667-460e-4871-b4cc-bebcaa8378a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:51.771367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f140b-fe4f-426a-a414-602effd51726 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:51.773790 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf44667-460e-4871-b4cc-bebcaa8378a4 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:51.792941 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 331/657] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:51.794651 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f140b-fe4f-426a-a414-602effd51726 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:51.806496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-3bf44667-460e-4871-b4cc-bebcaa8378a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:51.806496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:51.806496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:51.806496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:51.806496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:51.806496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:51.806496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:51.806496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:51.806496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:51.806496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:51.806496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:51.806496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:51.806496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:13:51.806496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:13:51.806496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:13:51.808085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:13:51.808085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:51.808085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:51.808085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:51.808085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:51.808085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:51.808085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:51.808085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:51.808085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:51.808085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:51.808085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:51.808085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:51.808085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:51.808085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:51.808085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:51.808085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:51.808085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:51.817104 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:13:51.817104 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:13:51.817104 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:51.817104 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:51.817104 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 327/658] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:51.817104 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acf4ca-4712-4cd8-92c7-5a2e6e7bc191 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:51.817104 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acf4ca-4712-4cd8-92c7-5a2e6e7bc191 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:51.817104 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acf4ca-4712-4cd8-92c7-5a2e6e7bc191 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:51.817104 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 328/659] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:51.820038 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32acf4ca-4712-4cd8-92c7-5a2e6e7bc191 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:51.857171 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:51.941708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f140b-fe4f-426a-a414-602effd51726 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:51.976195 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32acf4ca-4712-4cd8-92c7-5a2e6e7bc191 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:52.000881 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff96661-9ce4-4808-a5f0-f4382f77f8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:52.001446 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff96661-9ce4-4808-a5f0-f4382f77f8d3 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:52.001729 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff96661-9ce4-4808-a5f0-f4382f77f8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:52.002033 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff96661-9ce4-4808-a5f0-f4382f77f8d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:52.027221 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99af49-2500-47ce-8976-fe5ca8adc54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:52.028435 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99af49-2500-47ce-8976-fe5ca8adc54b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:52.028915 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99af49-2500-47ce-8976-fe5ca8adc54b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:52.029344 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99af49-2500-47ce-8976-fe5ca8adc54b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:52.042665 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99af49-2500-47ce-8976-fe5ca8adc54b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:52.045349 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99af49-2500-47ce-8976-fe5ca8adc54b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:52.071880 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-8c99af49-2500-47ce-8976-fe5ca8adc54b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 01 04:13:52.071880 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:52.071880 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:52.071880 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:52.071880 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:52.071880 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:52.071880 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:52.071880 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:52.071880 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:52.071880 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:52.071880 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:52.071880 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:52.071880 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 04:13:52.071880 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 04:13:52.071880 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 04:13:52.071880 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 04:13:52.073251 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:52.073251 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:52.073251 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 04:13:52.073251 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:13:52.073251 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 04:13:52.073251 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:13:52.073251 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:52.073251 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:52.073251 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:52.073251 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:52.073251 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:52.073251 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:52.073251 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:52.073251 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:52.073251 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:52.073251 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:52.073251 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:52.073251 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:52.074647 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:52.074647 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:52.074647 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 04:13:52.074647 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 04:13:52.074647 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 04:13:52.074647 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 04:13:52.074647 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 04:13:52.074647 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 04:13:52.074647 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 01 04:13:52.074647 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:52.075693 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff96661-9ce4-4808-a5f0-f4382f77f8d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:52.075838 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 329/660] 10.222.0.32 () {56 vars in 1102 bytes} [Wed Jun 1 04:13:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:52.075968 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff96661-9ce4-4808-a5f0-f4382f77f8d3 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:52.076093 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99af49-2500-47ce-8976-fe5ca8adc54b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:52.082131 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:52.126309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:52.213805 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99af49-2500-47ce-8976-fe5ca8adc54b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:52.219069 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 332/661] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:13:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 04:13:52.221039 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234a450-24c2-4769-a3bb-5227a0ab9780 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:52.221521 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234a450-24c2-4769-a3bb-5227a0ab9780 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:52.221996 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234a450-24c2-4769-a3bb-5227a0ab9780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:52.249289 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-3234a450-24c2-4769-a3bb-5227a0ab9780 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:52.251299 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3234a450-24c2-4769-a3bb-5227a0ab9780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:52.252967 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc18edf-7d1a-4a0a-bc5b-851d48bb9833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:52.253646 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc18edf-7d1a-4a0a-bc5b-851d48bb9833 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:52.253928 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc18edf-7d1a-4a0a-bc5b-851d48bb9833 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:52.254233 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc18edf-7d1a-4a0a-bc5b-851d48bb9833 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:52.254965 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc18edf-7d1a-4a0a-bc5b-851d48bb9833 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:52.255300 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc18edf-7d1a-4a0a-bc5b-851d48bb9833 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:52.256695 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc18edf-7d1a-4a0a-bc5b-851d48bb9833 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:52.269265 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 330/662] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:52.271310 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4083d-7776-44e2-bbd3-b3635ac5da6b None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:52.271598 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4083d-7776-44e2-bbd3-b3635ac5da6b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:52.271872 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4083d-7776-44e2-bbd3-b3635ac5da6b None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:52.273148 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 331/663] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:52.273849 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4083d-7776-44e2-bbd3-b3635ac5da6b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:52.359273 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 333/664] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:13:52.360821 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234a450-24c2-4769-a3bb-5227a0ab9780 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:52.363623 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:52.413127 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4083d-7776-44e2-bbd3-b3635ac5da6b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:52.457825 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be233a70-595e-43e7-a7dd-42db37970cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:52.458756 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be233a70-595e-43e7-a7dd-42db37970cdc None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:52.459125 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be233a70-595e-43e7-a7dd-42db37970cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:52.459487 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be233a70-595e-43e7-a7dd-42db37970cdc None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:52.460545 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be233a70-595e-43e7-a7dd-42db37970cdc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:52.460943 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be233a70-595e-43e7-a7dd-42db37970cdc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:52.462814 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be233a70-595e-43e7-a7dd-42db37970cdc None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:52.469530 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:52.484548 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 332/665] 10.222.0.32 () {56 vars in 1139 bytes} [Wed Jun 1 04:13:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:52.485868 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be233a70-595e-43e7-a7dd-42db37970cdc None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:52.513478 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234a450-24c2-4769-a3bb-5227a0ab9780 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:52.555500 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ea850-b233-4fc0-a94a-5cc5431258d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:52.556315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ea850-b233-4fc0-a94a-5cc5431258d1 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:52.556596 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ea850-b233-4fc0-a94a-5cc5431258d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:52.556873 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ea850-b233-4fc0-a94a-5cc5431258d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:52.568796 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ea850-b233-4fc0-a94a-5cc5431258d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:52.570319 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ea850-b233-4fc0-a94a-5cc5431258d1 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:52.589603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-fb9ea850-b233-4fc0-a94a-5cc5431258d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:52.589603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:52.589603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:52.589603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:52.589603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:52.589603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:52.589603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:52.589603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:52.589603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:52.589603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:52.589603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:52.589603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:52.589603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:13:52.589603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:13:52.589603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:13:52.590675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:13:52.590675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:52.590675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:52.590675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:52.590675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:52.590675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:52.590675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:52.590675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:52.590675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:52.590675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:52.590675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:52.590675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:52.590675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:52.590675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:52.590675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:52.590675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:52.590675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:52.592055 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:13:52.592055 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:13:52.592055 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:52.592055 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:52.592055 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 334/666] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:52.592586 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db74bd-2340-4176-a9fd-f76d7f225b44 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:52.592586 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db74bd-2340-4176-a9fd-f76d7f225b44 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:52.592891 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db74bd-2340-4176-a9fd-f76d7f225b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:52.610799 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-13db74bd-2340-4176-a9fd-f76d7f225b44 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:52.612009 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-13db74bd-2340-4176-a9fd-f76d7f225b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:52.628997 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be233a70-595e-43e7-a7dd-42db37970cdc None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:52.667905 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:52.687095 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4cd736-9a3d-4f6d-aab8-55e834cc9c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:52.687904 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cd736-9a3d-4f6d-aab8-55e834cc9c64 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:52.688181 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cd736-9a3d-4f6d-aab8-55e834cc9c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:52.688542 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cd736-9a3d-4f6d-aab8-55e834cc9c64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:52.698660 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 335/667] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:13:52.698660 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db74bd-2340-4176-a9fd-f76d7f225b44 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:52.707239 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4cd736-9a3d-4f6d-aab8-55e834cc9c64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:52.710269 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4cd736-9a3d-4f6d-aab8-55e834cc9c64 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:52.736179 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-cc4cd736-9a3d-4f6d-aab8-55e834cc9c64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:13:52.736179 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:52.736179 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:52.736179 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:52.736179 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:52.736179 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:52.736179 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:52.736179 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:52.736179 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:52.736179 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:52.736179 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:52.736179 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:52.736179 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 04:13:52.736179 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 04:13:52.736179 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 04:13:52.737954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 04:13:52.737954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:52.737954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:52.737954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:52.737954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:52.737954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:52.737954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:52.737954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:52.737954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:52.737954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:52.737954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:52.737954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:52.737954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:52.737954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:52.737954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:52.737954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:52.737954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:52.740436 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 04:13:52.740436 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 04:13:52.740436 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 04:13:52.740436 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 04:13:52.740436 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 04:13:52.740436 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 04:13:52.740436 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:13:52.740436 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:52.740436 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 333/668] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:13:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:52.740436 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4cd736-9a3d-4f6d-aab8-55e834cc9c64 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:52.761299 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:52.818581 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db74bd-2340-4176-a9fd-f76d7f225b44 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:52.857472 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255a5cf-cecb-492a-9dd5-cb823ebd1da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:52.858429 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255a5cf-cecb-492a-9dd5-cb823ebd1da4 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:52.858777 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255a5cf-cecb-492a-9dd5-cb823ebd1da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:52.859194 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255a5cf-cecb-492a-9dd5-cb823ebd1da4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:52.867560 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4cd736-9a3d-4f6d-aab8-55e834cc9c64 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:52.878176 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255a5cf-cecb-492a-9dd5-cb823ebd1da4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:52.892325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-d255a5cf-cecb-492a-9dd5-cb823ebd1da4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:13:52.892325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:52.892325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:52.892325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:52.892325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:52.892325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:52.892325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:52.892325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:52.892325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:52.892325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:52.892325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:52.892325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:52.892325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:52.892325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:52.892325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:52.892325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:52.893542 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:52.893542 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:52.893542 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:52.893542 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:52.893542 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:52.893542 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:52.893542 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:52.893542 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:52.893542 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:52.893542 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:52.893542 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:52.893542 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:52.893542 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:52.893542 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:52.893542 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:52.893542 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:52.894673 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:52.894673 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:52.894673 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:52.894673 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:52.894673 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:52.894673 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:52.894673 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:52.894673 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:52.894673 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:52.894673 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:52.894673 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:13:52.894673 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:52.894673 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 336/669] 10.222.0.32 () {56 vars in 1102 bytes} [Wed Jun 1 04:13:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:52.896020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255a5cf-cecb-492a-9dd5-cb823ebd1da4 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:52.919511 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292bf47-91b7-4793-a679-01e5b0574e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:52.920367 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292bf47-91b7-4793-a679-01e5b0574e32 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:52.920737 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292bf47-91b7-4793-a679-01e5b0574e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:52.921081 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292bf47-91b7-4793-a679-01e5b0574e32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:52.995500 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:53.025489 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292bf47-91b7-4793-a679-01e5b0574e32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:53.027436 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292bf47-91b7-4793-a679-01e5b0574e32 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:53.042566 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255a5cf-cecb-492a-9dd5-cb823ebd1da4 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:53.059776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:53.084521 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d570f-560f-4345-b486-30e74ee00d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:53.085286 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d570f-560f-4345-b486-30e74ee00d36 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:53.085653 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d570f-560f-4345-b486-30e74ee00d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:53.086156 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d570f-560f-4345-b486-30e74ee00d36 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:53.086933 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d570f-560f-4345-b486-30e74ee00d36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:53.087239 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d570f-560f-4345-b486-30e74ee00d36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:53.088645 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d570f-560f-4345-b486-30e74ee00d36 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:53.109130 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 337/670] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:53.110500 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d570f-560f-4345-b486-30e74ee00d36 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:53.148109 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 334/671] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:13:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 04:13:53.149740 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292bf47-91b7-4793-a679-01e5b0574e32 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:53.255459 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d570f-560f-4345-b486-30e74ee00d36 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:53.269599 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:53.290206 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292bf47-91b7-4793-a679-01e5b0574e32 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:53.300793 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c490e4c-3a21-410d-834d-771fdc6691ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:53.302160 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c490e4c-3a21-410d-834d-771fdc6691ee None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:53.302654 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c490e4c-3a21-410d-834d-771fdc6691ee None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:53.303132 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c490e4c-3a21-410d-834d-771fdc6691ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:53.320945 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c490e4c-3a21-410d-834d-771fdc6691ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:53.323475 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c490e4c-3a21-410d-834d-771fdc6691ee None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:53.325248 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc37a90-52de-44bd-82fb-77a6e4777a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:53.325926 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc37a90-52de-44bd-82fb-77a6e4777a99 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:53.326249 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc37a90-52de-44bd-82fb-77a6e4777a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:53.326534 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc37a90-52de-44bd-82fb-77a6e4777a99 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:53.327321 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc37a90-52de-44bd-82fb-77a6e4777a99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:53.327637 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc37a90-52de-44bd-82fb-77a6e4777a99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:53.329075 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc37a90-52de-44bd-82fb-77a6e4777a99 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:53.342499 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 335/672] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Jun 1 04:13:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:53.343268 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc37a90-52de-44bd-82fb-77a6e4777a99 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:53.348112 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-2c490e4c-3a21-410d-834d-771fdc6691ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:53.348112 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:53.348112 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:53.348112 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:53.348112 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:53.348112 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:53.348112 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:53.348112 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:53.348112 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:53.348112 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:53.348112 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:53.348112 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:53.348112 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:13:53.348112 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:13:53.348112 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:13:53.349730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:13:53.349730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:53.349730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:53.349730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:53.349730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:53.349730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:53.349730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:53.349730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:53.349730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:53.349730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:53.349730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:53.349730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:53.349730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:53.349730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:53.349730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:53.349730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:53.349730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:53.351359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:13:53.351359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:13:53.351359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:53.351359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:53.352078 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 338/673] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:53.353073 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c490e4c-3a21-410d-834d-771fdc6691ee None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:53.384160 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:53.472322 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c490e4c-3a21-410d-834d-771fdc6691ee None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:53.502819 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc37a90-52de-44bd-82fb-77a6e4777a99 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:53.508098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce0191-b760-45ac-ac79-19ebd311bc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:53.508912 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce0191-b760-45ac-ac79-19ebd311bc1b None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:53.509191 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce0191-b760-45ac-ac79-19ebd311bc1b None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:53.509466 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce0191-b760-45ac-ac79-19ebd311bc1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:53.517054 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce0191-b760-45ac-ac79-19ebd311bc1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:53.518564 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce0191-b760-45ac-ac79-19ebd311bc1b None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:53.532882 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-1fce0191-b760-45ac-ac79-19ebd311bc1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:13:53.532882 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:53.532882 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:53.532882 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:53.532882 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:53.532882 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:53.532882 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:53.532882 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:53.532882 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:53.532882 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:53.532882 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:53.532882 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:53.532882 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 04:13:53.532882 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 04:13:53.532882 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 04:13:53.533943 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 04:13:53.533943 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:53.533943 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:53.533943 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:53.533943 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:53.533943 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:53.533943 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:53.533943 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:53.533943 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:53.533943 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:53.533943 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:53.533943 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:53.533943 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:53.533943 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:53.533943 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:53.533943 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:53.533943 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:53.535446 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 04:13:53.535446 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 04:13:53.535446 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 04:13:53.535446 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 04:13:53.535446 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 04:13:53.535446 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 04:13:53.535446 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:13:53.535446 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:53.538143 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 339/674] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:13:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:53.539907 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce0191-b760-45ac-ac79-19ebd311bc1b None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:53.562375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31517c-d113-4539-b2ca-6a8241860acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:53.563539 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31517c-d113-4539-b2ca-6a8241860acc None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:53.564048 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31517c-d113-4539-b2ca-6a8241860acc None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:53.564551 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31517c-d113-4539-b2ca-6a8241860acc None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:53.566007 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed31517c-d113-4539-b2ca-6a8241860acc None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:53.566573 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed31517c-d113-4539-b2ca-6a8241860acc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:53.570182 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed31517c-d113-4539-b2ca-6a8241860acc None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:53.584361 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 336/675] 10.222.0.32 () {56 vars in 1103 bytes} [Wed Jun 1 04:13:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:53.585489 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31517c-d113-4539-b2ca-6a8241860acc None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:53.589788 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:53.632597 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:53.649267 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce0191-b760-45ac-ac79-19ebd311bc1b None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:53.688984 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7688dd-b6a1-4edb-8433-310f86df144c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:53.689857 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7688dd-b6a1-4edb-8433-310f86df144c None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:53.690248 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7688dd-b6a1-4edb-8433-310f86df144c None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:53.690715 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7688dd-b6a1-4edb-8433-310f86df144c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:53.703301 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7688dd-b6a1-4edb-8433-310f86df144c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:53.705216 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7688dd-b6a1-4edb-8433-310f86df144c None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:53.713942 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31517c-d113-4539-b2ca-6a8241860acc None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:53.727202 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-2c7688dd-b6a1-4edb-8433-310f86df144c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:53.727202 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:53.727202 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:53.727202 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:53.727202 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:53.727202 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:53.727202 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:53.727202 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:53.727202 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:53.727202 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:53.727202 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:53.727202 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:53.727202 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:13:53.727202 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:13:53.727202 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:13:53.728181 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:13:53.728181 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:53.728181 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:53.728181 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:53.728181 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:53.728181 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:53.728181 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:53.728181 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:53.728181 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:53.728181 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:53.728181 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:53.728181 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:53.728181 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:53.728181 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:53.728181 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:53.728181 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:53.728181 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:53.729067 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:13:53.729067 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:13:53.729067 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:53.729067 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:53.729722 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 340/676] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:53.730699 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7688dd-b6a1-4edb-8433-310f86df144c None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:53.766381 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eebce24-4459-44f0-b0b8-51d787e41ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:53.767035 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebce24-4459-44f0-b0b8-51d787e41ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:53.767317 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebce24-4459-44f0-b0b8-51d787e41ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:53.767592 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebce24-4459-44f0-b0b8-51d787e41ec7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:53.768420 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eebce24-4459-44f0-b0b8-51d787e41ec7 None admin] RBAC: Adding query filter params (role.id=5e94b8f2c0b1418e8d2a18e4fe08d4f9, scope.project.id=31d68f64d21647688074554062952074, user.id=c1fbe41fbc1e4ac4964e3a5a417b6253) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:53.768729 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eebce24-4459-44f0-b0b8-51d787e41ec7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:53.770190 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eebce24-4459-44f0-b0b8-51d787e41ec7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:53.776852 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 337/677] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:13:53 2022] GET /identity/v3/role_assignments?user.id=c1fbe41fbc1e4ac4964e3a5a417b6253&scope.project.id=31d68f64d21647688074554062952074&role.id=5e94b8f2c0b1418e8d2a18e4fe08d4f9 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:53.777647 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eebce24-4459-44f0-b0b8-51d787e41ec7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:53.881477 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:53.907921 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7688dd-b6a1-4edb-8433-310f86df144c None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:53.936940 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eebce24-4459-44f0-b0b8-51d787e41ec7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:53.957704 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef8abc-f371-406d-9cb1-8bc1f79471fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:53.959206 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef8abc-f371-406d-9cb1-8bc1f79471fb None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:53.959610 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef8abc-f371-406d-9cb1-8bc1f79471fb None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:53.960073 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef8abc-f371-406d-9cb1-8bc1f79471fb None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:53.961127 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef8abc-f371-406d-9cb1-8bc1f79471fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:53.961561 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef8abc-f371-406d-9cb1-8bc1f79471fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:53.963157 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef8abc-f371-406d-9cb1-8bc1f79471fb None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:53.973187 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:53.988057 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 341/678] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:13:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:53.988057 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef8abc-f371-406d-9cb1-8bc1f79471fb None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:54.000507 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca229ff-85ed-4d75-8bf6-11236a4df213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:54.001490 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca229ff-85ed-4d75-8bf6-11236a4df213 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:54.001965 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca229ff-85ed-4d75-8bf6-11236a4df213 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:54.002514 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca229ff-85ed-4d75-8bf6-11236a4df213 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:54.003790 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca229ff-85ed-4d75-8bf6-11236a4df213 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:54.004300 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca229ff-85ed-4d75-8bf6-11236a4df213 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:54.007564 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca229ff-85ed-4d75-8bf6-11236a4df213 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:54.029144 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 338/679] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Jun 1 04:13:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:54.030535 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca229ff-85ed-4d75-8bf6-11236a4df213 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:54.136435 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef8abc-f371-406d-9cb1-8bc1f79471fb None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:54.181114 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d84cc-7d4d-408f-9136-aab0a69545df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:54.182735 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d84cc-7d4d-408f-9136-aab0a69545df None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:54.183199 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d84cc-7d4d-408f-9136-aab0a69545df None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:54.183725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d84cc-7d4d-408f-9136-aab0a69545df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:54.187093 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca229ff-85ed-4d75-8bf6-11236a4df213 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:54.205517 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d84cc-7d4d-408f-9136-aab0a69545df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:54.207026 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d84cc-7d4d-408f-9136-aab0a69545df None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:54.220153 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:54.235183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b5290-ed16-40ba-a3c1-3c8d4c51156a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:54.236061 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b5290-ed16-40ba-a3c1-3c8d4c51156a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:54.236471 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b5290-ed16-40ba-a3c1-3c8d4c51156a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:54.236876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b5290-ed16-40ba-a3c1-3c8d4c51156a None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:54.237739 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b5290-ed16-40ba-a3c1-3c8d4c51156a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:54.238234 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b5290-ed16-40ba-a3c1-3c8d4c51156a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:54.239862 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b5290-ed16-40ba-a3c1-3c8d4c51156a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:54.242333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-7c8d84cc-7d4d-408f-9136-aab0a69545df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:54.242333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:54.242333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:54.242333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:54.242333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:54.242333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:54.242333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:54.242333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:54.242333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:54.242333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:54.242333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:54.242333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:54.242333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:13:54.242333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:13:54.242333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:13:54.244447 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:13:54.244447 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:54.244447 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:54.244447 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:54.244447 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:54.244447 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:54.244447 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:54.244447 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:54.244447 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:54.244447 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:54.244447 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:54.244447 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:54.244447 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:54.244447 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:54.244447 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:54.244447 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:54.244447 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:54.249118 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:13:54.249118 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:13:54.249118 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:54.249118 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:54.249118 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 342/680] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:54.249118 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d84cc-7d4d-408f-9136-aab0a69545df None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:54.264376 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 339/681] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:54.270250 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b5290-ed16-40ba-a3c1-3c8d4c51156a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:54.338441 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:54.383190 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b5290-ed16-40ba-a3c1-3c8d4c51156a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:54.421175 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ed461-079d-4223-b9dc-b7662c55de3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:54.421898 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ed461-079d-4223-b9dc-b7662c55de3b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:54.422200 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ed461-079d-4223-b9dc-b7662c55de3b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:54.422472 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ed461-079d-4223-b9dc-b7662c55de3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:54.423306 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ed461-079d-4223-b9dc-b7662c55de3b None admin] RBAC: Adding query filter params (role.id=5e94b8f2c0b1418e8d2a18e4fe08d4f9, scope.project.id=31d68f64d21647688074554062952074, user.id=79d614f85f5541d3babbb41468cbf55c) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:54.423670 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ed461-079d-4223-b9dc-b7662c55de3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:54.424850 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d84cc-7d4d-408f-9136-aab0a69545df None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:54.425120 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ed461-079d-4223-b9dc-b7662c55de3b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:54.436345 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 340/682] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:13:54 2022] GET /identity/v3/role_assignments?user.id=79d614f85f5541d3babbb41468cbf55c&scope.project.id=31d68f64d21647688074554062952074&role.id=5e94b8f2c0b1418e8d2a18e4fe08d4f9 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:54.437515 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ed461-079d-4223-b9dc-b7662c55de3b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:54.486729 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d9a21-c398-488e-a71c-1f5431cbf9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:54.490268 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d9a21-c398-488e-a71c-1f5431cbf9d5 None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:54.491094 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d9a21-c398-488e-a71c-1f5431cbf9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:54.491841 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d9a21-c398-488e-a71c-1f5431cbf9d5 None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:54.493309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d9a21-c398-488e-a71c-1f5431cbf9d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:54.497891 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d9a21-c398-488e-a71c-1f5431cbf9d5 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:54.512053 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:54.529778 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 343/683] 10.222.0.32 () {60 vars in 1132 bytes} [Wed Jun 1 04:13:54 2022] POST /identity/v3/users => generated 254 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:13:54.531274 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d9a21-c398-488e-a71c-1f5431cbf9d5 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:54.582701 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ed461-079d-4223-b9dc-b7662c55de3b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:54.624327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9110beb-ea69-4d2b-bd46-b4187cadf64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:54.625028 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9110beb-ea69-4d2b-bd46-b4187cadf64c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:54.625333 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9110beb-ea69-4d2b-bd46-b4187cadf64c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:54.625599 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9110beb-ea69-4d2b-bd46-b4187cadf64c None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:54.626657 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9110beb-ea69-4d2b-bd46-b4187cadf64c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:54.626970 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9110beb-ea69-4d2b-bd46-b4187cadf64c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:54.628637 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9110beb-ea69-4d2b-bd46-b4187cadf64c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:54.643818 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 341/684] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:54.649484 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9110beb-ea69-4d2b-bd46-b4187cadf64c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:54.667613 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d9a21-c398-488e-a71c-1f5431cbf9d5 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:54.677417 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:54.744677 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3076dc-86bf-445a-bec7-b35956d261e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:54.745522 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3076dc-86bf-445a-bec7-b35956d261e1 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:54.745806 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3076dc-86bf-445a-bec7-b35956d261e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:54.746125 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3076dc-86bf-445a-bec7-b35956d261e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:54.765844 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3076dc-86bf-445a-bec7-b35956d261e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:54.767463 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3076dc-86bf-445a-bec7-b35956d261e1 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:54.805773 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-2c3076dc-86bf-445a-bec7-b35956d261e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:13:54.805773 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:54.805773 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:54.805773 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:54.805773 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:54.805773 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:54.805773 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:54.805773 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:54.805773 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:54.805773 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:54.805773 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:54.805773 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:54.805773 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 04:13:54.805773 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 04:13:54.805773 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 04:13:54.806776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 04:13:54.806776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:54.806776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:54.806776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:54.806776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:54.806776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:54.806776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:54.806776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:54.806776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:54.806776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:54.806776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:54.806776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:54.806776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:54.806776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:54.806776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:54.806776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:54.806776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:54.807667 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 04:13:54.807667 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 04:13:54.807667 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 04:13:54.807667 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 04:13:54.807667 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 04:13:54.807667 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 04:13:54.807667 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:13:54.807667 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:54.807667 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 344/685] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:13:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:54.813170 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3076dc-86bf-445a-bec7-b35956d261e1 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:54.830780 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9110beb-ea69-4d2b-bd46-b4187cadf64c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:54.850610 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:54.885662 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f327c5-5a62-4f3b-91af-1ace56a78fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:54.887202 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f327c5-5a62-4f3b-91af-1ace56a78fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:54.887721 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f327c5-5a62-4f3b-91af-1ace56a78fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:54.888379 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f327c5-5a62-4f3b-91af-1ace56a78fe2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:54.899972 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f327c5-5a62-4f3b-91af-1ace56a78fe2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:54.901759 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f327c5-5a62-4f3b-91af-1ace56a78fe2 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:54.921588 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-60f327c5-5a62-4f3b-91af-1ace56a78fe2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 01 04:13:54.921588 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:54.921588 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:54.921588 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:54.921588 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:54.921588 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:54.921588 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:54.921588 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:54.921588 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:54.921588 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:54.921588 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:54.921588 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:54.921588 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 04:13:54.921588 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 04:13:54.921588 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 04:13:54.921588 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 04:13:54.922674 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:54.922674 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:54.922674 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 04:13:54.922674 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:13:54.922674 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 04:13:54.922674 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:13:54.922674 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:54.922674 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:54.922674 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:54.922674 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:54.922674 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:54.922674 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:54.922674 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:54.922674 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:54.922674 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:54.922674 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:54.922674 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:54.922674 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:54.923953 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:54.923953 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:54.923953 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 04:13:54.923953 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 04:13:54.923953 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 04:13:54.923953 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 04:13:54.923953 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 04:13:54.923953 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 04:13:54.923953 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 01 04:13:54.923953 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:54.923953 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 342/686] 10.222.0.32 () {56 vars in 1096 bytes} [Wed Jun 1 04:13:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:13:54.930224 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f327c5-5a62-4f3b-91af-1ace56a78fe2 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:54.962969 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3076dc-86bf-445a-bec7-b35956d261e1 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:55.019516 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5073792-5959-44a1-933e-f967808019bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:55.020627 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5073792-5959-44a1-933e-f967808019bd None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:55.021128 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5073792-5959-44a1-933e-f967808019bd None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:55.021619 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5073792-5959-44a1-933e-f967808019bd None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:55.022698 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5073792-5959-44a1-933e-f967808019bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:55.023234 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5073792-5959-44a1-933e-f967808019bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:55.024947 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5073792-5959-44a1-933e-f967808019bd None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:55.040106 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 345/687] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Jun 1 04:13:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:13:55.045787 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5073792-5959-44a1-933e-f967808019bd None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:55.105034 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:55.131496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f327c5-5a62-4f3b-91af-1ace56a78fe2 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:55.213810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125aaa24-c31d-4255-9481-33edf4b5082a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:55.216364 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125aaa24-c31d-4255-9481-33edf4b5082a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:55.217472 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125aaa24-c31d-4255-9481-33edf4b5082a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:55.218665 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125aaa24-c31d-4255-9481-33edf4b5082a None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:55.222025 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125aaa24-c31d-4255-9481-33edf4b5082a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:55.224727 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125aaa24-c31d-4255-9481-33edf4b5082a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:55.229302 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125aaa24-c31d-4255-9481-33edf4b5082a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:55.287420 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 343/688] 10.222.0.32 () {56 vars in 1135 bytes} [Wed Jun 1 04:13:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:55.294122 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5073792-5959-44a1-933e-f967808019bd None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:55.301260 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125aaa24-c31d-4255-9481-33edf4b5082a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:55.346727 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd572c-731c-493b-aea7-eadf61899dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:55.347390 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd572c-731c-493b-aea7-eadf61899dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:55.347729 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd572c-731c-493b-aea7-eadf61899dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:55.348116 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd572c-731c-493b-aea7-eadf61899dc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:55.349587 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:55.350193 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dd572c-731c-493b-aea7-eadf61899dc3 None admin] RBAC: Adding query filter params (role.id=5e94b8f2c0b1418e8d2a18e4fe08d4f9, scope.project.id=31d68f64d21647688074554062952074, user.id=dca5f9455ef349738adf4569fe5ed165) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:55.350515 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dd572c-731c-493b-aea7-eadf61899dc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:55.351989 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dd572c-731c-493b-aea7-eadf61899dc3 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:55.361659 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 346/689] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:13:55 2022] GET /identity/v3/role_assignments?user.id=dca5f9455ef349738adf4569fe5ed165&scope.project.id=31d68f64d21647688074554062952074&role.id=5e94b8f2c0b1418e8d2a18e4fe08d4f9 => generated 608 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:55.464808 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125aaa24-c31d-4255-9481-33edf4b5082a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:55.523879 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f0dd0-2bc2-40b3-b0fe-e94d64b71fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:55.524607 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f0dd0-2bc2-40b3-b0fe-e94d64b71fcc None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:55.524902 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f0dd0-2bc2-40b3-b0fe-e94d64b71fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:55.525186 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f0dd0-2bc2-40b3-b0fe-e94d64b71fcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:55.630842 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f0dd0-2bc2-40b3-b0fe-e94d64b71fcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:55.632292 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f0dd0-2bc2-40b3-b0fe-e94d64b71fcc None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:55.676810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:55.811025 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 344/690] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:13:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 01 04:13:55.820465 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd572c-731c-493b-aea7-eadf61899dc3 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:55.962675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:55.973533 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd572c-731c-493b-aea7-eadf61899dc3 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:56.018467 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75a205-0fbe-4bce-876e-e5ecfba60e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:56.019268 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75a205-0fbe-4bce-876e-e5ecfba60e2f None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:56.019555 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75a205-0fbe-4bce-876e-e5ecfba60e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:56.019835 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75a205-0fbe-4bce-876e-e5ecfba60e2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:56.037275 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e75a205-0fbe-4bce-876e-e5ecfba60e2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:56.038989 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e75a205-0fbe-4bce-876e-e5ecfba60e2f None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:56.063847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-2e75a205-0fbe-4bce-876e-e5ecfba60e2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:56.063847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:56.063847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:56.063847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:56.063847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:56.063847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:56.063847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:56.063847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:56.063847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:56.063847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:56.063847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:56.063847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:56.063847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:13:56.063847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:13:56.063847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:13:56.064821 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:13:56.064821 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:56.064821 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:56.064821 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:56.064821 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:56.064821 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:56.064821 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:56.064821 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:56.064821 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:56.064821 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:56.064821 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:56.064821 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:56.064821 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:56.064821 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:56.064821 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:56.064821 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:56.064821 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:56.065721 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:13:56.065721 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:13:56.065721 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:56.065721 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:56.065721 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 347/691] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:56.073871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f0dd0-2bc2-40b3-b0fe-e94d64b71fcc None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:56.292882 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f0dd0-2bc2-40b3-b0fe-e94d64b71fcc None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:56.322202 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:56.338124 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082aef99-e0b0-47a4-9b6f-464482f96a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:56.338818 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082aef99-e0b0-47a4-9b6f-464482f96a74 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:56.339103 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082aef99-e0b0-47a4-9b6f-464482f96a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:56.339386 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082aef99-e0b0-47a4-9b6f-464482f96a74 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:56.340117 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082aef99-e0b0-47a4-9b6f-464482f96a74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:56.340429 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082aef99-e0b0-47a4-9b6f-464482f96a74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:56.341831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082aef99-e0b0-47a4-9b6f-464482f96a74 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:56.362590 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 345/692] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:56.371119 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75a205-0fbe-4bce-876e-e5ecfba60e2f None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:56.542072 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75a205-0fbe-4bce-876e-e5ecfba60e2f None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:56.593088 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4ecab-7811-4ff3-a3af-de0423dfaf9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:56.593816 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4ecab-7811-4ff3-a3af-de0423dfaf9c None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:56.594135 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4ecab-7811-4ff3-a3af-de0423dfaf9c None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:56.594415 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4ecab-7811-4ff3-a3af-de0423dfaf9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:56.606935 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4ecab-7811-4ff3-a3af-de0423dfaf9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:56.608456 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4ecab-7811-4ff3-a3af-de0423dfaf9c None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:56.634884 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-4be4ecab-7811-4ff3-a3af-de0423dfaf9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:13:56.634884 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:56.634884 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:56.634884 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:56.634884 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:56.634884 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:56.634884 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:56.634884 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:56.634884 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:56.634884 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:56.634884 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:56.634884 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:56.634884 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 04:13:56.634884 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 04:13:56.634884 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 04:13:56.635838 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 04:13:56.635838 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:56.635838 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:56.635838 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:56.635838 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:56.635838 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:56.635838 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:56.635838 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:56.635838 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:56.635838 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:56.635838 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:56.635838 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:56.635838 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:56.635838 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:56.635838 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:56.635838 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:56.635838 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:56.636723 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 04:13:56.636723 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 04:13:56.636723 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 04:13:56.636723 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 04:13:56.636723 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 04:13:56.636723 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 04:13:56.636723 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:13:56.636723 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:56.636723 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 348/693] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:13:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:56.643445 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082aef99-e0b0-47a4-9b6f-464482f96a74 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:56.672838 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53236e-92fa-4ae4-95fd-5853a6cf7284 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:56.673149 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53236e-92fa-4ae4-95fd-5853a6cf7284 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:56.673397 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53236e-92fa-4ae4-95fd-5853a6cf7284 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:56.675075 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 349/694] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:13:56.681648 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc8f99-1b45-4329-bbdc-5c29226c2b79 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:56.681937 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc8f99-1b45-4329-bbdc-5c29226c2b79 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:56.682251 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc8f99-1b45-4329-bbdc-5c29226c2b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:56.690525 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:56.712747 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-ccfc8f99-1b45-4329-bbdc-5c29226c2b79 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:56.714003 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-ccfc8f99-1b45-4329-bbdc-5c29226c2b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:56.777453 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082aef99-e0b0-47a4-9b6f-464482f96a74 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:56.816963 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e0af5-04d0-46b2-9ae9-000fc0075a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:56.817689 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e0af5-04d0-46b2-9ae9-000fc0075a39 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:56.818253 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e0af5-04d0-46b2-9ae9-000fc0075a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:56.818706 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e0af5-04d0-46b2-9ae9-000fc0075a39 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:56.819515 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e0af5-04d0-46b2-9ae9-000fc0075a39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:56.819827 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e0af5-04d0-46b2-9ae9-000fc0075a39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:56.821343 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e0af5-04d0-46b2-9ae9-000fc0075a39 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:56.836058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 346/695] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Jun 1 04:13:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:56.843598 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e0af5-04d0-46b2-9ae9-000fc0075a39 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:56.910328 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 350/696] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 04:13:56.939762 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:56.955454 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc8f99-1b45-4329-bbdc-5c29226c2b79 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:57.011811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e0af5-04d0-46b2-9ae9-000fc0075a39 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:57.049811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db781d-60b2-4f9c-9b6a-6eda7bfd1ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:57.050534 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db781d-60b2-4f9c-9b6a-6eda7bfd1ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:57.050819 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db781d-60b2-4f9c-9b6a-6eda7bfd1ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:57.051096 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db781d-60b2-4f9c-9b6a-6eda7bfd1ff6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:57.051968 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db781d-60b2-4f9c-9b6a-6eda7bfd1ff6 None admin] RBAC: Adding query filter params (role.id=5e94b8f2c0b1418e8d2a18e4fe08d4f9, scope.project.id=31d68f64d21647688074554062952074, user.id=413c6613b4ec4e53aeeaf6828c807273) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:57.052284 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db781d-60b2-4f9c-9b6a-6eda7bfd1ff6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:57.053767 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db781d-60b2-4f9c-9b6a-6eda7bfd1ff6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:57.066148 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 347/697] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:13:56 2022] GET /identity/v3/role_assignments?user.id=413c6613b4ec4e53aeeaf6828c807273&scope.project.id=31d68f64d21647688074554062952074&role.id=5e94b8f2c0b1418e8d2a18e4fe08d4f9 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:57.168477 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc8f99-1b45-4329-bbdc-5c29226c2b79 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:57.225371 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:57.233951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aba519-a624-4ab0-8390-a5381cea1a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:57.234843 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aba519-a624-4ab0-8390-a5381cea1a65 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:57.235236 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aba519-a624-4ab0-8390-a5381cea1a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:57.235592 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aba519-a624-4ab0-8390-a5381cea1a65 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:57.236280 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aba519-a624-4ab0-8390-a5381cea1a65 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:57.243903 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aba519-a624-4ab0-8390-a5381cea1a65 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:57.259906 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-67aba519-a624-4ab0-8390-a5381cea1a65 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 01 04:13:57.259906 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:57.259906 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 04:13:57.259906 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 04:13:57.259906 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 04:13:57.259906 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 04:13:57.259906 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 04:13:57.259906 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:13:57.259906 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 01 04:13:57.259906 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:57.259906 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 04:13:57.259906 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:57.259906 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:57.259906 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:57.259906 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:57.259906 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:57.260980 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:57.260980 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:57.260980 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:57.260980 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:57.260980 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:57.260980 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:57.260980 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:57.260980 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 04:13:57.260980 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 04:13:57.260980 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 04:13:57.260980 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 04:13:57.260980 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:57.260980 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:57.260980 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:57.260980 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:57.260980 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:57.261844 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:57.261844 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:57.261844 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:57.261844 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:57.261844 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:57.261844 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:57.261844 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:57.261844 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:57.261844 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:57.261844 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:57.261844 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:57.261844 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 04:13:57.261844 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:13:57.261844 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 01 04:13:57.261844 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:57.261844 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 351/698] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Jun 1 04:13:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:13:57.269436 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db781d-60b2-4f9c-9b6a-6eda7bfd1ff6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:57.397424 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db781d-60b2-4f9c-9b6a-6eda7bfd1ff6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:57.415637 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:57.441204 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f950f-77d7-467a-9a92-d0bb6b250dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:57.441903 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f950f-77d7-467a-9a92-d0bb6b250dcc None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:57.442222 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f950f-77d7-467a-9a92-d0bb6b250dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:57.443299 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f950f-77d7-467a-9a92-d0bb6b250dcc None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:57.444169 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f950f-77d7-467a-9a92-d0bb6b250dcc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:57.444445 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f950f-77d7-467a-9a92-d0bb6b250dcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:57.445995 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f950f-77d7-467a-9a92-d0bb6b250dcc None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:57.452027 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 348/699] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Jun 1 04:13:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:57.459120 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aba519-a624-4ab0-8390-a5381cea1a65 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:57.584610 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aba519-a624-4ab0-8390-a5381cea1a65 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:57.621871 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c51ea-b0ef-4af9-9c56-4ee1465373d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:57.622577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c51ea-b0ef-4af9-9c56-4ee1465373d4 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:57.622860 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c51ea-b0ef-4af9-9c56-4ee1465373d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:57.623137 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c51ea-b0ef-4af9-9c56-4ee1465373d4 None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:57.623856 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c51ea-b0ef-4af9-9c56-4ee1465373d4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:57.624162 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c51ea-b0ef-4af9-9c56-4ee1465373d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:57.625616 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c51ea-b0ef-4af9-9c56-4ee1465373d4 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:57.632910 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 352/700] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Jun 1 04:13:57 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:57.702511 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66ffb4-1edd-44d3-b281-8283daeaeaf0 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:57.702718 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66ffb4-1edd-44d3-b281-8283daeaeaf0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:57.702998 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66ffb4-1edd-44d3-b281-8283daeaeaf0 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:57.704923 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 349/701] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:57.712169 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edfff1-3e52-4622-aa1a-df5330e98b79 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:57.712479 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edfff1-3e52-4622-aa1a-df5330e98b79 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:57.712738 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edfff1-3e52-4622-aa1a-df5330e98b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:57.738435 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-80edfff1-3e52-4622-aa1a-df5330e98b79 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:57.740350 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-80edfff1-3e52-4622-aa1a-df5330e98b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:57.823714 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:57.844674 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 353/702] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 04:13:57.887481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66ffb4-1edd-44d3-b281-8283daeaeaf0 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:57.894719 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a53d3-b7ac-4ab2-93d8-16653a21dc31 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:57.895026 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a53d3-b7ac-4ab2-93d8-16653a21dc31 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:57.895280 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a53d3-b7ac-4ab2-93d8-16653a21dc31 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:57.896709 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 354/703] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:57.906066 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3c49d-f0e6-41a7-91f8-5f4c11304de4 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:57.906066 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3c49d-f0e6-41a7-91f8-5f4c11304de4 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:57.906066 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3c49d-f0e6-41a7-91f8-5f4c11304de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:57.926153 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-01d3c49d-f0e6-41a7-91f8-5f4c11304de4 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:57.927924 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-01d3c49d-f0e6-41a7-91f8-5f4c11304de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:58.011675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66ffb4-1edd-44d3-b281-8283daeaeaf0 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:58.050134 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 355/704] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 04:13:58.065190 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657d8b4-b2bb-4ec7-8b1b-5776cd0e5515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:58.066062 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657d8b4-b2bb-4ec7-8b1b-5776cd0e5515 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:58.066387 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657d8b4-b2bb-4ec7-8b1b-5776cd0e5515 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:58.066666 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657d8b4-b2bb-4ec7-8b1b-5776cd0e5515 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:58.082304 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657d8b4-b2bb-4ec7-8b1b-5776cd0e5515 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:58.096375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-9657d8b4-b2bb-4ec7-8b1b-5776cd0e5515 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:13:58.096375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:58.096375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:58.096375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:58.096375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:58.096375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:58.096375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:58.096375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:58.096375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:58.096375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:58.096375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:58.096375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:58.096375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:58.096375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:58.096375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:58.096375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:58.097394 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:58.097394 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:58.097394 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:58.097394 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:58.097394 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:58.097394 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:58.097394 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:58.097394 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:58.097394 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:58.097394 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:58.097394 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:58.097394 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:58.097394 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:58.097394 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:58.097394 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:58.097394 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:58.098279 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:58.098279 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:58.098279 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:58.098279 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:58.098279 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:58.098279 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:58.098279 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:58.098279 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:58.098279 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:58.098279 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:58.098279 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:13:58.098279 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:58.098279 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 350/705] 10.222.0.32 () {56 vars in 1096 bytes} [Wed Jun 1 04:13:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:58.103987 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3c49d-f0e6-41a7-91f8-5f4c11304de4 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:58.147766 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657d8b4-b2bb-4ec7-8b1b-5776cd0e5515 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:58.218812 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:58.314422 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3c49d-f0e6-41a7-91f8-5f4c11304de4 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:58.336679 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657d8b4-b2bb-4ec7-8b1b-5776cd0e5515 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:58.370610 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:58.403036 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c689ca7-5935-4bd2-852d-6ad56f16bfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:58.404455 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c689ca7-5935-4bd2-852d-6ad56f16bfdf None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:58.404928 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c689ca7-5935-4bd2-852d-6ad56f16bfdf None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:58.405404 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c689ca7-5935-4bd2-852d-6ad56f16bfdf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:58.424302 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c689ca7-5935-4bd2-852d-6ad56f16bfdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:13:58.433381 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69a51e-195b-4c0f-8086-70ebb0acdca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:58.434202 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69a51e-195b-4c0f-8086-70ebb0acdca2 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:58.434485 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69a51e-195b-4c0f-8086-70ebb0acdca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:58.434762 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69a51e-195b-4c0f-8086-70ebb0acdca2 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:58.435521 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b69a51e-195b-4c0f-8086-70ebb0acdca2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:58.435826 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b69a51e-195b-4c0f-8086-70ebb0acdca2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:58.437202 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b69a51e-195b-4c0f-8086-70ebb0acdca2 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:58.439867 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-1c689ca7-5935-4bd2-852d-6ad56f16bfdf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:13:58.439867 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:58.439867 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:58.439867 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:58.439867 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:58.439867 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:58.439867 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:58.439867 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:58.439867 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:58.439867 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:58.439867 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:58.439867 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:58.439867 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:13:58.439867 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:13:58.439867 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:13:58.439867 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:13:58.440826 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:13:58.440826 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:13:58.440826 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:13:58.440826 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:13:58.440826 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:58.440826 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:58.440826 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:58.440826 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:58.440826 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:58.440826 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:58.440826 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:58.440826 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:58.440826 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:58.440826 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:58.440826 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:58.440826 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:58.441687 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:58.441687 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:58.441687 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:58.441687 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:58.441687 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:13:58.441687 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:13:58.441687 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:13:58.441687 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:13:58.441687 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:13:58.441687 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:13:58.441687 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:13:58.441687 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:58.446714 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 351/706] 10.222.0.32 () {56 vars in 1102 bytes} [Wed Jun 1 04:13:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:58.453055 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c689ca7-5935-4bd2-852d-6ad56f16bfdf None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:58.464253 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 356/707] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:13:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:58.491154 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69a51e-195b-4c0f-8086-70ebb0acdca2 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:58.629109 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:58.636866 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c689ca7-5935-4bd2-852d-6ad56f16bfdf None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:58.673930 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f12a4-585b-40e6-a84f-fc2c52313338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:58.674644 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f12a4-585b-40e6-a84f-fc2c52313338 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:58.674928 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f12a4-585b-40e6-a84f-fc2c52313338 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:58.675206 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f12a4-585b-40e6-a84f-fc2c52313338 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:58.675978 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f12a4-585b-40e6-a84f-fc2c52313338 None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:58.676287 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f12a4-585b-40e6-a84f-fc2c52313338 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:58.677728 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f12a4-585b-40e6-a84f-fc2c52313338 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:58.691470 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 352/708] 10.222.0.32 () {56 vars in 1103 bytes} [Wed Jun 1 04:13:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:58.693569 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f12a4-585b-40e6-a84f-fc2c52313338 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:58.796722 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f12a4-585b-40e6-a84f-fc2c52313338 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:58.800191 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69a51e-195b-4c0f-8086-70ebb0acdca2 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:58.832576 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09fa34a-d85e-4e9c-a3dd-935c62cd15ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:58.833949 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fa34a-d85e-4e9c-a3dd-935c62cd15ff None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:58.834259 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fa34a-d85e-4e9c-a3dd-935c62cd15ff None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:58.834538 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fa34a-d85e-4e9c-a3dd-935c62cd15ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:58.846013 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09fa34a-d85e-4e9c-a3dd-935c62cd15ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:58.847601 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09fa34a-d85e-4e9c-a3dd-935c62cd15ff None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:58.867293 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-a09fa34a-d85e-4e9c-a3dd-935c62cd15ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:58.867293 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:58.867293 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:58.867293 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:58.867293 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:58.867293 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:58.867293 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:58.867293 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:58.867293 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:58.867293 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:58.867293 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:58.867293 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:58.867293 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:13:58.867293 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:13:58.867293 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:13:58.868261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:13:58.868261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:58.868261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:58.868261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:58.868261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:58.868261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:58.868261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:58.868261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:58.868261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:58.868261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:58.868261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:58.868261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:58.868261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:58.868261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:58.868261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:58.868261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:58.868261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:58.869150 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:13:58.869150 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:13:58.869150 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:58.869150 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:58.872041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 353/709] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:58.874993 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851d98e-2c2e-433a-a45e-6578a5da2676 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:58.875359 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851d98e-2c2e-433a-a45e-6578a5da2676 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:58.875706 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851d98e-2c2e-433a-a45e-6578a5da2676 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:58.877376 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 354/710] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:13:58.878124 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851d98e-2c2e-433a-a45e-6578a5da2676 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:58.882778 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af49b47-71f7-416c-b446-15c45dec28ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:58.883736 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af49b47-71f7-416c-b446-15c45dec28ee None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:58.884123 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af49b47-71f7-416c-b446-15c45dec28ee None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:58.884503 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af49b47-71f7-416c-b446-15c45dec28ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:58.897760 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:58.899236 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af49b47-71f7-416c-b446-15c45dec28ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:58.901947 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af49b47-71f7-416c-b446-15c45dec28ee None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:58.934853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-1af49b47-71f7-416c-b446-15c45dec28ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:58.934853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:58.934853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:58.934853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:58.934853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:58.934853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:58.934853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:58.934853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:58.934853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:58.934853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:58.934853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:58.934853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:58.934853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:13:58.934853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:13:58.934853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:13:58.935871 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:13:58.935871 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:58.935871 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:58.935871 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:58.935871 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:58.935871 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:58.935871 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:58.935871 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:58.935871 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:58.935871 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:58.935871 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:58.935871 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:58.935871 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:58.935871 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:58.935871 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:58.935871 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:58.935871 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:58.936789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:13:58.936789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:13:58.936789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:13:58.936789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:58.942002 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 357/711] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:13:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 446 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:58.942002 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a1132-1862-4ba3-aebe-b6777d4ba3c4 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:58.942002 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a1132-1862-4ba3-aebe-b6777d4ba3c4 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:58.942002 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a1132-1862-4ba3-aebe-b6777d4ba3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:58.967171 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-206a1132-1862-4ba3-aebe-b6777d4ba3c4 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:13:58.968403 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-206a1132-1862-4ba3-aebe-b6777d4ba3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:13:59.012724 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:59.043703 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851d98e-2c2e-433a-a45e-6578a5da2676 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:59.070374 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 358/712] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:13:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:13:59.072272 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a1132-1862-4ba3-aebe-b6777d4ba3c4 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:59.096018 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d791cce-a7c2-4de0-b767-13ca21dc5668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:59.096700 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d791cce-a7c2-4de0-b767-13ca21dc5668 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:59.096983 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d791cce-a7c2-4de0-b767-13ca21dc5668 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:59.097259 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d791cce-a7c2-4de0-b767-13ca21dc5668 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:59.098024 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d791cce-a7c2-4de0-b767-13ca21dc5668 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:59.098350 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d791cce-a7c2-4de0-b767-13ca21dc5668 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:59.100308 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d791cce-a7c2-4de0-b767-13ca21dc5668 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:59.127757 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 355/713] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:59.130744 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d791cce-a7c2-4de0-b767-13ca21dc5668 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:59.246426 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a1132-1862-4ba3-aebe-b6777d4ba3c4 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:59.274354 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:59.304473 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d791cce-a7c2-4de0-b767-13ca21dc5668 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:59.308067 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e6fbd-c76d-4cea-9129-87cdffb7b46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:59.309274 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e6fbd-c76d-4cea-9129-87cdffb7b46e None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:59.309850 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e6fbd-c76d-4cea-9129-87cdffb7b46e None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:59.310465 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e6fbd-c76d-4cea-9129-87cdffb7b46e None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:59.311874 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e6fbd-c76d-4cea-9129-87cdffb7b46e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:59.312493 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e6fbd-c76d-4cea-9129-87cdffb7b46e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:59.315120 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e6fbd-c76d-4cea-9129-87cdffb7b46e None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:59.338713 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 359/714] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:59.339760 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e6fbd-c76d-4cea-9129-87cdffb7b46e None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:59.357460 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2cabcb-be71-4ae4-99ef-ad83b48b7ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:59.360085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2cabcb-be71-4ae4-99ef-ad83b48b7ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:59.360424 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2cabcb-be71-4ae4-99ef-ad83b48b7ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:59.360690 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2cabcb-be71-4ae4-99ef-ad83b48b7ab1 None admin] PATH_INFO: `/v3/services/network` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:59.361305 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2cabcb-be71-4ae4-99ef-ad83b48b7ab1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:59.362729 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2cabcb-be71-4ae4-99ef-ad83b48b7ab1 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:59.377199 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-bf2cabcb-be71-4ae4-99ef-ad83b48b7ab1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 01 04:13:59.377199 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:59.377199 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 04:13:59.377199 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 04:13:59.377199 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 04:13:59.377199 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 04:13:59.377199 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 04:13:59.377199 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:13:59.377199 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 01 04:13:59.377199 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:59.377199 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 04:13:59.377199 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:59.377199 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:59.377199 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:59.377199 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:59.377199 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:59.377199 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:59.379675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:59.379675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:59.379675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:59.379675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:59.379675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:59.379675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:59.379675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 04:13:59.379675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 04:13:59.379675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 04:13:59.379675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 04:13:59.379675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:59.379675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:59.379675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:59.379675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:59.379675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:59.379675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:59.383366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:59.383366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:59.383366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:59.383366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:59.383366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:59.383366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:59.383366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:59.383366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:59.383366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:59.383366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:59.383366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 04:13:59.383366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:13:59.383366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 01 04:13:59.383366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:59.386351 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 356/715] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:13:59 2022] GET /identity/v3/services/network => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:59.386351 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2cabcb-be71-4ae4-99ef-ad83b48b7ab1 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:59.392113 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:59.539841 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2cabcb-be71-4ae4-99ef-ad83b48b7ab1 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:59.549861 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e6fbd-c76d-4cea-9129-87cdffb7b46e None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:59.601390 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b65c67-f257-4205-8a91-95ecbbfc78f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:59.602633 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b5a6a-e20d-4fb9-89fc-7e678f84ccc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:59.602851 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b65c67-f257-4205-8a91-95ecbbfc78f8 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:59.603378 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b65c67-f257-4205-8a91-95ecbbfc78f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:59.603850 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b65c67-f257-4205-8a91-95ecbbfc78f8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:59.604308 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b5a6a-e20d-4fb9-89fc-7e678f84ccc8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:59.604864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b5a6a-e20d-4fb9-89fc-7e678f84ccc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:59.605442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b5a6a-e20d-4fb9-89fc-7e678f84ccc8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:59.610889 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:59.616166 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b65c67-f257-4205-8a91-95ecbbfc78f8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:59.617929 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b65c67-f257-4205-8a91-95ecbbfc78f8 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:59.628283 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b5a6a-e20d-4fb9-89fc-7e678f84ccc8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:59.632091 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b5a6a-e20d-4fb9-89fc-7e678f84ccc8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:59.639716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-76b65c67-f257-4205-8a91-95ecbbfc78f8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 01 04:13:59.639716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:59.639716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:59.639716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:59.639716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:59.639716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:59.639716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:59.639716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:59.639716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:59.639716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:59.639716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:59.639716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:59.639716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 04:13:59.639716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 04:13:59.639716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 04:13:59.639716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 04:13:59.640749 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:59.640749 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:59.640749 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 04:13:59.640749 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:13:59.640749 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 04:13:59.640749 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:13:59.640749 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:59.640749 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:59.640749 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:59.640749 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:59.640749 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:59.640749 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:59.640749 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:59.640749 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:59.640749 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:59.640749 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:59.640749 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:59.640749 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:59.641709 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:59.641709 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:59.641709 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 04:13:59.641709 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 04:13:59.641709 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 04:13:59.641709 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 04:13:59.641709 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 04:13:59.641709 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 04:13:59.641709 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 01 04:13:59.641709 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:13:59.644620 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 360/716] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Jun 1 04:13:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:59.645818 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b65c67-f257-4205-8a91-95ecbbfc78f8 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:59.670106 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-364b5a6a-e20d-4fb9-89fc-7e678f84ccc8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 01 04:13:59.670106 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:13:59.670106 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:13:59.670106 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:13:59.670106 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:13:59.670106 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:13:59.670106 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:13:59.670106 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:13:59.670106 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:13:59.670106 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:13:59.670106 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:13:59.670106 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:13:59.670106 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 04:13:59.670106 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 04:13:59.670106 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 04:13:59.670106 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 04:13:59.671136 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:13:59.671136 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:13:59.671136 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 04:13:59.671136 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:13:59.671136 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 04:13:59.671136 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:13:59.671136 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:13:59.671136 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:13:59.671136 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:13:59.671136 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:13:59.671136 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:13:59.671136 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:13:59.671136 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:13:59.671136 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:13:59.671136 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:13:59.671136 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:13:59.671136 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:13:59.671136 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:13:59.672168 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:13:59.672168 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:13:59.672168 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 04:13:59.672168 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 04:13:59.672168 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 04:13:59.672168 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 04:13:59.672168 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 04:13:59.672168 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 04:13:59.672168 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 01 04:13:59.672168 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:13:59.674899 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 357/717] 10.222.0.32 () {56 vars in 1093 bytes} [Wed Jun 1 04:13:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:13:59.676445 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b5a6a-e20d-4fb9-89fc-7e678f84ccc8 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:59.776612 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:13:59.805371 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b65c67-f257-4205-8a91-95ecbbfc78f8 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:59.849491 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b5a6a-e20d-4fb9-89fc-7e678f84ccc8 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:13:59.849737 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5229a1b-8950-4edd-a657-07b027b17904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:59.850407 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5229a1b-8950-4edd-a657-07b027b17904 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:59.850692 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5229a1b-8950-4edd-a657-07b027b17904 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:59.850971 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5229a1b-8950-4edd-a657-07b027b17904 None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:59.851743 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5229a1b-8950-4edd-a657-07b027b17904 None admin] RBAC: Adding query filter params (name=network) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:59.852092 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5229a1b-8950-4edd-a657-07b027b17904 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:59.854266 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5229a1b-8950-4edd-a657-07b027b17904 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:59.858970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 361/718] 10.222.0.32 () {56 vars in 1112 bytes} [Wed Jun 1 04:13:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:59.859951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5229a1b-8950-4edd-a657-07b027b17904 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:13:59.898116 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beba67c-078b-4c7e-975b-8c59b569fabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:13:59.899344 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beba67c-078b-4c7e-975b-8c59b569fabd None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:13:59.899819 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beba67c-078b-4c7e-975b-8c59b569fabd None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:13:59.901420 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beba67c-078b-4c7e-975b-8c59b569fabd None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:13:59.902714 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beba67c-078b-4c7e-975b-8c59b569fabd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:13:59.903249 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beba67c-078b-4c7e-975b-8c59b569fabd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:13:59.904969 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beba67c-078b-4c7e-975b-8c59b569fabd None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:13:59.929635 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 358/719] 10.222.0.32 () {56 vars in 1149 bytes} [Wed Jun 1 04:13:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:13:59.930768 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beba67c-078b-4c7e-975b-8c59b569fabd None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:00.001394 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:00.047105 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5229a1b-8950-4edd-a657-07b027b17904 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:00.066253 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beba67c-078b-4c7e-975b-8c59b569fabd None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:00.111062 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce7ae2-f662-4f38-bab2-48cca83f705e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:00.112232 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce7ae2-f662-4f38-bab2-48cca83f705e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:00.112736 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce7ae2-f662-4f38-bab2-48cca83f705e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:00.113235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce7ae2-f662-4f38-bab2-48cca83f705e None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:00.115229 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce7ae2-f662-4f38-bab2-48cca83f705e None admin] RBAC: Adding query filter params (type=network) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:00.115782 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce7ae2-f662-4f38-bab2-48cca83f705e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:00.120105 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce7ae2-f662-4f38-bab2-48cca83f705e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:00.121356 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159023d-9916-44af-bd45-58e6177be2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:00.122071 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159023d-9916-44af-bd45-58e6177be2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:00.122365 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159023d-9916-44af-bd45-58e6177be2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:00.122653 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159023d-9916-44af-bd45-58e6177be2f4 None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:00.123511 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159023d-9916-44af-bd45-58e6177be2f4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:00.123827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159023d-9916-44af-bd45-58e6177be2f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:00.125281 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159023d-9916-44af-bd45-58e6177be2f4 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:00.134888 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 359/720] 10.222.0.32 () {56 vars in 1112 bytes} [Wed Jun 1 04:13:59 2022] GET /identity/v3/services?type=network => generated 124 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:00.134888 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce7ae2-f662-4f38-bab2-48cca83f705e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:00.149122 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 362/721] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Jun 1 04:13:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:00.152785 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be06e89-e664-4056-b1f0-63d782e5fe92 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:00.152785 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be06e89-e664-4056-b1f0-63d782e5fe92 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:00.152785 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be06e89-e664-4056-b1f0-63d782e5fe92 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:00.153118 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 363/722] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:14:00.159498 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f00e7e-1537-4c63-8859-36c9e5889b19 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:00.159930 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f00e7e-1537-4c63-8859-36c9e5889b19 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:00.160318 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f00e7e-1537-4c63-8859-36c9e5889b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:00.173128 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:00.180682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-c6f00e7e-1537-4c63-8859-36c9e5889b19 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:00.182018 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c6f00e7e-1537-4c63-8859-36c9e5889b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:00.290034 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 364/723] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:14:00.290034 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f00e7e-1537-4c63-8859-36c9e5889b19 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:00.297819 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce7ae2-f662-4f38-bab2-48cca83f705e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:00.319464 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:00.345799 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840aa1e-ecbe-4d2f-aa3a-2385079d83dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:00.346800 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840aa1e-ecbe-4d2f-aa3a-2385079d83dd None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:00.347273 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840aa1e-ecbe-4d2f-aa3a-2385079d83dd None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:00.347757 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840aa1e-ecbe-4d2f-aa3a-2385079d83dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:00.443685 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c840aa1e-ecbe-4d2f-aa3a-2385079d83dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:00.444458 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f00e7e-1537-4c63-8859-36c9e5889b19 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:00.446258 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c840aa1e-ecbe-4d2f-aa3a-2385079d83dd None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:00.499136 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7255c-ea53-4a8c-8343-ebf83d736ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:00.500030 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7255c-ea53-4a8c-8343-ebf83d736ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:00.500502 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7255c-ea53-4a8c-8343-ebf83d736ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:00.500949 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7255c-ea53-4a8c-8343-ebf83d736ce8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:00.505162 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:00.585908 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 360/724] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:14:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 04:14:00.589027 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b888e-cfe4-4cf6-a47d-a0cb02a1d0ef None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:00.589534 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b888e-cfe4-4cf6-a47d-a0cb02a1d0ef None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:00.590041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b888e-cfe4-4cf6-a47d-a0cb02a1d0ef None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:00.592786 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 361/725] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:14:00.593645 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7255c-ea53-4a8c-8343-ebf83d736ce8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:00.594120 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b888e-cfe4-4cf6-a47d-a0cb02a1d0ef None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:00.595753 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7255c-ea53-4a8c-8343-ebf83d736ce8 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:00.616746 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:00.741358 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b888e-cfe4-4cf6-a47d-a0cb02a1d0ef None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:00.746667 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 365/726] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:14:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 04:14:00.746667 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9a291-f013-48d8-8adb-5096ae8bb883 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:00.746667 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9a291-f013-48d8-8adb-5096ae8bb883 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:00.746667 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9a291-f013-48d8-8adb-5096ae8bb883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:00.761485 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-07d9a291-f013-48d8-8adb-5096ae8bb883 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:00.762836 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-07d9a291-f013-48d8-8adb-5096ae8bb883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:00.788795 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10151f9-dc69-4be8-8ee4-2f454e34d2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:00.789857 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10151f9-dc69-4be8-8ee4-2f454e34d2dc None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:00.790260 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10151f9-dc69-4be8-8ee4-2f454e34d2dc None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:00.790624 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10151f9-dc69-4be8-8ee4-2f454e34d2dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:00.802312 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10151f9-dc69-4be8-8ee4-2f454e34d2dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:14:00.810239 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-a10151f9-dc69-4be8-8ee4-2f454e34d2dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:14:00.810239 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:00.810239 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:00.810239 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:00.810239 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:00.810239 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:00.810239 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:00.810239 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:00.810239 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:00.810239 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:00.810239 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:00.810239 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:00.810239 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:14:00.810239 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:14:00.810239 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:14:00.810239 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:14:00.811215 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:14:00.811215 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:14:00.811215 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:14:00.811215 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:14:00.811215 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:00.811215 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:00.811215 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:00.811215 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:00.811215 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:00.811215 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:00.811215 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:00.811215 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:00.811215 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:00.811215 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:00.811215 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:00.811215 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:00.812085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:00.812085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:00.812085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:00.812085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:00.812085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:14:00.812085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:14:00.812085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:14:00.812085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:14:00.812085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:14:00.812085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:14:00.812085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:14:00.812085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:00.812085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 362/727] 10.222.0.32 () {56 vars in 1096 bytes} [Wed Jun 1 04:14:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:00.812824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10151f9-dc69-4be8-8ee4-2f454e34d2dc None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:00.814060 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:00.890102 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 366/728] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:14:00.890907 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9a291-f013-48d8-8adb-5096ae8bb883 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:00.918202 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:00.945589 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10151f9-dc69-4be8-8ee4-2f454e34d2dc None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:00.991946 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51496f22-3589-4328-be1f-6fb42c99b1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:00.992750 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51496f22-3589-4328-be1f-6fb42c99b1c3 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:00.993047 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51496f22-3589-4328-be1f-6fb42c99b1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:00.993328 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51496f22-3589-4328-be1f-6fb42c99b1c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:01.010176 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51496f22-3589-4328-be1f-6fb42c99b1c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:01.011613 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51496f22-3589-4328-be1f-6fb42c99b1c3 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:01.047910 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9a291-f013-48d8-8adb-5096ae8bb883 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:01.051513 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-51496f22-3589-4328-be1f-6fb42c99b1c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:01.051513 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:01.051513 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:01.051513 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:01.051513 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:01.051513 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:01.051513 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:01.051513 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:01.051513 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:01.051513 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:01.051513 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:01.051513 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:01.051513 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:14:01.051513 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:14:01.051513 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:14:01.053217 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:14:01.053217 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:01.053217 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:01.053217 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:01.053217 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:01.053217 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:01.053217 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:01.053217 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:01.053217 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:01.053217 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:01.053217 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:01.053217 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:01.053217 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:01.053217 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:01.053217 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:01.053217 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:01.053217 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:01.055012 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:14:01.055012 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:14:01.055012 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:01.055012 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:01.061314 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 363/729] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:14:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:01.062984 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51496f22-3589-4328-be1f-6fb42c99b1c3 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:01.093821 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c613af-ebca-479d-b129-e6ad8e33b3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:01.094692 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c613af-ebca-479d-b129-e6ad8e33b3c7 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:01.094977 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c613af-ebca-479d-b129-e6ad8e33b3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:01.095258 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c613af-ebca-479d-b129-e6ad8e33b3c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:01.107849 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c613af-ebca-479d-b129-e6ad8e33b3c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:01.109326 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c613af-ebca-479d-b129-e6ad8e33b3c7 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:01.129119 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-b5c613af-ebca-479d-b129-e6ad8e33b3c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:01.129119 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:01.129119 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:01.129119 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:01.129119 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:01.129119 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:01.129119 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:01.129119 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:01.129119 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:01.129119 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:01.129119 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:01.129119 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:01.129119 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:14:01.129119 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:14:01.129119 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:14:01.131624 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:14:01.131624 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:01.131624 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:01.131624 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:01.131624 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:01.131624 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:01.131624 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:01.131624 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:01.131624 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:01.131624 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:01.131624 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:01.131624 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:01.131624 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:01.131624 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:01.131624 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:01.131624 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:01.131624 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:01.133547 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:14:01.133547 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:14:01.133547 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:01.133547 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:01.135428 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 367/730] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:14:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:01.136228 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c613af-ebca-479d-b129-e6ad8e33b3c7 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:01.170488 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:01.250966 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51496f22-3589-4328-be1f-6fb42c99b1c3 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:01.302491 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:01.308438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c613af-ebca-479d-b129-e6ad8e33b3c7 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:01.316534 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675d5ee-4e36-427c-b672-ae9ec4003207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:01.317661 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675d5ee-4e36-427c-b672-ae9ec4003207 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:01.318409 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675d5ee-4e36-427c-b672-ae9ec4003207 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:01.318856 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675d5ee-4e36-427c-b672-ae9ec4003207 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:01.320164 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d675d5ee-4e36-427c-b672-ae9ec4003207 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:01.320690 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d675d5ee-4e36-427c-b672-ae9ec4003207 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:01.323253 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d675d5ee-4e36-427c-b672-ae9ec4003207 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:01.339630 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 364/731] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:14:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:01.341100 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675d5ee-4e36-427c-b672-ae9ec4003207 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:01.362629 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7c5e3-7fe8-4418-af5b-69fa23066ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:01.363488 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7c5e3-7fe8-4418-af5b-69fa23066ac3 None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:01.363942 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7c5e3-7fe8-4418-af5b-69fa23066ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:01.364478 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7c5e3-7fe8-4418-af5b-69fa23066ac3 None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:01.365742 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7c5e3-7fe8-4418-af5b-69fa23066ac3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:01.368129 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7c5e3-7fe8-4418-af5b-69fa23066ac3 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:01.391859 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 368/732] 10.222.0.32 () {60 vars in 1141 bytes} [Wed Jun 1 04:14:01 2022] POST /identity/v3/services => generated 251 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:14:01.393782 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7c5e3-7fe8-4418-af5b-69fa23066ac3 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:01.559808 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675d5ee-4e36-427c-b672-ae9ec4003207 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:01.564334 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:01.644403 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7c5e3-7fe8-4418-af5b-69fa23066ac3 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:01.645454 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18511f8-7d1d-4316-9026-ef67613d587a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:01.647758 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18511f8-7d1d-4316-9026-ef67613d587a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:01.648653 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18511f8-7d1d-4316-9026-ef67613d587a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:01.649469 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18511f8-7d1d-4316-9026-ef67613d587a None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:01.651305 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18511f8-7d1d-4316-9026-ef67613d587a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:01.652207 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18511f8-7d1d-4316-9026-ef67613d587a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:01.655336 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18511f8-7d1d-4316-9026-ef67613d587a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:01.686446 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 365/733] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:01.688570 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18511f8-7d1d-4316-9026-ef67613d587a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:01.724948 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60defb9-5eb2-43d9-aa1b-b76c61400089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:01.726048 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60defb9-5eb2-43d9-aa1b-b76c61400089 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:01.726523 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60defb9-5eb2-43d9-aa1b-b76c61400089 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:01.726991 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60defb9-5eb2-43d9-aa1b-b76c61400089 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:01.728644 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60defb9-5eb2-43d9-aa1b-b76c61400089 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:01.729148 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60defb9-5eb2-43d9-aa1b-b76c61400089 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:01.732356 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60defb9-5eb2-43d9-aa1b-b76c61400089 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:01.758677 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 369/734] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:01.759822 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60defb9-5eb2-43d9-aa1b-b76c61400089 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:01.815708 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:01.918528 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18511f8-7d1d-4316-9026-ef67613d587a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:01.970357 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60defb9-5eb2-43d9-aa1b-b76c61400089 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:01.992676 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d4ace-ba77-4be3-9ab2-1fc980a983b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:01.994284 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d4ace-ba77-4be3-9ab2-1fc980a983b3 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:01.994922 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d4ace-ba77-4be3-9ab2-1fc980a983b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:01.995544 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d4ace-ba77-4be3-9ab2-1fc980a983b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:02.017170 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d4ace-ba77-4be3-9ab2-1fc980a983b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:02.020931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d4ace-ba77-4be3-9ab2-1fc980a983b3 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:02.036864 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa9e1c-7c75-4380-ad8d-18e2a6ce284f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:02.038261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa9e1c-7c75-4380-ad8d-18e2a6ce284f None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:02.038761 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa9e1c-7c75-4380-ad8d-18e2a6ce284f None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:02.039261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa9e1c-7c75-4380-ad8d-18e2a6ce284f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:02.044501 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:02.053274 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa9e1c-7c75-4380-ad8d-18e2a6ce284f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:02.056426 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa9e1c-7c75-4380-ad8d-18e2a6ce284f None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:02.066081 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-f16d4ace-ba77-4be3-9ab2-1fc980a983b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:02.066081 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:02.066081 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:02.066081 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:02.066081 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:02.066081 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:02.066081 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:02.066081 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:02.066081 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:02.066081 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:02.066081 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:02.066081 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:02.066081 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:14:02.066081 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:14:02.066081 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:14:02.068342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:14:02.068342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:02.068342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:02.068342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:02.068342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:02.068342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:02.068342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:02.068342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:02.068342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:02.068342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:02.068342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:02.068342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:02.068342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:02.068342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:02.068342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:02.068342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:02.068342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:02.070525 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:14:02.070525 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:14:02.070525 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:02.070525 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:02.080724 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 366/735] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:14:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:02.082749 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d4ace-ba77-4be3-9ab2-1fc980a983b3 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:02.088666 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-bafa9e1c-7c75-4380-ad8d-18e2a6ce284f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:14:02.088666 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:02.088666 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:02.088666 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:02.088666 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:02.088666 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:02.088666 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:02.088666 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:02.088666 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:02.088666 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:02.088666 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:02.088666 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:02.088666 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 04:14:02.088666 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 04:14:02.088666 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 04:14:02.090752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 04:14:02.090752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:02.090752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:02.090752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:02.090752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:02.090752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:02.090752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:02.090752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:02.090752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:02.090752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:02.090752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:02.090752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:02.090752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:02.090752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:02.090752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:02.090752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:02.090752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:02.092824 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 04:14:02.092824 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 04:14:02.092824 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 04:14:02.092824 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 04:14:02.092824 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 04:14:02.092824 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 04:14:02.092824 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:14:02.092824 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:02.098563 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 370/736] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:14:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:02.100829 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa9e1c-7c75-4380-ad8d-18e2a6ce284f None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:02.301839 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d4ace-ba77-4be3-9ab2-1fc980a983b3 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:02.305233 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:02.305425 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa9e1c-7c75-4380-ad8d-18e2a6ce284f None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:02.370809 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e8604-c657-4d97-84ee-9e19a031b20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:02.372407 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e8604-c657-4d97-84ee-9e19a031b20c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:02.373093 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e8604-c657-4d97-84ee-9e19a031b20c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:02.373795 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e8604-c657-4d97-84ee-9e19a031b20c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:02.375933 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7c1d9-d28c-4f50-b982-ddf344137515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:02.377064 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7c1d9-d28c-4f50-b982-ddf344137515 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:02.377822 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7c1d9-d28c-4f50-b982-ddf344137515 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:02.378235 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7c1d9-d28c-4f50-b982-ddf344137515 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:02.380539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7c1d9-d28c-4f50-b982-ddf344137515 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:02.381103 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7c1d9-d28c-4f50-b982-ddf344137515 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:02.383843 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7c1d9-d28c-4f50-b982-ddf344137515 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:02.388981 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e8604-c657-4d97-84ee-9e19a031b20c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:02.392120 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e8604-c657-4d97-84ee-9e19a031b20c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:02.413702 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 371/737] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:02.413702 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7c1d9-d28c-4f50-b982-ddf344137515 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:02.427584 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-188e8604-c657-4d97-84ee-9e19a031b20c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:14:02.427584 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:02.427584 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:02.427584 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:02.427584 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:02.427584 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:02.427584 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:02.427584 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:02.427584 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:02.427584 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:02.427584 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:02.427584 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:02.427584 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 04:14:02.427584 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 04:14:02.427584 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 04:14:02.429556 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 04:14:02.429556 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:02.429556 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:02.429556 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:02.429556 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:02.429556 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:02.429556 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:02.429556 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:02.429556 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:02.429556 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:02.429556 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:02.429556 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:02.429556 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:02.429556 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:02.429556 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:02.429556 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:02.429556 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:02.431419 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 04:14:02.431419 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 04:14:02.431419 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 04:14:02.431419 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 04:14:02.431419 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 04:14:02.431419 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 04:14:02.431419 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:14:02.431419 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:02.441938 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 367/738] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:14:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:02.444574 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e8604-c657-4d97-84ee-9e19a031b20c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:02.526419 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:02.622431 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7c1d9-d28c-4f50-b982-ddf344137515 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:02.640871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e8604-c657-4d97-84ee-9e19a031b20c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:02.684967 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de1410-9728-4f6e-9820-d2a658af78b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:02.686304 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de1410-9728-4f6e-9820-d2a658af78b9 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:02.686777 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de1410-9728-4f6e-9820-d2a658af78b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:02.687249 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de1410-9728-4f6e-9820-d2a658af78b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:02.688923 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de1410-9728-4f6e-9820-d2a658af78b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:02.689459 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de1410-9728-4f6e-9820-d2a658af78b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:02.692140 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de1410-9728-4f6e-9820-d2a658af78b9 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:02.701267 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008d6a1-7538-404d-92d2-2a9079e08869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:02.703589 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008d6a1-7538-404d-92d2-2a9079e08869 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:02.704322 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008d6a1-7538-404d-92d2-2a9079e08869 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:02.705022 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008d6a1-7538-404d-92d2-2a9079e08869 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:02.714228 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008d6a1-7538-404d-92d2-2a9079e08869 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:02.716012 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008d6a1-7538-404d-92d2-2a9079e08869 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:02.718208 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 372/739] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Jun 1 04:14:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:02.719846 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de1410-9728-4f6e-9820-d2a658af78b9 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:02.732134 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-b008d6a1-7538-404d-92d2-2a9079e08869 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 01 04:14:02.732134 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:02.732134 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:02.732134 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:02.732134 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:02.732134 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:02.732134 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:02.732134 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:02.732134 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:02.732134 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:02.732134 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:02.732134 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:02.732134 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 04:14:02.732134 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 04:14:02.732134 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 04:14:02.732134 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 04:14:02.733145 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:02.733145 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:02.733145 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 04:14:02.733145 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:14:02.733145 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 04:14:02.733145 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:14:02.733145 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:02.733145 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:02.733145 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:02.733145 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:02.733145 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:02.733145 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:02.733145 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:02.733145 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:02.733145 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:02.733145 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:02.733145 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:02.733145 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:02.734163 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:02.734163 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:02.734163 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 04:14:02.734163 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 04:14:02.734163 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 04:14:02.734163 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 04:14:02.734163 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 04:14:02.734163 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 04:14:02.734163 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 01 04:14:02.734163 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:02.736608 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 368/740] 10.222.0.32 () {56 vars in 1096 bytes} [Wed Jun 1 04:14:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:02.737708 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008d6a1-7538-404d-92d2-2a9079e08869 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:02.765708 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:02.847208 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008d6a1-7538-404d-92d2-2a9079e08869 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:02.887246 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4e34d-0b27-48b6-aced-44f4f13d1618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:02.888261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4e34d-0b27-48b6-aced-44f4f13d1618 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:02.888746 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4e34d-0b27-48b6-aced-44f4f13d1618 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:02.889317 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4e34d-0b27-48b6-aced-44f4f13d1618 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:02.890383 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4e34d-0b27-48b6-aced-44f4f13d1618 None admin] RBAC: Adding query filter params (role.id=5e94b8f2c0b1418e8d2a18e4fe08d4f9, scope.project.id=31d68f64d21647688074554062952074, user.id=3fa2ad34164a4631adf76fbd042679ba) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:02.890703 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4e34d-0b27-48b6-aced-44f4f13d1618 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:02.892152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4e34d-0b27-48b6-aced-44f4f13d1618 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:02.898303 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 369/741] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:14:02 2022] GET /identity/v3/role_assignments?user.id=3fa2ad34164a4631adf76fbd042679ba&scope.project.id=31d68f64d21647688074554062952074&role.id=5e94b8f2c0b1418e8d2a18e4fe08d4f9 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:02.899588 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4e34d-0b27-48b6-aced-44f4f13d1618 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:02.919684 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de1410-9728-4f6e-9820-d2a658af78b9 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:02.938583 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:02.969913 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887097d-ffbd-47b2-89ce-e0cf3e747d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:02.970619 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887097d-ffbd-47b2-89ce-e0cf3e747d94 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:02.970893 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887097d-ffbd-47b2-89ce-e0cf3e747d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:02.971165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887097d-ffbd-47b2-89ce-e0cf3e747d94 None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:02.972655 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e887097d-ffbd-47b2-89ce-e0cf3e747d94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:02.972968 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e887097d-ffbd-47b2-89ce-e0cf3e747d94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:02.975185 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e887097d-ffbd-47b2-89ce-e0cf3e747d94 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:02.994204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 373/742] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Jun 1 04:14:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:02.995939 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda4971-2aed-437d-8161-b8b4325febff None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:02.996226 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda4971-2aed-437d-8161-b8b4325febff None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:02.996772 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda4971-2aed-437d-8161-b8b4325febff None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:02.999226 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 374/743] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:14:03.003972 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda4971-2aed-437d-8161-b8b4325febff None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:03.034342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:03.054248 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4e34d-0b27-48b6-aced-44f4f13d1618 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:03.094895 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47912b-67c7-43ec-92c9-56f0121bdc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:03.095860 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47912b-67c7-43ec-92c9-56f0121bdc1b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:03.096326 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47912b-67c7-43ec-92c9-56f0121bdc1b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:03.096771 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47912b-67c7-43ec-92c9-56f0121bdc1b None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:03.097918 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47912b-67c7-43ec-92c9-56f0121bdc1b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:03.099000 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47912b-67c7-43ec-92c9-56f0121bdc1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:03.100756 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47912b-67c7-43ec-92c9-56f0121bdc1b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:03.122622 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 370/744] 10.222.0.32 () {56 vars in 1135 bytes} [Wed Jun 1 04:14:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:03.124412 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76112647-d60d-4e7b-bf34-179859056a76 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:03.124891 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76112647-d60d-4e7b-bf34-179859056a76 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:03.125321 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76112647-d60d-4e7b-bf34-179859056a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:03.127636 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda4971-2aed-437d-8161-b8b4325febff None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:03.145030 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-76112647-d60d-4e7b-bf34-179859056a76 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:03.147348 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-76112647-d60d-4e7b-bf34-179859056a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:03.180422 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c876d-c064-49a6-8837-1fd977c3f957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:03.181782 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c876d-c064-49a6-8837-1fd977c3f957 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:03.182793 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c876d-c064-49a6-8837-1fd977c3f957 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:03.183575 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c876d-c064-49a6-8837-1fd977c3f957 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:03.184809 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c876d-c064-49a6-8837-1fd977c3f957 None admin] RBAC: Adding query filter params (role.id=76fc054ad9544460a7be1e2010c23642, scope.project.id=31d68f64d21647688074554062952074, user.id=79d614f85f5541d3babbb41468cbf55c) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:03.185383 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c876d-c064-49a6-8837-1fd977c3f957 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:03.187250 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c876d-c064-49a6-8837-1fd977c3f957 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:03.197628 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 375/745] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:14:03 2022] GET /identity/v3/role_assignments?user.id=79d614f85f5541d3babbb41468cbf55c&scope.project.id=31d68f64d21647688074554062952074&role.id=76fc054ad9544460a7be1e2010c23642 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:03.199030 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c876d-c064-49a6-8837-1fd977c3f957 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:03.254043 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 371/746] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:03 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 04:14:03.265030 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:03.340860 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76112647-d60d-4e7b-bf34-179859056a76 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:03.354917 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c876d-c064-49a6-8837-1fd977c3f957 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:03.398336 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73543a78-cf50-4e37-a955-e09cc7116afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:03.399119 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73543a78-cf50-4e37-a955-e09cc7116afe None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:03.399415 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73543a78-cf50-4e37-a955-e09cc7116afe None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:03.399698 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73543a78-cf50-4e37-a955-e09cc7116afe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:03.502726 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73543a78-cf50-4e37-a955-e09cc7116afe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:03.506244 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73543a78-cf50-4e37-a955-e09cc7116afe None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:03.543221 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:03.595642 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76112647-d60d-4e7b-bf34-179859056a76 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:03.606518 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:03.638096 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa7b0a-6ae4-4979-a545-f0e9a7333e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:03.639474 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa7b0a-6ae4-4979-a545-f0e9a7333e50 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:03.639782 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa7b0a-6ae4-4979-a545-f0e9a7333e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:03.640041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa7b0a-6ae4-4979-a545-f0e9a7333e50 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:03.640892 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa7b0a-6ae4-4979-a545-f0e9a7333e50 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:03.642378 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa7b0a-6ae4-4979-a545-f0e9a7333e50 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:03.670453 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 372/747] 10.222.0.32 () {60 vars in 1141 bytes} [Wed Jun 1 04:14:03 2022] POST /identity/v3/services => generated 240 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:14:03.716349 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 376/748] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:14:03 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 04:14:03.722081 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa7b0a-6ae4-4979-a545-f0e9a7333e50 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:03.896845 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa7b0a-6ae4-4979-a545-f0e9a7333e50 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:03.948012 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:03.957156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc630f5-6ede-45c2-97ff-4ad06d349530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:03.959154 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc630f5-6ede-45c2-97ff-4ad06d349530 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:03.959665 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc630f5-6ede-45c2-97ff-4ad06d349530 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:03.960146 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc630f5-6ede-45c2-97ff-4ad06d349530 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:03.978980 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc630f5-6ede-45c2-97ff-4ad06d349530 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:03.980539 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc630f5-6ede-45c2-97ff-4ad06d349530 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:03.999886 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-2dc630f5-6ede-45c2-97ff-4ad06d349530 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:03.999886 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:03.999886 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:03.999886 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:03.999886 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:03.999886 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:03.999886 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:03.999886 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:03.999886 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:03.999886 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:03.999886 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:03.999886 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:03.999886 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:14:03.999886 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:14:03.999886 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:14:04.002057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:14:04.002057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:04.002057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:04.002057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:04.002057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:04.002057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:04.002057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:04.002057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:04.002057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:04.002057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:04.002057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:04.002057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:04.002057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:04.002057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:04.002057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:04.002057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:04.002057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:04.003811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:14:04.003811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:14:04.003811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:04.003811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:04.003811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 373/749] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:14:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:04.012107 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73543a78-cf50-4e37-a955-e09cc7116afe None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:04.132431 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73543a78-cf50-4e37-a955-e09cc7116afe None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:04.173072 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e77c70-2f98-4938-ac3b-54d3bc2469b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:04.174155 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e77c70-2f98-4938-ac3b-54d3bc2469b8 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:04.174592 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e77c70-2f98-4938-ac3b-54d3bc2469b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:04.175040 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e77c70-2f98-4938-ac3b-54d3bc2469b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:04.175968 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e77c70-2f98-4938-ac3b-54d3bc2469b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:04.176944 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e77c70-2f98-4938-ac3b-54d3bc2469b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:04.178511 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e77c70-2f98-4938-ac3b-54d3bc2469b8 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:04.187137 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:04.195539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 377/750] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:04.200889 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc630f5-6ede-45c2-97ff-4ad06d349530 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:04.337849 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc630f5-6ede-45c2-97ff-4ad06d349530 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:04.406600 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89966b-e1bc-43c6-b560-238fcc4d18c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:04.408308 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89966b-e1bc-43c6-b560-238fcc4d18c5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:04.409014 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89966b-e1bc-43c6-b560-238fcc4d18c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:04.409742 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89966b-e1bc-43c6-b560-238fcc4d18c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:04.423571 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b89966b-e1bc-43c6-b560-238fcc4d18c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:04.427230 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b89966b-e1bc-43c6-b560-238fcc4d18c5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:04.457108 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-3b89966b-e1bc-43c6-b560-238fcc4d18c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:14:04.457108 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:04.457108 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:04.457108 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:04.457108 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:04.457108 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:04.457108 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:04.457108 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:04.457108 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:04.457108 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:04.457108 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:04.457108 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:04.457108 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 04:14:04.457108 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 04:14:04.457108 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 04:14:04.459158 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 04:14:04.459158 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:04.459158 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:04.459158 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:04.459158 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:04.459158 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:04.459158 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:04.459158 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:04.459158 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:04.459158 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:04.459158 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:04.459158 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:04.459158 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:04.459158 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:04.459158 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:04.459158 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:04.459158 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:04.461206 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 04:14:04.461206 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 04:14:04.461206 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 04:14:04.461206 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 04:14:04.461206 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 04:14:04.461206 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 04:14:04.461206 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:14:04.461206 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:04.465306 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 374/751] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:14:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:14:04.471582 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e77c70-2f98-4938-ac3b-54d3bc2469b8 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:04.636550 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e77c70-2f98-4938-ac3b-54d3bc2469b8 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:04.688080 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398c924-6dae-4ffe-84fc-eda804b107c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:04.688750 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398c924-6dae-4ffe-84fc-eda804b107c8 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:04.689030 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398c924-6dae-4ffe-84fc-eda804b107c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:04.689307 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398c924-6dae-4ffe-84fc-eda804b107c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:04.690123 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398c924-6dae-4ffe-84fc-eda804b107c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:04.690429 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398c924-6dae-4ffe-84fc-eda804b107c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:04.691858 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398c924-6dae-4ffe-84fc-eda804b107c8 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:04.709564 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 378/752] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Jun 1 04:14:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:04.715934 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89966b-e1bc-43c6-b560-238fcc4d18c5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:04.794621 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:04.855981 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89966b-e1bc-43c6-b560-238fcc4d18c5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:04.898717 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3601100-8bfc-40c7-b9f5-e7cfa5c71002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:04.899400 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3601100-8bfc-40c7-b9f5-e7cfa5c71002 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:04.899675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3601100-8bfc-40c7-b9f5-e7cfa5c71002 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:04.899959 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3601100-8bfc-40c7-b9f5-e7cfa5c71002 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:04.900793 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3601100-8bfc-40c7-b9f5-e7cfa5c71002 None admin] RBAC: Adding query filter params (role.id=76fc054ad9544460a7be1e2010c23642, scope.project.id=31d68f64d21647688074554062952074, user.id=413c6613b4ec4e53aeeaf6828c807273) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:04.901106 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3601100-8bfc-40c7-b9f5-e7cfa5c71002 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:04.902580 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3601100-8bfc-40c7-b9f5-e7cfa5c71002 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:04.908775 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 375/753] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:14:04 2022] GET /identity/v3/role_assignments?user.id=413c6613b4ec4e53aeeaf6828c807273&scope.project.id=31d68f64d21647688074554062952074&role.id=76fc054ad9544460a7be1e2010c23642 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:05.254418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6262e-df99-424e-8704-88dd1b465e8e None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:05.254958 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6262e-df99-424e-8704-88dd1b465e8e None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:05.255177 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6262e-df99-424e-8704-88dd1b465e8e None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:05.256693 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 379/754] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:14:05.262712 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded37a3-e1f4-4add-a83e-548cc29759cc None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:05.263000 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded37a3-e1f4-4add-a83e-548cc29759cc None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:05.263280 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded37a3-e1f4-4add-a83e-548cc29759cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:05.291021 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-5ded37a3-e1f4-4add-a83e-548cc29759cc None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:05.292240 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5ded37a3-e1f4-4add-a83e-548cc29759cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:05.399705 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 376/755] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 04:14:05.432376 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6262e-df99-424e-8704-88dd1b465e8e None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:05.533610 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:05.596323 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6262e-df99-424e-8704-88dd1b465e8e None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:05.647588 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd0464-62d4-4faa-bf99-6cadd4e76821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:05.648414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd0464-62d4-4faa-bf99-6cadd4e76821 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:05.648694 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd0464-62d4-4faa-bf99-6cadd4e76821 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:05.648968 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd0464-62d4-4faa-bf99-6cadd4e76821 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:05.649625 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd0464-62d4-4faa-bf99-6cadd4e76821 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:05.651026 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd0464-62d4-4faa-bf99-6cadd4e76821 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:05.664931 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-6fbd0464-62d4-4faa-bf99-6cadd4e76821 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 01 04:14:05.664931 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:05.664931 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 04:14:05.664931 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 04:14:05.664931 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 04:14:05.664931 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 04:14:05.664931 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 04:14:05.664931 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:05.664931 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 01 04:14:05.664931 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:05.664931 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 04:14:05.664931 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:05.664931 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:05.664931 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:05.664931 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:05.664931 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:05.665927 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:05.665927 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:05.665927 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:05.665927 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:05.665927 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:05.665927 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:05.665927 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:05.665927 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 04:14:05.665927 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 04:14:05.665927 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 04:14:05.665927 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 04:14:05.665927 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:05.665927 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:05.665927 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:05.665927 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:05.665927 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:05.666804 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:05.666804 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:05.666804 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:05.666804 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:05.666804 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:05.666804 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:05.666804 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:05.666804 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:05.666804 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:05.666804 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:05.666804 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:05.666804 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 04:14:05.666804 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:05.666804 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 01 04:14:05.666804 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:05.669734 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 380/756] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Jun 1 04:14:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:05.675303 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded37a3-e1f4-4add-a83e-548cc29759cc None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:05.739895 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:05.823532 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded37a3-e1f4-4add-a83e-548cc29759cc None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:05.863356 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe94562-f4bf-4641-9b00-c8c46d8486c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:05.864546 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe94562-f4bf-4641-9b00-c8c46d8486c4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:05.864831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe94562-f4bf-4641-9b00-c8c46d8486c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:05.865102 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe94562-f4bf-4641-9b00-c8c46d8486c4 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:05.865815 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe94562-f4bf-4641-9b00-c8c46d8486c4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:05.866151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe94562-f4bf-4641-9b00-c8c46d8486c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:05.867609 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe94562-f4bf-4641-9b00-c8c46d8486c4 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:05.877060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 377/757] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Jun 1 04:14:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:05.883196 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd0464-62d4-4faa-bf99-6cadd4e76821 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:06.142664 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd0464-62d4-4faa-bf99-6cadd4e76821 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:06.205518 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:06.228910 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823d52c-c8f6-48a2-bee2-e71d0f04efa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:06.230596 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823d52c-c8f6-48a2-bee2-e71d0f04efa3 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:06.231379 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823d52c-c8f6-48a2-bee2-e71d0f04efa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:06.232208 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823d52c-c8f6-48a2-bee2-e71d0f04efa3 None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:06.233883 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823d52c-c8f6-48a2-bee2-e71d0f04efa3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:06.234748 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823d52c-c8f6-48a2-bee2-e71d0f04efa3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:06.237758 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823d52c-c8f6-48a2-bee2-e71d0f04efa3 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:06.248777 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 381/758] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Jun 1 04:14:05 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:06.254401 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe94562-f4bf-4641-9b00-c8c46d8486c4 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:06.398920 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:06.405544 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe94562-f4bf-4641-9b00-c8c46d8486c4 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:06.434715 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5978d6-31ac-4641-886d-6a910c283179 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:06.436296 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5978d6-31ac-4641-886d-6a910c283179 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:06.437029 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5978d6-31ac-4641-886d-6a910c283179 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:06.440532 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 382/759] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:14:06.450629 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bec43-1879-4b8b-b522-d2d36ba144a6 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:06.451585 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bec43-1879-4b8b-b522-d2d36ba144a6 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:06.452374 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bec43-1879-4b8b-b522-d2d36ba144a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:06.466228 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200bd09-1ee5-402a-a7b7-9c5db90f109d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:06.466959 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200bd09-1ee5-402a-a7b7-9c5db90f109d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:06.467241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200bd09-1ee5-402a-a7b7-9c5db90f109d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:06.467555 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200bd09-1ee5-402a-a7b7-9c5db90f109d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:06.468380 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200bd09-1ee5-402a-a7b7-9c5db90f109d None admin] RBAC: Adding query filter params (interface=public, service_id=f987ad953d5143598097403f7c8989c7, region_id=RegionOne) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:06.468688 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200bd09-1ee5-402a-a7b7-9c5db90f109d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:06.470092 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200bd09-1ee5-402a-a7b7-9c5db90f109d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:06.484994 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 378/760] 10.222.0.32 () {56 vars in 1251 bytes} [Wed Jun 1 04:14:06 2022] GET /identity/v3/endpoints?service_id=f987ad953d5143598097403f7c8989c7&interface=public®ion_id=RegionOne => generated 194 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:06.486485 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a609e0-54fd-4471-9779-9e804d730e67 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:06.486781 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a609e0-54fd-4471-9779-9e804d730e67 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:06.487061 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a609e0-54fd-4471-9779-9e804d730e67 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:06.487701 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-9c7bec43-1879-4b8b-b522-d2d36ba144a6 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:06.490482 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-9c7bec43-1879-4b8b-b522-d2d36ba144a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:06.492655 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 379/761] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:14:06.493596 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a609e0-54fd-4471-9779-9e804d730e67 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:06.617752 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a609e0-54fd-4471-9779-9e804d730e67 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:06.646540 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 383/762] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:14:06.650130 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce24cc3-f224-4924-9b98-50e1dc7783c0 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:06.650986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce24cc3-f224-4924-9b98-50e1dc7783c0 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:06.651930 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce24cc3-f224-4924-9b98-50e1dc7783c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:06.659822 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d17fd-b689-45b6-811f-3c9d302388f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:06.659822 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d17fd-b689-45b6-811f-3c9d302388f1 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:06.659822 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d17fd-b689-45b6-811f-3c9d302388f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:06.659822 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d17fd-b689-45b6-811f-3c9d302388f1 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:06.660510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d17fd-b689-45b6-811f-3c9d302388f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:06.660510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d17fd-b689-45b6-811f-3c9d302388f1 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:06.666564 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 380/763] 10.222.0.32 () {56 vars in 1087 bytes} [Wed Jun 1 04:14:06 2022] GET /identity/v3/services => generated 772 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:06.699242 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-6ce24cc3-f224-4924-9b98-50e1dc7783c0 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:06.700654 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6ce24cc3-f224-4924-9b98-50e1dc7783c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:06.708173 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d17fd-b689-45b6-811f-3c9d302388f1 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:06.765918 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:06.883147 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 384/764] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:14:06.918918 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce24cc3-f224-4924-9b98-50e1dc7783c0 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:06.951349 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d17fd-b689-45b6-811f-3c9d302388f1 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:07.003861 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:07.024439 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565fe407-5016-4058-8165-0ff48303fcfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:07.025250 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fe407-5016-4058-8165-0ff48303fcfe None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:07.025540 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fe407-5016-4058-8165-0ff48303fcfe None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:07.025806 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fe407-5016-4058-8165-0ff48303fcfe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:07.047374 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565fe407-5016-4058-8165-0ff48303fcfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:14:07.055650 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-565fe407-5016-4058-8165-0ff48303fcfe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:14:07.055650 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:07.055650 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:07.055650 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:07.055650 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:07.055650 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:07.055650 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:07.055650 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:07.055650 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:07.055650 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:07.055650 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:07.055650 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:07.055650 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:14:07.055650 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:14:07.055650 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:14:07.055650 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:14:07.057510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:14:07.057510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:14:07.057510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:14:07.057510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:14:07.057510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:07.057510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:07.057510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:07.057510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:07.057510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:07.057510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:07.057510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:07.057510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:07.057510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:07.057510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:07.057510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:07.057510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:07.059271 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:07.059271 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:07.059271 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:07.059271 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:07.059271 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:14:07.059271 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:14:07.059271 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:14:07.059271 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:14:07.059271 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:14:07.059271 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:14:07.059271 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:14:07.059271 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:07.059271 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 381/765] 10.222.0.32 () {56 vars in 1096 bytes} [Wed Jun 1 04:14:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:07.073600 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565fe407-5016-4058-8165-0ff48303fcfe None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:07.112800 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce24cc3-f224-4924-9b98-50e1dc7783c0 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:07.203068 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673141db-97ab-4718-82ae-bf17eee26faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:07.204552 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673141db-97ab-4718-82ae-bf17eee26faf None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:07.205401 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673141db-97ab-4718-82ae-bf17eee26faf None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:07.206027 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673141db-97ab-4718-82ae-bf17eee26faf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:07.230167 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673141db-97ab-4718-82ae-bf17eee26faf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:14:07.248323 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-673141db-97ab-4718-82ae-bf17eee26faf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:14:07.248323 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:07.248323 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:07.248323 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:07.248323 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:07.248323 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:07.248323 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:07.248323 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:07.248323 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:07.248323 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:07.248323 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:07.248323 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:07.248323 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:14:07.248323 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:14:07.248323 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:14:07.248323 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:14:07.250663 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:14:07.250663 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:14:07.250663 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:14:07.250663 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:14:07.250663 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:07.250663 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:07.250663 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:07.250663 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:07.250663 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:07.250663 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:07.250663 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:07.250663 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:07.250663 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:07.250663 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:07.250663 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:07.250663 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:07.252487 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:07.252487 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:07.252487 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:07.252487 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:07.252487 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:14:07.252487 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:14:07.252487 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:14:07.252487 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:14:07.252487 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:14:07.252487 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:14:07.252487 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:14:07.252487 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:07.252487 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 385/766] 10.222.0.32 () {56 vars in 1102 bytes} [Wed Jun 1 04:14:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:14:07.253814 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28e5fa-1951-488a-bbfe-370972d10e3d None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:07.253814 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28e5fa-1951-488a-bbfe-370972d10e3d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:07.254086 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28e5fa-1951-488a-bbfe-370972d10e3d None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:07.258056 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 386/767] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:14:07.259409 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28e5fa-1951-488a-bbfe-370972d10e3d None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:07.271763 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:07.288275 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565fe407-5016-4058-8165-0ff48303fcfe None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:07.335071 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e131d-16b6-447a-adfe-29e2930d9acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:07.336220 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e131d-16b6-447a-adfe-29e2930d9acc None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:07.336511 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e131d-16b6-447a-adfe-29e2930d9acc None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:07.336783 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e131d-16b6-447a-adfe-29e2930d9acc None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:07.337542 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e131d-16b6-447a-adfe-29e2930d9acc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:07.337845 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e131d-16b6-447a-adfe-29e2930d9acc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:07.339811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e131d-16b6-447a-adfe-29e2930d9acc None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:07.354094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 382/768] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:14:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:07.357355 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577d520-ec2b-46a6-b861-f45949454fe6 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:07.357814 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577d520-ec2b-46a6-b861-f45949454fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:07.358279 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577d520-ec2b-46a6-b861-f45949454fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:07.383581 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-5577d520-ec2b-46a6-b861-f45949454fe6 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:07.385205 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5577d520-ec2b-46a6-b861-f45949454fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:07.487156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 383/769] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:14:07.488488 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577d520-ec2b-46a6-b861-f45949454fe6 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:07.502699 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28e5fa-1951-488a-bbfe-370972d10e3d None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:07.519276 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:07.586784 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf34451-00a8-4c5c-b0d4-062076bccaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:07.588329 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf34451-00a8-4c5c-b0d4-062076bccaff None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:07.589095 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf34451-00a8-4c5c-b0d4-062076bccaff None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:07.590447 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf34451-00a8-4c5c-b0d4-062076bccaff None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:07.592540 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf34451-00a8-4c5c-b0d4-062076bccaff None admin] RBAC: Adding query filter params (name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:07.593341 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf34451-00a8-4c5c-b0d4-062076bccaff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:07.596016 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf34451-00a8-4c5c-b0d4-062076bccaff None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:07.596273 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:07.611427 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 387/770] 10.222.0.32 () {56 vars in 1103 bytes} [Wed Jun 1 04:14:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:07.612904 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf34451-00a8-4c5c-b0d4-062076bccaff None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:07.625606 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577d520-ec2b-46a6-b861-f45949454fe6 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:07.674113 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489c0dc-d95e-4582-b4bd-78fa5e98807c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:07.675782 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489c0dc-d95e-4582-b4bd-78fa5e98807c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:07.676222 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489c0dc-d95e-4582-b4bd-78fa5e98807c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:07.677538 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489c0dc-d95e-4582-b4bd-78fa5e98807c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:07.695169 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1489c0dc-d95e-4582-b4bd-78fa5e98807c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:07.697719 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1489c0dc-d95e-4582-b4bd-78fa5e98807c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:07.729036 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-1489c0dc-d95e-4582-b4bd-78fa5e98807c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:07.729036 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:07.729036 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:07.729036 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:07.729036 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:07.729036 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:07.729036 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:07.729036 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:07.729036 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:07.729036 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:07.729036 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:07.729036 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:07.729036 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:14:07.729036 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:14:07.729036 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:14:07.730110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:14:07.730110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:07.730110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:07.730110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:07.730110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:07.730110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:07.730110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:07.730110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:07.730110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:07.730110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:07.730110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:07.730110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:07.730110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:07.730110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:07.730110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:07.730110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:07.730110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:07.731176 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:14:07.731176 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:14:07.731176 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:07.731176 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:07.731579 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 384/771] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:14:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:07.732585 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf34451-00a8-4c5c-b0d4-062076bccaff None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:07.733834 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d0538-26cc-44d4-bd1d-0c8fb8df9c74 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:07.734334 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d0538-26cc-44d4-bd1d-0c8fb8df9c74 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:07.734797 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d0538-26cc-44d4-bd1d-0c8fb8df9c74 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:07.738086 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 385/772] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:14:07.738868 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d0538-26cc-44d4-bd1d-0c8fb8df9c74 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:07.780435 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad66d9d-64e7-4cfd-88d0-2b31fff737e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:07.781232 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad66d9d-64e7-4cfd-88d0-2b31fff737e3 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:07.781513 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad66d9d-64e7-4cfd-88d0-2b31fff737e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:07.781786 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad66d9d-64e7-4cfd-88d0-2b31fff737e3 None admin] PATH_INFO: `/v3/services/network` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:07.782478 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad66d9d-64e7-4cfd-88d0-2b31fff737e3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:07.783912 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad66d9d-64e7-4cfd-88d0-2b31fff737e3 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:07.797173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-dad66d9d-64e7-4cfd-88d0-2b31fff737e3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 01 04:14:07.797173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:07.797173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 04:14:07.797173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 04:14:07.797173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 04:14:07.797173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 04:14:07.797173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 04:14:07.797173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:07.797173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 01 04:14:07.797173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:07.797173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 04:14:07.797173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:07.797173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:07.797173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:07.797173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:07.797173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:07.797173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:07.799147 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:07.799147 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:07.799147 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:07.799147 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:07.799147 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:07.799147 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:07.799147 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 04:14:07.799147 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 04:14:07.799147 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 04:14:07.799147 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 04:14:07.799147 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:07.799147 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:07.799147 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:07.799147 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:07.799147 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:07.799147 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:07.800725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:07.800725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:07.800725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:07.800725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:07.800725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:07.800725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:07.800725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:07.800725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:07.800725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:07.800725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:07.800725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 04:14:07.800725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:07.800725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 01 04:14:07.800725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:07.800725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 388/773] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:14:07 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:07.803499 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad66d9d-64e7-4cfd-88d0-2b31fff737e3 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:07.844260 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:07.877515 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d0538-26cc-44d4-bd1d-0c8fb8df9c74 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:07.913112 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:07.920316 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b3089-13b9-4e0d-8b3c-126206d91a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:07.921234 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b3089-13b9-4e0d-8b3c-126206d91a2b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:07.921571 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b3089-13b9-4e0d-8b3c-126206d91a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:07.921955 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b3089-13b9-4e0d-8b3c-126206d91a2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:07.935266 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b3089-13b9-4e0d-8b3c-126206d91a2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:07.936014 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad66d9d-64e7-4cfd-88d0-2b31fff737e3 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:07.936858 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b3089-13b9-4e0d-8b3c-126206d91a2b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:07.959954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-167b3089-13b9-4e0d-8b3c-126206d91a2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:07.959954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:07.959954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:07.959954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:07.959954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:07.959954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:07.959954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:07.959954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:07.959954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:07.959954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:07.959954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:07.959954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:07.959954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:14:07.959954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:14:07.959954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:14:07.961443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:14:07.961443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:07.961443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:07.961443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:07.961443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:07.961443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:07.961443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:07.961443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:07.961443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:07.961443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:07.961443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:07.961443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:07.961443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:07.961443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:07.961443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:07.961443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:07.961443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:07.962683 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:14:07.962683 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:14:07.962683 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:07.962683 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:07.966857 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 386/774] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:14:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:07.968386 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172333b0-2a8e-4044-bfd6-50e82d8b56e6 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:07.968673 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172333b0-2a8e-4044-bfd6-50e82d8b56e6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:07.968951 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172333b0-2a8e-4044-bfd6-50e82d8b56e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:07.983045 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50cfbd-60a2-43bd-a1c0-67f8c4dcc2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:07.983706 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50cfbd-60a2-43bd-a1c0-67f8c4dcc2da None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:07.984018 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50cfbd-60a2-43bd-a1c0-67f8c4dcc2da None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:07.984293 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50cfbd-60a2-43bd-a1c0-67f8c4dcc2da None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:07.985015 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac50cfbd-60a2-43bd-a1c0-67f8c4dcc2da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:07.985317 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac50cfbd-60a2-43bd-a1c0-67f8c4dcc2da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:07.986705 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac50cfbd-60a2-43bd-a1c0-67f8c4dcc2da None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:07.993877 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-172333b0-2a8e-4044-bfd6-50e82d8b56e6 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:07.995936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-172333b0-2a8e-4044-bfd6-50e82d8b56e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:07.999608 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 389/775] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:08.000442 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50cfbd-60a2-43bd-a1c0-67f8c4dcc2da None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:08.102206 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 387/776] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:14:08.103513 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172333b0-2a8e-4044-bfd6-50e82d8b56e6 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:08.138716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:08.159682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50cfbd-60a2-43bd-a1c0-67f8c4dcc2da None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:08.200507 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfb755-839b-4322-bb51-03a28e9aff26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:08.201237 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfb755-839b-4322-bb51-03a28e9aff26 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:08.201778 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfb755-839b-4322-bb51-03a28e9aff26 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:08.201778 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfb755-839b-4322-bb51-03a28e9aff26 None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:08.202540 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bfb755-839b-4322-bb51-03a28e9aff26 None admin] RBAC: Adding query filter params (name=network) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:08.202890 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bfb755-839b-4322-bb51-03a28e9aff26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:08.204256 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bfb755-839b-4322-bb51-03a28e9aff26 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:08.211078 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 390/777] 10.222.0.32 () {56 vars in 1112 bytes} [Wed Jun 1 04:14:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:08.212001 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfb755-839b-4322-bb51-03a28e9aff26 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:08.258293 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172333b0-2a8e-4044-bfd6-50e82d8b56e6 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:08.277363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:08.304922 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c2b62-6b17-4b15-b334-b7fcabdab3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:08.306244 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c2b62-6b17-4b15-b334-b7fcabdab3e5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:08.306723 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c2b62-6b17-4b15-b334-b7fcabdab3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:08.307135 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c2b62-6b17-4b15-b334-b7fcabdab3e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:08.308144 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c2b62-6b17-4b15-b334-b7fcabdab3e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:08.308592 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c2b62-6b17-4b15-b334-b7fcabdab3e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:08.310675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c2b62-6b17-4b15-b334-b7fcabdab3e5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:08.333710 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 388/778] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:08.333916 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfb755-839b-4322-bb51-03a28e9aff26 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:08.334053 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c2b62-6b17-4b15-b334-b7fcabdab3e5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:08.389666 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9444d-2603-4140-8776-b28d3311cb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:08.391070 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9444d-2603-4140-8776-b28d3311cb01 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:08.391534 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9444d-2603-4140-8776-b28d3311cb01 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:08.391928 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9444d-2603-4140-8776-b28d3311cb01 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:08.407748 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9444d-2603-4140-8776-b28d3311cb01 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:08.407748 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9444d-2603-4140-8776-b28d3311cb01 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:08.432473 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-eac9444d-2603-4140-8776-b28d3311cb01 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 01 04:14:08.432473 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:08.432473 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:08.432473 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:08.432473 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:08.432473 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:08.432473 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:08.432473 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:08.432473 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:08.432473 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:08.432473 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:08.432473 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:08.432473 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 04:14:08.432473 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 04:14:08.432473 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 04:14:08.432473 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 04:14:08.435146 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:08.435146 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:08.435146 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 04:14:08.435146 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:14:08.435146 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 04:14:08.435146 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:14:08.435146 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:08.435146 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:08.435146 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:08.435146 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:08.435146 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:08.435146 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:08.435146 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:08.435146 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:08.435146 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:08.435146 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:08.435146 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:08.435146 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:08.437034 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:08.437034 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:08.437034 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 04:14:08.437034 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 04:14:08.437034 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 04:14:08.437034 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 04:14:08.437034 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 04:14:08.437034 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 04:14:08.437034 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 01 04:14:08.437034 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:08.437034 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 391/779] 10.222.0.32 () {56 vars in 1093 bytes} [Wed Jun 1 04:14:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:08.437034 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9444d-2603-4140-8776-b28d3311cb01 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:08.467262 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:08.493758 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c2b62-6b17-4b15-b334-b7fcabdab3e5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:08.532722 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea31358-dba8-498f-910a-7164423d1fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:08.533452 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea31358-dba8-498f-910a-7164423d1fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:08.533733 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea31358-dba8-498f-910a-7164423d1fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:08.534189 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea31358-dba8-498f-910a-7164423d1fe0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:08.549376 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea31358-dba8-498f-910a-7164423d1fe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:14:08.557778 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-7ea31358-dba8-498f-910a-7164423d1fe0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:14:08.557778 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:08.557778 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:08.557778 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:08.557778 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:08.557778 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:08.557778 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:08.557778 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:08.557778 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:08.557778 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:08.557778 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:08.557778 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:08.557778 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:14:08.557778 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:14:08.557778 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:14:08.557778 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:14:08.559765 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:14:08.559765 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:14:08.559765 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:14:08.559765 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:14:08.559765 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:08.559765 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:08.559765 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:08.559765 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:08.559765 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:08.559765 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:08.559765 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:08.559765 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:08.559765 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:08.559765 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:08.559765 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:08.559765 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:08.561363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:08.561363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:08.561363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:08.561363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:08.561363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:14:08.561363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:14:08.561363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:14:08.561363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:14:08.561363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:14:08.561363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:14:08.561363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:14:08.561363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:08.561363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 389/780] 10.222.0.32 () {56 vars in 1096 bytes} [Wed Jun 1 04:14:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:08.561363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea31358-dba8-498f-910a-7164423d1fe0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:08.577427 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9444d-2603-4140-8776-b28d3311cb01 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:08.604805 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:08.620117 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b342f-63f9-4128-8dce-b51422c92d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:08.620809 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b342f-63f9-4128-8dce-b51422c92d5f None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:08.621096 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b342f-63f9-4128-8dce-b51422c92d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:08.621376 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b342f-63f9-4128-8dce-b51422c92d5f None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:08.622152 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b342f-63f9-4128-8dce-b51422c92d5f None admin] RBAC: Adding query filter params (type=network) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:08.622601 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b342f-63f9-4128-8dce-b51422c92d5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:08.624012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b342f-63f9-4128-8dce-b51422c92d5f None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:08.635420 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 392/781] 10.222.0.32 () {56 vars in 1112 bytes} [Wed Jun 1 04:14:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:08.635420 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b342f-63f9-4128-8dce-b51422c92d5f None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:08.714192 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea31358-dba8-498f-910a-7164423d1fe0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:08.737026 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:08.761499 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af6482-dff4-4bf8-b523-497fe0482f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:08.762785 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af6482-dff4-4bf8-b523-497fe0482f50 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:08.763278 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af6482-dff4-4bf8-b523-497fe0482f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:08.763730 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af6482-dff4-4bf8-b523-497fe0482f50 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:08.769883 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b342f-63f9-4128-8dce-b51422c92d5f None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:08.777029 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af6482-dff4-4bf8-b523-497fe0482f50 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:08.778710 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af6482-dff4-4bf8-b523-497fe0482f50 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:08.797917 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-35af6482-dff4-4bf8-b523-497fe0482f50 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 01 04:14:08.797917 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:08.797917 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:08.797917 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:08.797917 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:08.797917 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:08.797917 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:08.797917 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:08.797917 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:08.797917 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:08.797917 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:08.797917 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:08.797917 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 04:14:08.797917 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 04:14:08.797917 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 04:14:08.797917 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 04:14:08.799632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:08.799632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:08.799632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 04:14:08.799632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:14:08.799632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 04:14:08.799632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:14:08.799632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:08.799632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:08.799632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:08.799632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:08.799632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:08.799632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:08.799632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:08.799632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:08.799632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:08.799632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:08.799632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:08.799632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:08.801449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:08.801449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:08.801449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 04:14:08.801449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 04:14:08.801449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 04:14:08.801449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 04:14:08.801449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 04:14:08.801449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 04:14:08.801449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 01 04:14:08.801449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:08.801449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 390/782] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Jun 1 04:14:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:08.801449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af6482-dff4-4bf8-b523-497fe0482f50 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:08.824546 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d71e4-3276-4ced-ac60-7c61e71d1bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:08.825710 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d71e4-3276-4ced-ac60-7c61e71d1bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:08.826225 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d71e4-3276-4ced-ac60-7c61e71d1bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:08.826732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d71e4-3276-4ced-ac60-7c61e71d1bc0 None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:08.827770 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d71e4-3276-4ced-ac60-7c61e71d1bc0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:08.828196 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d71e4-3276-4ced-ac60-7c61e71d1bc0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:08.830246 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d71e4-3276-4ced-ac60-7c61e71d1bc0 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:08.862178 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 393/783] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Jun 1 04:14:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:08.862178 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d71e4-3276-4ced-ac60-7c61e71d1bc0 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:08.917180 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:08.928316 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af6482-dff4-4bf8-b523-497fe0482f50 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:08.973997 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bec193-bb1f-45f2-ad8b-64c34270636e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:08.975183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bec193-bb1f-45f2-ad8b-64c34270636e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:08.975183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bec193-bb1f-45f2-ad8b-64c34270636e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:08.975450 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bec193-bb1f-45f2-ad8b-64c34270636e None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:08.975842 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d71e4-3276-4ced-ac60-7c61e71d1bc0 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:08.976031 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bec193-bb1f-45f2-ad8b-64c34270636e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:08.976312 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bec193-bb1f-45f2-ad8b-64c34270636e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:08.977853 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bec193-bb1f-45f2-ad8b-64c34270636e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:08.995142 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 391/784] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:14:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:08.995142 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bec193-bb1f-45f2-ad8b-64c34270636e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:09.026158 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fbfb1b-7470-4b2a-91c1-fe4d18889408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:09.026829 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbfb1b-7470-4b2a-91c1-fe4d18889408 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:09.027095 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbfb1b-7470-4b2a-91c1-fe4d18889408 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:09.027366 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbfb1b-7470-4b2a-91c1-fe4d18889408 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:09.028154 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fbfb1b-7470-4b2a-91c1-fe4d18889408 None admin] RBAC: Adding query filter params (interface=public, service_id=2fee7229d5914161abd4384c9d28910e, region_id=RegionOne) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:09.028474 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fbfb1b-7470-4b2a-91c1-fe4d18889408 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:09.029838 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fbfb1b-7470-4b2a-91c1-fe4d18889408 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:09.038521 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 394/785] 10.222.0.32 () {56 vars in 1251 bytes} [Wed Jun 1 04:14:08 2022] GET /identity/v3/endpoints?service_id=2fee7229d5914161abd4384c9d28910e&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:09.039353 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fbfb1b-7470-4b2a-91c1-fe4d18889408 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:09.042108 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:09.111182 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bec193-bb1f-45f2-ad8b-64c34270636e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:09.150890 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272af6b5-2a50-4626-9bb9-9dad5022ff56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:09.151688 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272af6b5-2a50-4626-9bb9-9dad5022ff56 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:09.152035 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272af6b5-2a50-4626-9bb9-9dad5022ff56 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:09.152429 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272af6b5-2a50-4626-9bb9-9dad5022ff56 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:09.153727 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272af6b5-2a50-4626-9bb9-9dad5022ff56 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:09.154212 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272af6b5-2a50-4626-9bb9-9dad5022ff56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:09.156595 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272af6b5-2a50-4626-9bb9-9dad5022ff56 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:09.180845 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fbfb1b-7470-4b2a-91c1-fe4d18889408 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:09.181142 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 392/786] 10.222.0.32 () {56 vars in 1149 bytes} [Wed Jun 1 04:14:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:09.182040 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272af6b5-2a50-4626-9bb9-9dad5022ff56 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:09.201859 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:09.225202 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a918e3b9-c579-457f-b0a1-59037a8c1790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:09.226043 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918e3b9-c579-457f-b0a1-59037a8c1790 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:09.226333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918e3b9-c579-457f-b0a1-59037a8c1790 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:09.226605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918e3b9-c579-457f-b0a1-59037a8c1790 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:09.240559 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a918e3b9-c579-457f-b0a1-59037a8c1790 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:09.242110 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a918e3b9-c579-457f-b0a1-59037a8c1790 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:09.260950 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-a918e3b9-c579-457f-b0a1-59037a8c1790 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:09.260950 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:09.260950 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:09.260950 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:09.260950 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:09.260950 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:09.260950 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:09.260950 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:09.260950 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:09.260950 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:09.260950 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:09.260950 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:09.260950 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:14:09.260950 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:14:09.260950 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:14:09.262414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:14:09.262414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:09.262414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:09.262414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:09.262414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:09.262414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:09.262414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:09.262414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:09.262414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:09.262414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:09.262414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:09.262414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:09.262414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:09.262414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:09.262414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:09.262414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:09.262414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:09.263391 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:14:09.263391 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:14:09.263391 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:09.263391 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:09.263391 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 395/787] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:14:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:09.263391 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a918e3b9-c579-457f-b0a1-59037a8c1790 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:09.306978 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272af6b5-2a50-4626-9bb9-9dad5022ff56 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:09.323443 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:09.344114 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d8c32-cc5a-4814-83f4-fef35e7048a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:09.344922 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d8c32-cc5a-4814-83f4-fef35e7048a8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:09.345203 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d8c32-cc5a-4814-83f4-fef35e7048a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:09.345481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d8c32-cc5a-4814-83f4-fef35e7048a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:09.356321 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d8c32-cc5a-4814-83f4-fef35e7048a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:09.357770 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d8c32-cc5a-4814-83f4-fef35e7048a8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:09.371238 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a918e3b9-c579-457f-b0a1-59037a8c1790 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:09.377359 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-0c9d8c32-cc5a-4814-83f4-fef35e7048a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:09.377359 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:09.377359 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:09.377359 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:09.377359 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:09.377359 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:09.377359 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:09.377359 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:09.377359 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:09.377359 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:09.377359 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:09.377359 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:09.377359 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:14:09.377359 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:14:09.377359 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:14:09.379138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:14:09.379138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:09.379138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:09.379138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:09.379138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:09.379138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:09.379138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:09.379138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:09.379138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:09.379138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:09.379138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:09.379138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:09.379138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:09.379138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:09.379138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:09.379138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:09.379138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:09.381424 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:14:09.381424 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:14:09.381424 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:09.381424 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:09.381424 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 393/788] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:14:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:09.381424 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf6d04-be06-4747-b015-8585df7d337d None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:09.381424 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf6d04-be06-4747-b015-8585df7d337d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:09.381424 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf6d04-be06-4747-b015-8585df7d337d None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:09.385210 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 394/789] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:14:09.385210 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf6d04-be06-4747-b015-8585df7d337d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:09.416677 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a21bdf-07fe-4161-a4a7-307dbd0a7fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:09.417339 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a21bdf-07fe-4161-a4a7-307dbd0a7fbd None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:09.417626 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a21bdf-07fe-4161-a4a7-307dbd0a7fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:09.417901 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a21bdf-07fe-4161-a4a7-307dbd0a7fbd None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:09.418617 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a21bdf-07fe-4161-a4a7-307dbd0a7fbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:09.419981 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a21bdf-07fe-4161-a4a7-307dbd0a7fbd None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:09.425243 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 396/790] 10.222.0.32 () {56 vars in 1087 bytes} [Wed Jun 1 04:14:09 2022] GET /identity/v3/services => generated 772 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:09.426067 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a21bdf-07fe-4161-a4a7-307dbd0a7fbd None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:09.459924 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:09.512255 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf6d04-be06-4747-b015-8585df7d337d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:09.556193 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cea0f-7318-4ebb-88a7-77f8667c4ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:09.557026 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cea0f-7318-4ebb-88a7-77f8667c4ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:09.557306 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cea0f-7318-4ebb-88a7-77f8667c4ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:09.557577 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cea0f-7318-4ebb-88a7-77f8667c4ca3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:09.571295 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8cea0f-7318-4ebb-88a7-77f8667c4ca3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:09.572900 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8cea0f-7318-4ebb-88a7-77f8667c4ca3 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:09.575208 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a21bdf-07fe-4161-a4a7-307dbd0a7fbd None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:09.593669 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-ec8cea0f-7318-4ebb-88a7-77f8667c4ca3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:09.593669 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:09.593669 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:09.593669 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:09.593669 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:09.593669 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:09.593669 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:09.593669 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:09.593669 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:09.593669 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:09.593669 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:09.593669 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:09.593669 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:14:09.593669 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:14:09.593669 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:14:09.594933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:14:09.594933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:09.594933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:09.594933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:09.594933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:09.594933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:09.594933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:09.594933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:09.594933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:09.594933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:09.594933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:09.594933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:09.594933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:09.594933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:09.594933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:09.594933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:09.594933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:09.595862 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:14:09.595862 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:14:09.595862 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:09.595862 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:09.595862 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 395/791] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:14:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:09.595862 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cea0f-7318-4ebb-88a7-77f8667c4ca3 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:09.610916 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:09.631971 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a0c95-6eb5-4a03-9ba0-ce85a486b685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:09.632922 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a0c95-6eb5-4a03-9ba0-ce85a486b685 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:09.632922 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a0c95-6eb5-4a03-9ba0-ce85a486b685 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:09.633134 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a0c95-6eb5-4a03-9ba0-ce85a486b685 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:09.633846 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24a0c95-6eb5-4a03-9ba0-ce85a486b685 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:09.634193 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24a0c95-6eb5-4a03-9ba0-ce85a486b685 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:09.635642 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24a0c95-6eb5-4a03-9ba0-ce85a486b685 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:09.651873 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 397/792] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:09.653076 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5c276-0459-43a9-93ba-f52b88d87d78 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:09.653361 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5c276-0459-43a9-93ba-f52b88d87d78 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:09.653637 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5c276-0459-43a9-93ba-f52b88d87d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:09.674660 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-82d5c276-0459-43a9-93ba-f52b88d87d78 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:09.675997 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-82d5c276-0459-43a9-93ba-f52b88d87d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:09.739074 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cea0f-7318-4ebb-88a7-77f8667c4ca3 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:09.757569 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:09.761551 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 398/793] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:14:09.763076 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5c276-0459-43a9-93ba-f52b88d87d78 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:09.791616 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b43a44-81d4-4d7f-bde5-d103cbb1dd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:09.792286 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b43a44-81d4-4d7f-bde5-d103cbb1dd87 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:09.792573 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b43a44-81d4-4d7f-bde5-d103cbb1dd87 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:09.792874 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b43a44-81d4-4d7f-bde5-d103cbb1dd87 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:09.793595 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b43a44-81d4-4d7f-bde5-d103cbb1dd87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:09.793897 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b43a44-81d4-4d7f-bde5-d103cbb1dd87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:09.795407 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b43a44-81d4-4d7f-bde5-d103cbb1dd87 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:09.810359 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 396/794] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:09.811641 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b43a44-81d4-4d7f-bde5-d103cbb1dd87 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:09.916535 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5c276-0459-43a9-93ba-f52b88d87d78 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:09.923499 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b43a44-81d4-4d7f-bde5-d103cbb1dd87 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:09.927405 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:09.959555 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348da18-7529-453a-9812-c12047cf24ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:09.960370 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348da18-7529-453a-9812-c12047cf24ce None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:09.960656 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348da18-7529-453a-9812-c12047cf24ce None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:09.960932 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348da18-7529-453a-9812-c12047cf24ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:09.961219 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a7821-9804-4580-8511-d28f97b9dd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:09.961890 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a7821-9804-4580-8511-d28f97b9dd5d None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:09.962203 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a7821-9804-4580-8511-d28f97b9dd5d None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:09.962517 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a7821-9804-4580-8511-d28f97b9dd5d None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:09.963498 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a7821-9804-4580-8511-d28f97b9dd5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:09.964730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a7821-9804-4580-8511-d28f97b9dd5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:09.966151 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a7821-9804-4580-8511-d28f97b9dd5d None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:09.968592 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c348da18-7529-453a-9812-c12047cf24ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:09.970045 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c348da18-7529-453a-9812-c12047cf24ce None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:09.984979 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 399/795] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:09.984979 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a7821-9804-4580-8511-d28f97b9dd5d None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:09.985831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-c348da18-7529-453a-9812-c12047cf24ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:14:09.985831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:09.985831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:09.985831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:09.985831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:09.985831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:09.985831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:09.985831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:09.985831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:09.985831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:09.985831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:09.985831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:09.985831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 04:14:09.985831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 04:14:09.985831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 04:14:09.987086 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 04:14:09.987086 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:09.987086 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:09.987086 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:09.987086 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:09.987086 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:09.987086 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:09.987086 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:09.987086 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:09.987086 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:09.987086 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:09.987086 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:09.987086 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:09.987086 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:09.987086 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:09.987086 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:09.987086 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:09.988002 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 04:14:09.988002 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 04:14:09.988002 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 04:14:09.988002 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 04:14:09.988002 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 04:14:09.988002 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 04:14:09.988002 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:14:09.988002 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:09.991718 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 397/796] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:14:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:09.992622 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348da18-7529-453a-9812-c12047cf24ce None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:10.037581 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:10.096009 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a7821-9804-4580-8511-d28f97b9dd5d None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:10.103620 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348da18-7529-453a-9812-c12047cf24ce None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:10.133165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233dfd42-af4b-4b6c-a4bc-1c895e513460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:10.134266 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dfd42-af4b-4b6c-a4bc-1c895e513460 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:10.134541 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dfd42-af4b-4b6c-a4bc-1c895e513460 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:10.134975 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dfd42-af4b-4b6c-a4bc-1c895e513460 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:10.135926 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233dfd42-af4b-4b6c-a4bc-1c895e513460 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:10.137578 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233dfd42-af4b-4b6c-a4bc-1c895e513460 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:10.140281 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec38b3-22e5-40e8-b56f-a945025c5bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:10.141140 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec38b3-22e5-40e8-b56f-a945025c5bac None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:10.141597 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec38b3-22e5-40e8-b56f-a945025c5bac None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:10.142070 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec38b3-22e5-40e8-b56f-a945025c5bac None admin] PATH_INFO: `/v3/users/swift` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:10.150323 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec38b3-22e5-40e8-b56f-a945025c5bac None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:10.151956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec38b3-22e5-40e8-b56f-a945025c5bac None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:10.152138 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-233dfd42-af4b-4b6c-a4bc-1c895e513460 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 01 04:14:10.152138 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:10.152138 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 04:14:10.152138 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 04:14:10.152138 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 04:14:10.152138 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 04:14:10.152138 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 04:14:10.152138 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:10.152138 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 01 04:14:10.152138 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:10.152138 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 04:14:10.152138 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:10.152138 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:10.152138 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:10.152138 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:10.152138 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:10.153206 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:10.153206 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:10.153206 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:10.153206 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:10.153206 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:10.153206 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:10.153206 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:10.153206 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 04:14:10.153206 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 04:14:10.153206 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 04:14:10.153206 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 04:14:10.153206 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:10.153206 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:10.153206 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:10.153206 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:10.153206 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:10.154247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:10.154247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:10.154247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:10.154247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:10.154247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:10.154247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:10.154247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:10.154247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:10.154247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:10.154247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:10.154247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:10.154247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 04:14:10.154247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:10.154247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 01 04:14:10.154247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:10.157579 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 400/797] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Jun 1 04:14:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:10.158635 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233dfd42-af4b-4b6c-a4bc-1c895e513460 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:10.173691 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-6dec38b3-22e5-40e8-b56f-a945025c5bac None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 01 04:14:10.173691 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:10.173691 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:10.173691 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:10.173691 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:10.173691 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:10.173691 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:10.173691 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:10.173691 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:10.173691 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:10.173691 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:10.173691 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:10.173691 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 04:14:10.173691 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 04:14:10.173691 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 04:14:10.173691 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 04:14:10.174885 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:10.174885 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:10.174885 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 04:14:10.174885 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:14:10.174885 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 04:14:10.174885 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:14:10.174885 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:10.174885 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:10.174885 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:10.174885 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:10.174885 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:10.174885 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:10.174885 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:10.174885 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:10.174885 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:10.174885 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:10.174885 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:10.174885 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:10.175930 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:10.175930 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:10.175930 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 04:14:10.175930 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 04:14:10.175930 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 04:14:10.175930 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 04:14:10.175930 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 04:14:10.175930 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 04:14:10.175930 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 01 04:14:10.175930 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:10.175930 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 398/798] 10.222.0.32 () {56 vars in 1096 bytes} [Wed Jun 1 04:14:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:10.175930 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec38b3-22e5-40e8-b56f-a945025c5bac None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:10.204087 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:10.282356 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233dfd42-af4b-4b6c-a4bc-1c895e513460 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:10.286270 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:10.290961 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec38b3-22e5-40e8-b56f-a945025c5bac None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:10.321179 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff04183-0000-48fe-871b-95cb0ab83b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:10.322062 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff04183-0000-48fe-871b-95cb0ab83b5c None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:10.322399 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff04183-0000-48fe-871b-95cb0ab83b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:10.322679 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff04183-0000-48fe-871b-95cb0ab83b5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:10.329781 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff04183-0000-48fe-871b-95cb0ab83b5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:10.330796 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e51b07-ab33-4455-bef2-c981ee0f4db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:10.331276 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff04183-0000-48fe-871b-95cb0ab83b5c None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:10.331462 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e51b07-ab33-4455-bef2-c981ee0f4db0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:10.331747 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e51b07-ab33-4455-bef2-c981ee0f4db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:10.332047 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e51b07-ab33-4455-bef2-c981ee0f4db0 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:10.333353 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e51b07-ab33-4455-bef2-c981ee0f4db0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:10.333671 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e51b07-ab33-4455-bef2-c981ee0f4db0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:10.335148 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e51b07-ab33-4455-bef2-c981ee0f4db0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:10.346851 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-1ff04183-0000-48fe-871b-95cb0ab83b5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:14:10.346851 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:10.346851 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:10.346851 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:10.346851 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:10.346851 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:10.346851 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:10.346851 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:10.346851 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:10.346851 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:10.346851 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:10.346851 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:10.346851 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 04:14:10.346851 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 04:14:10.346851 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 04:14:10.353284 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 04:14:10.353284 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:10.353284 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:10.353284 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:10.353284 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:10.353284 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:10.353284 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:10.353284 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:10.353284 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:10.353284 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:10.353284 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:10.353284 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:10.353284 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:10.353284 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:10.353284 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:10.353284 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:10.353284 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:10.354222 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 04:14:10.354222 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 04:14:10.354222 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 04:14:10.354222 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 04:14:10.354222 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 04:14:10.354222 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 04:14:10.354222 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:14:10.354222 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:10.354636 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 399/799] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Jun 1 04:14:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:10.354723 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 401/800] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:14:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:10.354723 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff04183-0000-48fe-871b-95cb0ab83b5c None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:10.354848 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e51b07-ab33-4455-bef2-c981ee0f4db0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:10.454364 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:10.462148 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff04183-0000-48fe-871b-95cb0ab83b5c None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:10.470908 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e51b07-ab33-4455-bef2-c981ee0f4db0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:10.499763 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2225a-dc0b-4ffe-87bc-c9b1629e16a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:10.500719 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2225a-dc0b-4ffe-87bc-c9b1629e16a0 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:10.501177 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2225a-dc0b-4ffe-87bc-c9b1629e16a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:10.501625 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2225a-dc0b-4ffe-87bc-c9b1629e16a0 None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:10.502678 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e2225a-dc0b-4ffe-87bc-c9b1629e16a0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:10.503050 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e2225a-dc0b-4ffe-87bc-c9b1629e16a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:10.505303 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e2225a-dc0b-4ffe-87bc-c9b1629e16a0 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:10.507517 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b6cc0-65e9-4722-964c-f994085154a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:10.508185 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b6cc0-65e9-4722-964c-f994085154a7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:10.508470 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b6cc0-65e9-4722-964c-f994085154a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:10.508746 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b6cc0-65e9-4722-964c-f994085154a7 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:10.509450 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b6cc0-65e9-4722-964c-f994085154a7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:10.509756 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b6cc0-65e9-4722-964c-f994085154a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:10.511211 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b6cc0-65e9-4722-964c-f994085154a7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:10.516135 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 400/801] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Jun 1 04:14:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:10.516729 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b6cc0-65e9-4722-964c-f994085154a7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:10.529085 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 402/802] 10.222.0.32 () {56 vars in 1135 bytes} [Wed Jun 1 04:14:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:10.530187 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2225a-dc0b-4ffe-87bc-c9b1629e16a0 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:10.550444 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:10.631136 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b6cc0-65e9-4722-964c-f994085154a7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:10.636813 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2225a-dc0b-4ffe-87bc-c9b1629e16a0 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:10.666461 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0864d4-1ad5-40b8-822d-139ac8c90208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:10.667369 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0864d4-1ad5-40b8-822d-139ac8c90208 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:10.667658 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0864d4-1ad5-40b8-822d-139ac8c90208 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:10.667936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0864d4-1ad5-40b8-822d-139ac8c90208 None admin] PATH_INFO: `/v3/projects/31d68f64d21647688074554062952074/users/79d614f85f5541d3babbb41468cbf55c/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:10.669958 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0864d4-1ad5-40b8-822d-139ac8c90208 None admin] RBAC: Authorizing `identity:create_grant(project_id=31d68f64d21647688074554062952074, user_id=79d614f85f5541d3babbb41468cbf55c, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:10.671424 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0864d4-1ad5-40b8-822d-139ac8c90208 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:10.677950 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c3d88-1a61-4057-8eda-834e809ab60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:10.678763 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c3d88-1a61-4057-8eda-834e809ab60a None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:10.679049 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c3d88-1a61-4057-8eda-834e809ab60a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:10.679394 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c3d88-1a61-4057-8eda-834e809ab60a None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:10.680560 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c3d88-1a61-4057-8eda-834e809ab60a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:10.681017 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c3d88-1a61-4057-8eda-834e809ab60a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:10.682607 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c3d88-1a61-4057-8eda-834e809ab60a None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:10.685721 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 401/803] 10.222.0.32 () {58 vars in 1439 bytes} [Wed Jun 1 04:14:10 2022] PUT /identity/v3/projects/31d68f64d21647688074554062952074/users/79d614f85f5541d3babbb41468cbf55c/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:14:10.686576 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0864d4-1ad5-40b8-822d-139ac8c90208 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:10.705387 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 403/804] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Jun 1 04:14:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:10.706725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c3d88-1a61-4057-8eda-834e809ab60a None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:10.722186 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:10.794553 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:10.817418 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0864d4-1ad5-40b8-822d-139ac8c90208 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:10.831684 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c3d88-1a61-4057-8eda-834e809ab60a None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:10.858436 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836855c-9d3c-4e0f-9b4d-d43283b24ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:10.859414 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836855c-9d3c-4e0f-9b4d-d43283b24ddc None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:10.859848 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836855c-9d3c-4e0f-9b4d-d43283b24ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:10.860302 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836855c-9d3c-4e0f-9b4d-d43283b24ddc None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:10.861173 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3836855c-9d3c-4e0f-9b4d-d43283b24ddc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:10.861628 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3836855c-9d3c-4e0f-9b4d-d43283b24ddc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:10.863330 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3836855c-9d3c-4e0f-9b4d-d43283b24ddc None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:10.870043 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 402/805] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Jun 1 04:14:10 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:10.871226 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836855c-9d3c-4e0f-9b4d-d43283b24ddc None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:10.878124 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df62206-8ab1-49ff-86ec-98a1d17aa811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:10.880280 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df62206-8ab1-49ff-86ec-98a1d17aa811 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:10.880730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df62206-8ab1-49ff-86ec-98a1d17aa811 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:10.881158 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df62206-8ab1-49ff-86ec-98a1d17aa811 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:10.899893 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df62206-8ab1-49ff-86ec-98a1d17aa811 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:10.901613 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df62206-8ab1-49ff-86ec-98a1d17aa811 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:10.927216 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-5df62206-8ab1-49ff-86ec-98a1d17aa811 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:10.927216 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:10.927216 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:10.927216 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:10.927216 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:10.927216 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:10.927216 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:10.927216 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:10.927216 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:10.927216 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:10.927216 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:10.927216 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:10.927216 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:14:10.927216 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:14:10.927216 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:14:10.928186 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:14:10.928186 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:10.928186 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:10.928186 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:10.928186 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:10.928186 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:10.928186 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:10.928186 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:10.928186 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:10.928186 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:10.928186 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:10.928186 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:10.928186 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:10.928186 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:10.928186 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:10.928186 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:10.928186 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:10.929747 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:14:10.929747 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:14:10.929747 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:10.929747 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:10.929747 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 404/806] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:14:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:10.929747 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df62206-8ab1-49ff-86ec-98a1d17aa811 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:11.000715 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:11.021021 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836855c-9d3c-4e0f-9b4d-d43283b24ddc None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:11.054401 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df62206-8ab1-49ff-86ec-98a1d17aa811 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:11.062193 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601964a5-e777-4dbb-8d96-7ba96df6f2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:11.063094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601964a5-e777-4dbb-8d96-7ba96df6f2c1 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:11.063381 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601964a5-e777-4dbb-8d96-7ba96df6f2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:11.063660 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601964a5-e777-4dbb-8d96-7ba96df6f2c1 None admin] PATH_INFO: `/v3/projects/31d68f64d21647688074554062952074/users/3fa2ad34164a4631adf76fbd042679ba/roles/5e94b8f2c0b1418e8d2a18e4fe08d4f9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:11.085169 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601964a5-e777-4dbb-8d96-7ba96df6f2c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=31d68f64d21647688074554062952074, user_id=3fa2ad34164a4631adf76fbd042679ba, role_id=5e94b8f2c0b1418e8d2a18e4fe08d4f9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:11.087008 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601964a5-e777-4dbb-8d96-7ba96df6f2c1 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:11.091944 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:11.096271 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fbf22-5ba8-44f1-a00a-757a154f640d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:11.097312 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fbf22-5ba8-44f1-a00a-757a154f640d None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:11.097941 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fbf22-5ba8-44f1-a00a-757a154f640d None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:11.099222 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fbf22-5ba8-44f1-a00a-757a154f640d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:11.100249 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262fbf22-5ba8-44f1-a00a-757a154f640d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:11.101936 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262fbf22-5ba8-44f1-a00a-757a154f640d None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:11.112054 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 403/807] 10.222.0.32 () {58 vars in 1439 bytes} [Wed Jun 1 04:14:10 2022] PUT /identity/v3/projects/31d68f64d21647688074554062952074/users/3fa2ad34164a4631adf76fbd042679ba/roles/5e94b8f2c0b1418e8d2a18e4fe08d4f9 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:14:11.113326 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601964a5-e777-4dbb-8d96-7ba96df6f2c1 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:11.146581 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 405/808] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Jun 1 04:14:10 2022] POST /identity/v3/endpoints => generated 346 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:14:11.303221 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601964a5-e777-4dbb-8d96-7ba96df6f2c1 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:11.364863 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14697a73-3eb8-4080-8453-ad9367c82921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:11.365573 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14697a73-3eb8-4080-8453-ad9367c82921 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:11.365858 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14697a73-3eb8-4080-8453-ad9367c82921 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:11.366221 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14697a73-3eb8-4080-8453-ad9367c82921 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:11.366969 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14697a73-3eb8-4080-8453-ad9367c82921 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:11.367275 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14697a73-3eb8-4080-8453-ad9367c82921 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:11.368711 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14697a73-3eb8-4080-8453-ad9367c82921 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:11.382005 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 404/809] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:11.387220 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fbf22-5ba8-44f1-a00a-757a154f640d None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:11.509959 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fbf22-5ba8-44f1-a00a-757a154f640d None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:11.530621 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:11.552293 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c085520-c421-4560-a5f7-0804d9642cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:11.553087 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c085520-c421-4560-a5f7-0804d9642cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:11.553421 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c085520-c421-4560-a5f7-0804d9642cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:11.553640 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c085520-c421-4560-a5f7-0804d9642cf0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:11.561032 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c085520-c421-4560-a5f7-0804d9642cf0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:11.562587 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c085520-c421-4560-a5f7-0804d9642cf0 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:11.578297 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-6c085520-c421-4560-a5f7-0804d9642cf0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:14:11.578297 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:11.578297 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:11.578297 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:11.578297 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:11.578297 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:11.578297 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:11.578297 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:11.578297 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:11.578297 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:11.578297 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:11.578297 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:11.578297 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 04:14:11.578297 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 04:14:11.578297 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 04:14:11.579247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 04:14:11.579247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:11.579247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:11.579247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:11.579247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:11.579247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:11.579247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:11.579247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:11.579247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:11.579247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:11.579247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:11.579247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:11.579247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:11.579247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:11.579247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:11.579247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:11.579247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:11.580858 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 04:14:11.580858 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 04:14:11.580858 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 04:14:11.580858 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 04:14:11.580858 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 04:14:11.580858 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 04:14:11.580858 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:14:11.580858 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:11.580858 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 406/810] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:14:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:11.587766 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14697a73-3eb8-4080-8453-ad9367c82921 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:11.646168 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:11.707779 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14697a73-3eb8-4080-8453-ad9367c82921 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:11.743345 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21210e79-c95d-4c77-8761-47f4c99f86f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:11.744013 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21210e79-c95d-4c77-8761-47f4c99f86f6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:11.744291 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21210e79-c95d-4c77-8761-47f4c99f86f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:11.744565 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21210e79-c95d-4c77-8761-47f4c99f86f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:11.745345 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21210e79-c95d-4c77-8761-47f4c99f86f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:11.745651 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21210e79-c95d-4c77-8761-47f4c99f86f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:11.747113 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21210e79-c95d-4c77-8761-47f4c99f86f6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:11.760850 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 405/811] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Jun 1 04:14:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:11.766646 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c085520-c421-4560-a5f7-0804d9642cf0 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:11.874495 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310b353-8a55-4615-98cc-6697a857b8c8 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:11.874697 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310b353-8a55-4615-98cc-6697a857b8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:11.874974 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310b353-8a55-4615-98cc-6697a857b8c8 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:11.876576 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 406/812] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:14:11.880615 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c085520-c421-4560-a5f7-0804d9642cf0 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:11.887491 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721108c-a59a-4278-a435-559fe6db1da6 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:11.887779 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721108c-a59a-4278-a435-559fe6db1da6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:11.888060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721108c-a59a-4278-a435-559fe6db1da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:11.922345 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f33de3-13c0-485d-a306-93dcf13abd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:11.923033 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7721108c-a59a-4278-a435-559fe6db1da6 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:11.923453 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f33de3-13c0-485d-a306-93dcf13abd3e None admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:11.923793 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f33de3-13c0-485d-a306-93dcf13abd3e None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:11.924127 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f33de3-13c0-485d-a306-93dcf13abd3e None admin] PATH_INFO: `/v3/projects/31d68f64d21647688074554062952074/users/413c6613b4ec4e53aeeaf6828c807273/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:11.924248 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7721108c-a59a-4278-a435-559fe6db1da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:11.926846 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f33de3-13c0-485d-a306-93dcf13abd3e None admin] RBAC: Authorizing `identity:create_grant(project_id=31d68f64d21647688074554062952074, user_id=413c6613b4ec4e53aeeaf6828c807273, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:11.928552 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f33de3-13c0-485d-a306-93dcf13abd3e None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:11.956104 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 407/813] 10.222.0.32 () {58 vars in 1439 bytes} [Wed Jun 1 04:14:11 2022] PUT /identity/v3/projects/31d68f64d21647688074554062952074/users/413c6613b4ec4e53aeeaf6828c807273/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:14:12.032805 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 407/814] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 04:14:12.069000 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f33de3-13c0-485d-a306-93dcf13abd3e None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:12.124952 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:12.221052 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f33de3-13c0-485d-a306-93dcf13abd3e None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:12.263238 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67095af2-8299-435a-b1a7-98bd96ee644d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:12.264054 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67095af2-8299-435a-b1a7-98bd96ee644d None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:12.264335 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67095af2-8299-435a-b1a7-98bd96ee644d None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:12.264610 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67095af2-8299-435a-b1a7-98bd96ee644d None admin] PATH_INFO: `/v3/services/network` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:12.265269 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67095af2-8299-435a-b1a7-98bd96ee644d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:12.266702 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67095af2-8299-435a-b1a7-98bd96ee644d None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:12.282004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-67095af2-8299-435a-b1a7-98bd96ee644d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 01 04:14:12.282004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:12.282004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 04:14:12.282004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 04:14:12.282004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 04:14:12.282004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 04:14:12.282004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 04:14:12.282004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:12.282004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 01 04:14:12.282004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:12.282004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 04:14:12.282004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:12.282004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:12.282004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:12.282004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:12.282004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:12.282004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:12.283247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:12.283247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:12.283247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:12.283247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:12.283247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:12.283247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:12.283247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 04:14:12.283247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 04:14:12.283247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 04:14:12.283247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 04:14:12.283247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:12.283247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:12.283247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:12.283247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:12.283247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:12.283247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:12.284278 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:12.284278 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:12.284278 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:12.284278 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:12.284278 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:12.284278 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:12.284278 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:12.284278 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:12.284278 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:12.284278 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:12.284278 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 04:14:12.284278 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:12.284278 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 01 04:14:12.284278 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:12.284278 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 408/815] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:14:12 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:12.289497 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721108c-a59a-4278-a435-559fe6db1da6 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:12.338236 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:12.400934 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721108c-a59a-4278-a435-559fe6db1da6 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:12.447267 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3246d62-6e98-4e93-9e59-19a0f98ba9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:12.448317 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3246d62-6e98-4e93-9e59-19a0f98ba9d8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:12.448821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3246d62-6e98-4e93-9e59-19a0f98ba9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:12.449316 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3246d62-6e98-4e93-9e59-19a0f98ba9d8 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:12.450253 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3246d62-6e98-4e93-9e59-19a0f98ba9d8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:12.450766 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3246d62-6e98-4e93-9e59-19a0f98ba9d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:12.452380 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3246d62-6e98-4e93-9e59-19a0f98ba9d8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:12.457899 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 408/816] 10.222.0.32 () {56 vars in 1112 bytes} [Wed Jun 1 04:14:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:12.467089 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67095af2-8299-435a-b1a7-98bd96ee644d None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:12.659900 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67095af2-8299-435a-b1a7-98bd96ee644d None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:12.661727 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:12.717097 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919823bf-d1fd-4c41-83bf-a52e9bcf8c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:12.717776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919823bf-d1fd-4c41-83bf-a52e9bcf8c01 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:12.718082 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919823bf-d1fd-4c41-83bf-a52e9bcf8c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:12.718357 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919823bf-d1fd-4c41-83bf-a52e9bcf8c01 None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:12.719071 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919823bf-d1fd-4c41-83bf-a52e9bcf8c01 None admin] RBAC: Adding query filter params (type=network) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:12.719376 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919823bf-d1fd-4c41-83bf-a52e9bcf8c01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:12.720749 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919823bf-d1fd-4c41-83bf-a52e9bcf8c01 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:12.730605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 409/817] 10.222.0.32 () {56 vars in 1112 bytes} [Wed Jun 1 04:14:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:12.736208 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3246d62-6e98-4e93-9e59-19a0f98ba9d8 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:12.879890 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3246d62-6e98-4e93-9e59-19a0f98ba9d8 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:12.888811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:12.920665 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7528e2f2-e28f-4416-9df3-16bc5b471c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:12.921667 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528e2f2-e28f-4416-9df3-16bc5b471c07 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:12.922221 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528e2f2-e28f-4416-9df3-16bc5b471c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:12.922715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528e2f2-e28f-4416-9df3-16bc5b471c07 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:12.923653 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7528e2f2-e28f-4416-9df3-16bc5b471c07 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:12.925327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7528e2f2-e28f-4416-9df3-16bc5b471c07 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:12.955150 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 409/818] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Jun 1 04:14:12 2022] POST /identity/v3/endpoints => generated 327 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:14:13.393843 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9871250-b424-4791-bd00-b1bddbf1bfa9 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:13.395500 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9871250-b424-4791-bd00-b1bddbf1bfa9 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:13.395996 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9871250-b424-4791-bd00-b1bddbf1bfa9 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:13.397928 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 410/819] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:14:13.403619 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b01c7-a50a-49c6-8ab7-3450b82a254a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:13.404527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b01c7-a50a-49c6-8ab7-3450b82a254a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:13.405012 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b01c7-a50a-49c6-8ab7-3450b82a254a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:13.424943 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e42b01c7-a50a-49c6-8ab7-3450b82a254a None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:13.426554 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e42b01c7-a50a-49c6-8ab7-3450b82a254a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:13.505195 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 410/820] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:14:13.529844 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9871250-b424-4791-bd00-b1bddbf1bfa9 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:13.664316 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9871250-b424-4791-bd00-b1bddbf1bfa9 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:13.708687 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a9a31-66e3-42ef-93b8-7c37d844c69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:13.709495 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a9a31-66e3-42ef-93b8-7c37d844c69c None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:13.709779 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a9a31-66e3-42ef-93b8-7c37d844c69c None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:13.710109 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a9a31-66e3-42ef-93b8-7c37d844c69c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:13.723422 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980a9a31-66e3-42ef-93b8-7c37d844c69c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:14:13.731224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-980a9a31-66e3-42ef-93b8-7c37d844c69c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:14:13.731224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:13.731224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:13.731224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:13.731224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:13.731224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:13.731224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:13.731224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:13.731224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:13.731224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:13.731224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:13.731224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:13.731224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:14:13.731224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:14:13.731224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:14:13.731224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:14:13.732165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:14:13.732165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:14:13.732165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:14:13.732165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:14:13.732165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:13.732165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:13.732165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:13.732165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:13.732165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:13.732165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:13.732165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:13.732165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:13.732165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:13.732165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:13.732165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:13.732165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:13.733011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:13.733011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:13.733011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:13.733011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:13.733011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:14:13.733011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:14:13.733011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:14:13.733011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:14:13.733011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:14:13.733011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:14:13.733011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:14:13.733011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:13.733011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 411/821] 10.222.0.32 () {56 vars in 1096 bytes} [Wed Jun 1 04:14:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:13.740602 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b01c7-a50a-49c6-8ab7-3450b82a254a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:13.834810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:13.851335 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b01c7-a50a-49c6-8ab7-3450b82a254a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:13.888083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1a711-b0ec-468e-b91d-9c1ece9e6070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:13.889173 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1a711-b0ec-468e-b91d-9c1ece9e6070 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:13.889715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1a711-b0ec-468e-b91d-9c1ece9e6070 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:13.890219 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1a711-b0ec-468e-b91d-9c1ece9e6070 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:13.891231 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1a711-b0ec-468e-b91d-9c1ece9e6070 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:13.891734 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1a711-b0ec-468e-b91d-9c1ece9e6070 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:13.893296 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1a711-b0ec-468e-b91d-9c1ece9e6070 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:13.903633 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 411/822] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:14:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:13.905386 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521b915-f3fa-42d4-87f5-ad8cccf9865d None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:13.905680 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521b915-f3fa-42d4-87f5-ad8cccf9865d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:13.905961 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521b915-f3fa-42d4-87f5-ad8cccf9865d None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:13.907525 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 412/823] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:14:13.908692 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1a711-b0ec-468e-b91d-9c1ece9e6070 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:13.912995 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff97fe2-5103-4209-8ea1-ea5577f965b5 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:13.913372 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff97fe2-5103-4209-8ea1-ea5577f965b5 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:13.913650 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff97fe2-5103-4209-8ea1-ea5577f965b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:13.933375 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-2ff97fe2-5103-4209-8ea1-ea5577f965b5 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:13.934592 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-2ff97fe2-5103-4209-8ea1-ea5577f965b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:13.963963 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:14.038374 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1a711-b0ec-468e-b91d-9c1ece9e6070 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:14.042112 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 413/824] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 04:14:14.072976 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff97fe2-5103-4209-8ea1-ea5577f965b5 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:14.076876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24c003-f2c8-4b09-885a-6ec5ed073d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:14.077951 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24c003-f2c8-4b09-885a-6ec5ed073d7b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:14.078461 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24c003-f2c8-4b09-885a-6ec5ed073d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:14.078953 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24c003-f2c8-4b09-885a-6ec5ed073d7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:14.092022 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24c003-f2c8-4b09-885a-6ec5ed073d7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:14.093953 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24c003-f2c8-4b09-885a-6ec5ed073d7b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:14.118058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-9a24c003-f2c8-4b09-885a-6ec5ed073d7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:14.118058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:14.118058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:14.118058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:14.118058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:14.118058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:14.118058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:14.118058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:14.118058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:14.118058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:14.118058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:14.118058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:14.118058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:14:14.118058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:14:14.118058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:14:14.118995 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:14:14.118995 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:14.118995 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:14.118995 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:14.118995 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:14.118995 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:14.118995 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:14.118995 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:14.118995 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:14.118995 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:14.118995 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:14.118995 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:14.118995 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:14.118995 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:14.118995 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:14.118995 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:14.118995 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:14.119931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:14:14.119931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:14:14.119931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:14.119931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:14.123280 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 412/825] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:14:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:14.135401 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24c003-f2c8-4b09-885a-6ec5ed073d7b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:14.139857 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:14.196651 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff97fe2-5103-4209-8ea1-ea5577f965b5 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:14.288737 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d3c42-c4d9-4012-8d7b-7192cd524912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:14.288737 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d3c42-c4d9-4012-8d7b-7192cd524912 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:14.288737 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d3c42-c4d9-4012-8d7b-7192cd524912 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:14.288737 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d3c42-c4d9-4012-8d7b-7192cd524912 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:14.306011 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24c003-f2c8-4b09-885a-6ec5ed073d7b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:14.306219 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d3c42-c4d9-4012-8d7b-7192cd524912 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:14:14.314539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-938d3c42-c4d9-4012-8d7b-7192cd524912 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:14:14.314539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:14.314539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:14.314539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:14.314539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:14.314539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:14.314539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:14.314539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:14.314539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:14.314539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:14.314539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:14.314539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:14.314539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:14:14.314539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:14:14.314539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:14:14.314539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:14:14.315536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:14:14.315536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:14:14.315536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:14:14.315536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:14:14.315536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:14.315536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:14.315536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:14.315536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:14.315536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:14.315536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:14.315536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:14.315536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:14.315536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:14.315536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:14.315536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:14.315536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:14.316384 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:14.316384 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:14.316384 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:14.316384 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:14.316384 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:14:14.316384 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:14:14.316384 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:14:14.316384 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:14:14.316384 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:14:14.316384 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:14:14.316384 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:14:14.316384 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:14.321376 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 414/826] 10.222.0.32 () {56 vars in 1102 bytes} [Wed Jun 1 04:14:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:14:14.324039 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af17d17-deca-4e1b-a8a7-5706f26d73d1 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:14.324039 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af17d17-deca-4e1b-a8a7-5706f26d73d1 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:14.324039 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af17d17-deca-4e1b-a8a7-5706f26d73d1 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:14.326158 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 415/827] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:14:14.327595 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af17d17-deca-4e1b-a8a7-5706f26d73d1 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:14.350172 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:14.357006 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f44b20-1933-4e1e-b18f-1b3f33aad95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:14.357789 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f44b20-1933-4e1e-b18f-1b3f33aad95e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:14.358181 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f44b20-1933-4e1e-b18f-1b3f33aad95e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:14.358526 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f44b20-1933-4e1e-b18f-1b3f33aad95e None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:14.359325 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f44b20-1933-4e1e-b18f-1b3f33aad95e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:14.359701 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f44b20-1933-4e1e-b18f-1b3f33aad95e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:14.361410 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f44b20-1933-4e1e-b18f-1b3f33aad95e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:14.378146 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 413/828] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:14.381482 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a23be-618d-42af-959c-6efdf71c7f25 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:14.382437 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a23be-618d-42af-959c-6efdf71c7f25 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:14.382726 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a23be-618d-42af-959c-6efdf71c7f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:14.400795 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-488a23be-618d-42af-959c-6efdf71c7f25 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:14.402256 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-488a23be-618d-42af-959c-6efdf71c7f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:14.449838 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af17d17-deca-4e1b-a8a7-5706f26d73d1 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:14.472087 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:14.486103 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 414/829] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:14:14.486782 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a23be-618d-42af-959c-6efdf71c7f25 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:14.509080 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e3a3f-eb14-4149-9e0d-d6d19ba147af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:14.510302 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e3a3f-eb14-4149-9e0d-d6d19ba147af None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:14.510899 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e3a3f-eb14-4149-9e0d-d6d19ba147af None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:14.510899 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e3a3f-eb14-4149-9e0d-d6d19ba147af None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:14.511650 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e3a3f-eb14-4149-9e0d-d6d19ba147af None admin] RBAC: Adding query filter params (name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:14.511960 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e3a3f-eb14-4149-9e0d-d6d19ba147af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:14.513354 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e3a3f-eb14-4149-9e0d-d6d19ba147af None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:14.530189 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 416/830] 10.222.0.32 () {56 vars in 1103 bytes} [Wed Jun 1 04:14:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:14.530189 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e3a3f-eb14-4149-9e0d-d6d19ba147af None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:14.623256 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:14.630481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a23be-618d-42af-959c-6efdf71c7f25 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:14.653055 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e3a3f-eb14-4149-9e0d-d6d19ba147af None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:14.680470 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0946f2-a526-43b7-8963-1592c9b817b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:14.681517 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0946f2-a526-43b7-8963-1592c9b817b1 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:14.681802 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0946f2-a526-43b7-8963-1592c9b817b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:14.682109 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0946f2-a526-43b7-8963-1592c9b817b1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:14.693404 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0946f2-a526-43b7-8963-1592c9b817b1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:14.694701 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7294f2-1bb9-43b6-a69a-a3d10a021318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:14.695777 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7294f2-1bb9-43b6-a69a-a3d10a021318 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:14.696121 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0946f2-a526-43b7-8963-1592c9b817b1 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:14.696490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7294f2-1bb9-43b6-a69a-a3d10a021318 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:14.697034 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7294f2-1bb9-43b6-a69a-a3d10a021318 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:14.698043 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7294f2-1bb9-43b6-a69a-a3d10a021318 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:14.699960 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7294f2-1bb9-43b6-a69a-a3d10a021318 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:14.713434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-ee7294f2-1bb9-43b6-a69a-a3d10a021318 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 01 04:14:14.713434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:14.713434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 04:14:14.713434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 04:14:14.713434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 04:14:14.713434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 04:14:14.713434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 04:14:14.713434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:14.713434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 01 04:14:14.713434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:14.713434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 04:14:14.713434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:14.713434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:14.713434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:14.713434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:14.713434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:14.713434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:14.714553 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:14.714553 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:14.714553 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:14.714553 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:14.714553 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:14.714553 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:14.714553 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 04:14:14.714553 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 04:14:14.714553 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 04:14:14.714553 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 04:14:14.714553 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:14.714553 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:14.714553 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:14.714553 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:14.714553 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:14.714553 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:14.715397 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:14.715397 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:14.715397 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:14.715397 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:14.715397 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:14.715397 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:14.715397 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:14.715397 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:14.715397 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:14.715397 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:14.715397 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 04:14:14.715397 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:14.715397 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 01 04:14:14.715397 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:14.721967 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 417/831] 10.222.0.32 () {56 vars in 1114 bytes} [Wed Jun 1 04:14:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:14.721967 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7294f2-1bb9-43b6-a69a-a3d10a021318 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:14.723472 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-7a0946f2-a526-43b7-8963-1592c9b817b1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 01 04:14:14.723472 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:14.723472 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:14.723472 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:14.723472 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:14.723472 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:14.723472 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:14.723472 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:14.723472 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:14.723472 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:14.723472 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:14.723472 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:14.723472 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 04:14:14.723472 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 04:14:14.723472 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 04:14:14.723472 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 04:14:14.724780 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:14.724780 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:14.724780 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 04:14:14.724780 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:14:14.724780 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 04:14:14.724780 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:14:14.724780 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:14.724780 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:14.724780 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:14.724780 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:14.724780 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:14.724780 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:14.724780 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:14.724780 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:14.724780 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:14.724780 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:14.724780 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:14.724780 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:14.725738 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:14.725738 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:14.725738 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 04:14:14.725738 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 04:14:14.725738 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 04:14:14.725738 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 04:14:14.725738 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 04:14:14.725738 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 04:14:14.725738 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 01 04:14:14.725738 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:14.732416 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 415/832] 10.222.0.32 () {56 vars in 1093 bytes} [Wed Jun 1 04:14:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:14.732416 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0946f2-a526-43b7-8963-1592c9b817b1 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:14.795753 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:14.829002 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7294f2-1bb9-43b6-a69a-a3d10a021318 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:14.843846 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0946f2-a526-43b7-8963-1592c9b817b1 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:14.862282 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a54c0-2089-47e2-acf2-01a05280f0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:14.863077 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a54c0-2089-47e2-acf2-01a05280f0ed None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:14.863365 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a54c0-2089-47e2-acf2-01a05280f0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:14.864174 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a54c0-2089-47e2-acf2-01a05280f0ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:14.875442 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a54c0-2089-47e2-acf2-01a05280f0ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:14.876906 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a54c0-2089-47e2-acf2-01a05280f0ed None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:14.877148 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff571b4a-b665-4302-b254-cc9eed92f2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:14.877815 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff571b4a-b665-4302-b254-cc9eed92f2af None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:14.878136 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff571b4a-b665-4302-b254-cc9eed92f2af None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:14.878413 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff571b4a-b665-4302-b254-cc9eed92f2af None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:14.879034 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:14.879192 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff571b4a-b665-4302-b254-cc9eed92f2af None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:14.880080 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff571b4a-b665-4302-b254-cc9eed92f2af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:14.881502 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff571b4a-b665-4302-b254-cc9eed92f2af None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:14.886649 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 416/833] 10.222.0.32 () {56 vars in 1114 bytes} [Wed Jun 1 04:14:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:14.887450 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff571b4a-b665-4302-b254-cc9eed92f2af None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:14.895260 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-9c9a54c0-2089-47e2-acf2-01a05280f0ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:14.895260 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:14.895260 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:14.895260 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:14.895260 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:14.895260 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:14.895260 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:14.895260 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:14.895260 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:14.895260 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:14.895260 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:14.895260 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:14.895260 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:14:14.895260 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:14:14.895260 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:14:14.896240 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:14:14.896240 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:14.896240 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:14.896240 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:14.896240 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:14.896240 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:14.896240 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:14.896240 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:14.896240 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:14.896240 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:14.896240 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:14.896240 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:14.896240 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:14.896240 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:14.896240 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:14.896240 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:14.896240 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:14.897262 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:14:14.897262 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:14:14.897262 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:14.897262 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:14.897262 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 418/834] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:14:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:14.897745 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976e776-a262-4b61-90fb-65baafb32318 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:14.898003 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976e776-a262-4b61-90fb-65baafb32318 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:14.898267 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976e776-a262-4b61-90fb-65baafb32318 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:14.902029 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 419/835] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:14:14.902029 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976e776-a262-4b61-90fb-65baafb32318 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:14.988368 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff571b4a-b665-4302-b254-cc9eed92f2af None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:15.002930 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976e776-a262-4b61-90fb-65baafb32318 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:15.005452 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:15.025421 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162a1d4-4e2b-468e-b6e4-8b4ab91858b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:15.026119 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162a1d4-4e2b-468e-b6e4-8b4ab91858b3 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:15.026404 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162a1d4-4e2b-468e-b6e4-8b4ab91858b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:15.026684 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162a1d4-4e2b-468e-b6e4-8b4ab91858b3 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:15.027510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162a1d4-4e2b-468e-b6e4-8b4ab91858b3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:15.027820 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162a1d4-4e2b-468e-b6e4-8b4ab91858b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:15.029239 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162a1d4-4e2b-468e-b6e4-8b4ab91858b3 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:15.038126 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7347d-902f-487e-91ff-0bbd56fe6769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:15.038779 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7347d-902f-487e-91ff-0bbd56fe6769 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:15.039060 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7347d-902f-487e-91ff-0bbd56fe6769 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:15.039335 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7347d-902f-487e-91ff-0bbd56fe6769 None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:15.040028 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7347d-902f-487e-91ff-0bbd56fe6769 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:15.040329 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7347d-902f-487e-91ff-0bbd56fe6769 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:15.041667 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7347d-902f-487e-91ff-0bbd56fe6769 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:15.046323 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 420/836] 10.222.0.32 () {56 vars in 1114 bytes} [Wed Jun 1 04:14:14 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:15.051919 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 417/837] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Jun 1 04:14:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:15.052114 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7347d-902f-487e-91ff-0bbd56fe6769 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:15.052209 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa32a55-52a4-40bc-a15c-63f8017df773 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:15.052209 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa32a55-52a4-40bc-a15c-63f8017df773 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:15.052209 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa32a55-52a4-40bc-a15c-63f8017df773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:15.066768 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-8aa32a55-52a4-40bc-a15c-63f8017df773 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:15.068280 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8aa32a55-52a4-40bc-a15c-63f8017df773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:15.124866 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:15.155727 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 418/838] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:14:15.155727 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa32a55-52a4-40bc-a15c-63f8017df773 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:15.188460 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7347d-902f-487e-91ff-0bbd56fe6769 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:15.228482 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52650f-2f0f-47a7-ad41-6e54607147a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:15.229396 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52650f-2f0f-47a7-ad41-6e54607147a6 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:15.229744 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52650f-2f0f-47a7-ad41-6e54607147a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:15.230080 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52650f-2f0f-47a7-ad41-6e54607147a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:15.230827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52650f-2f0f-47a7-ad41-6e54607147a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:15.231134 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52650f-2f0f-47a7-ad41-6e54607147a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:15.232555 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52650f-2f0f-47a7-ad41-6e54607147a6 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:15.250391 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 421/839] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:15.251628 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52650f-2f0f-47a7-ad41-6e54607147a6 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:15.273954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa32a55-52a4-40bc-a15c-63f8017df773 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:15.279326 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:15.316286 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9f44c-78ba-4a11-9665-7c3dfcd8aef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:15.317032 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9f44c-78ba-4a11-9665-7c3dfcd8aef3 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:15.317256 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9f44c-78ba-4a11-9665-7c3dfcd8aef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:15.317535 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9f44c-78ba-4a11-9665-7c3dfcd8aef3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:15.368926 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52650f-2f0f-47a7-ad41-6e54607147a6 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:15.390659 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:15.400381 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b9f44c-78ba-4a11-9665-7c3dfcd8aef3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:15.401850 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b9f44c-78ba-4a11-9665-7c3dfcd8aef3 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:15.409790 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a9283-ef6b-4361-be43-2ce0178abe79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:15.411497 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a9283-ef6b-4361-be43-2ce0178abe79 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:15.411936 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a9283-ef6b-4361-be43-2ce0178abe79 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:15.412215 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a9283-ef6b-4361-be43-2ce0178abe79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:15.423538 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a9283-ef6b-4361-be43-2ce0178abe79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:14:15.432324 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-b74a9283-ef6b-4361-be43-2ce0178abe79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:14:15.432324 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:15.432324 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:15.432324 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:15.432324 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:15.432324 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:15.432324 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:15.432324 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:15.432324 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:15.432324 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:15.432324 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:15.432324 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:15.432324 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:14:15.432324 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:14:15.432324 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:14:15.432324 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:14:15.433470 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:14:15.433470 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:14:15.433470 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:14:15.433470 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:14:15.433470 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:15.433470 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:15.433470 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:15.433470 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:15.433470 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:15.433470 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:15.433470 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:15.433470 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:15.433470 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:15.433470 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:15.433470 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:15.433470 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:15.434468 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:15.434468 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:15.434468 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:15.434468 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:15.434468 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:14:15.434468 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:14:15.434468 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:14:15.434468 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:14:15.434468 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:14:15.434468 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:14:15.434468 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:14:15.434468 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:15.434468 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 422/840] 10.222.0.32 () {56 vars in 1096 bytes} [Wed Jun 1 04:14:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:15.434468 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a9283-ef6b-4361-be43-2ce0178abe79 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:15.522902 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 419/841] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:14:15 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 01 04:14:15.523683 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9f44c-78ba-4a11-9665-7c3dfcd8aef3 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:15.529891 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:15.557522 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a9283-ef6b-4361-be43-2ce0178abe79 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:15.594632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d19d9-e22d-4787-b358-0245e901b139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:15.595736 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d19d9-e22d-4787-b358-0245e901b139 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:15.596168 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d19d9-e22d-4787-b358-0245e901b139 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:15.596591 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d19d9-e22d-4787-b358-0245e901b139 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:15.606332 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d19d9-e22d-4787-b358-0245e901b139 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:15.608603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d19d9-e22d-4787-b358-0245e901b139 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:15.624714 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-3d8d19d9-e22d-4787-b358-0245e901b139 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 01 04:14:15.624714 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:15.624714 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:15.624714 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:15.624714 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:15.624714 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:15.624714 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:15.624714 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:15.624714 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:15.624714 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:15.624714 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:15.624714 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:15.624714 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 04:14:15.624714 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 04:14:15.624714 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 04:14:15.624714 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 04:14:15.625807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:15.625807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:15.625807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 04:14:15.625807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:14:15.625807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 04:14:15.625807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:14:15.625807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:15.625807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:15.625807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:15.625807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:15.625807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:15.625807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:15.625807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:15.625807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:15.625807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:15.625807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:15.625807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:15.625807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:15.626869 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:15.626869 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:15.626869 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 04:14:15.626869 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 04:14:15.626869 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 04:14:15.626869 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 04:14:15.626869 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 04:14:15.626869 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 04:14:15.626869 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 01 04:14:15.626869 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:15.628820 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 423/842] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Jun 1 04:14:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:15.629827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d19d9-e22d-4787-b358-0245e901b139 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:15.637152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9f44c-78ba-4a11-9665-7c3dfcd8aef3 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:15.672628 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:15.674212 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f03922-e721-49e4-9c97-eb74437929d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:15.675276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f03922-e721-49e4-9c97-eb74437929d3 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:15.675565 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f03922-e721-49e4-9c97-eb74437929d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:15.675843 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f03922-e721-49e4-9c97-eb74437929d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:15.676772 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f03922-e721-49e4-9c97-eb74437929d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:15.677115 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f03922-e721-49e4-9c97-eb74437929d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:15.679249 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f03922-e721-49e4-9c97-eb74437929d3 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:15.694299 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 420/843] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:14:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:15.694299 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f03922-e721-49e4-9c97-eb74437929d3 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:15.744174 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d19d9-e22d-4787-b358-0245e901b139 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:15.762083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:15.779122 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03504986-2b84-432f-ba5d-4f96001b7a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:15.779840 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03504986-2b84-432f-ba5d-4f96001b7a8e None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:15.780280 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03504986-2b84-432f-ba5d-4f96001b7a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:15.780568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03504986-2b84-432f-ba5d-4f96001b7a8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:15.792328 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03504986-2b84-432f-ba5d-4f96001b7a8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:15.793801 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03504986-2b84-432f-ba5d-4f96001b7a8e None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:15.802554 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f03922-e721-49e4-9c97-eb74437929d3 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:15.814004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-03504986-2b84-432f-ba5d-4f96001b7a8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:15.814004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:15.814004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:15.814004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:15.814004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:15.814004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:15.814004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:15.814004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:15.814004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:15.814004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:15.814004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:15.814004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:15.814004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:14:15.814004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:14:15.814004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:14:15.814952 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:14:15.814952 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:15.814952 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:15.814952 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:15.814952 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:15.814952 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:15.814952 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:15.814952 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:15.814952 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:15.814952 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:15.814952 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:15.814952 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:15.814952 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:15.814952 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:15.814952 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:15.814952 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:15.814952 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:15.822809 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:14:15.822809 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:14:15.822809 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:15.822809 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:15.822809 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 424/844] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:14:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:15.822809 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03504986-2b84-432f-ba5d-4f96001b7a8e None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:15.840202 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0ec65-b86c-485d-870e-e4e5f7cfb69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:15.840892 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0ec65-b86c-485d-870e-e4e5f7cfb69d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:15.841194 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0ec65-b86c-485d-870e-e4e5f7cfb69d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:15.841454 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0ec65-b86c-485d-870e-e4e5f7cfb69d None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:15.842328 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae0ec65-b86c-485d-870e-e4e5f7cfb69d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:15.842639 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae0ec65-b86c-485d-870e-e4e5f7cfb69d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:15.844073 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae0ec65-b86c-485d-870e-e4e5f7cfb69d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:15.862633 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 421/845] 10.222.0.32 () {56 vars in 1149 bytes} [Wed Jun 1 04:14:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:15.866954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0ec65-b86c-485d-870e-e4e5f7cfb69d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:15.924220 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:15.934577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03504986-2b84-432f-ba5d-4f96001b7a8e None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:15.974646 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcebac9a-5a95-4757-b1eb-3c41783e57c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:15.975535 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebac9a-5a95-4757-b1eb-3c41783e57c5 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:15.975825 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebac9a-5a95-4757-b1eb-3c41783e57c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:15.976106 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebac9a-5a95-4757-b1eb-3c41783e57c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:15.987575 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0ec65-b86c-485d-870e-e4e5f7cfb69d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:15.987808 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcebac9a-5a95-4757-b1eb-3c41783e57c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:15.989349 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcebac9a-5a95-4757-b1eb-3c41783e57c5 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:16.008603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-fcebac9a-5a95-4757-b1eb-3c41783e57c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:16.008603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:16.008603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:16.008603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:16.008603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:16.008603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:16.008603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:16.008603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:16.008603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:16.008603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:16.008603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:16.008603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:16.008603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:14:16.008603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:14:16.008603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:14:16.009627 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:14:16.009627 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:16.009627 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:16.009627 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:16.009627 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:16.009627 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:16.009627 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:16.009627 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:16.009627 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:16.009627 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:16.009627 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:16.009627 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:16.009627 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:16.009627 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:16.009627 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:16.009627 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:16.009627 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:16.011169 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:14:16.011169 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:14:16.011169 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:16.011169 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:16.014660 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 425/846] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:14:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:16.015606 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcebac9a-5a95-4757-b1eb-3c41783e57c5 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:16.016209 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:16.031353 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4514020-496d-4328-b763-65c33b4c7254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:16.032095 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4514020-496d-4328-b763-65c33b4c7254 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:16.032389 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4514020-496d-4328-b763-65c33b4c7254 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:16.032659 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4514020-496d-4328-b763-65c33b4c7254 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:16.033383 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4514020-496d-4328-b763-65c33b4c7254 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:16.033788 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4514020-496d-4328-b763-65c33b4c7254 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:16.035111 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4514020-496d-4328-b763-65c33b4c7254 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:16.047637 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 422/847] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:16.052620 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4514020-496d-4328-b763-65c33b4c7254 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:16.137260 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcebac9a-5a95-4757-b1eb-3c41783e57c5 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:16.180306 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4514020-496d-4328-b763-65c33b4c7254 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:16.182238 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb86197-f1ac-4336-a4b2-d76cec2ddcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:16.183875 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb86197-f1ac-4336-a4b2-d76cec2ddcdf None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:16.183875 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb86197-f1ac-4336-a4b2-d76cec2ddcdf None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:16.183875 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb86197-f1ac-4336-a4b2-d76cec2ddcdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:16.198564 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:16.218868 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb87ce0-c9a8-4a69-958c-af14c446865f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:16.219658 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb87ce0-c9a8-4a69-958c-af14c446865f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:16.219952 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb87ce0-c9a8-4a69-958c-af14c446865f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:16.220338 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb87ce0-c9a8-4a69-958c-af14c446865f None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:16.221068 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb87ce0-c9a8-4a69-958c-af14c446865f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:16.221375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb87ce0-c9a8-4a69-958c-af14c446865f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:16.222812 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb87ce0-c9a8-4a69-958c-af14c446865f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:16.241132 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 423/848] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:16.241132 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb87ce0-c9a8-4a69-958c-af14c446865f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:16.273999 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb86197-f1ac-4336-a4b2-d76cec2ddcdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:16.276568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb86197-f1ac-4336-a4b2-d76cec2ddcdf None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:16.287183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:16.347293 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb87ce0-c9a8-4a69-958c-af14c446865f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:16.386609 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a6ad6-7c82-4239-8c61-2e2cdee76ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:16.387382 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a6ad6-7c82-4239-8c61-2e2cdee76ddb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:16.387874 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a6ad6-7c82-4239-8c61-2e2cdee76ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:16.387984 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a6ad6-7c82-4239-8c61-2e2cdee76ddb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:16.391715 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 426/849] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:14:16 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 01 04:14:16.395559 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a6ad6-7c82-4239-8c61-2e2cdee76ddb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:16.397112 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a6ad6-7c82-4239-8c61-2e2cdee76ddb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:16.397439 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb86197-f1ac-4336-a4b2-d76cec2ddcdf None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:16.411345 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-f76a6ad6-7c82-4239-8c61-2e2cdee76ddb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:14:16.411345 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:16.411345 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:16.411345 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:16.411345 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:16.411345 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:16.411345 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:16.411345 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:16.411345 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:16.411345 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:16.411345 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:16.411345 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:16.411345 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 04:14:16.411345 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 04:14:16.411345 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 04:14:16.412342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 04:14:16.412342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:16.412342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:16.412342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:16.412342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:16.412342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:16.412342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:16.412342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:16.412342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:16.412342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:16.412342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:16.412342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:16.412342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:16.412342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:16.412342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:16.412342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:16.412342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:16.413208 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 04:14:16.413208 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 04:14:16.413208 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 04:14:16.413208 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 04:14:16.413208 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 04:14:16.413208 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 04:14:16.413208 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:14:16.413208 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:16.413208 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 424/850] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:14:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:16.413686 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a6ad6-7c82-4239-8c61-2e2cdee76ddb None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:16.448659 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:16.513426 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb86197-f1ac-4336-a4b2-d76cec2ddcdf None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:16.546538 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a6ad6-7c82-4239-8c61-2e2cdee76ddb None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:16.551669 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:16.551903 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb8aad-f718-4f22-8182-5f37b23e9d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:16.553062 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb8aad-f718-4f22-8182-5f37b23e9d67 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:16.553425 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb8aad-f718-4f22-8182-5f37b23e9d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:16.553644 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb8aad-f718-4f22-8182-5f37b23e9d67 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:16.561406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb8aad-f718-4f22-8182-5f37b23e9d67 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:16.562898 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb8aad-f718-4f22-8182-5f37b23e9d67 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:16.579333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-0afb8aad-f718-4f22-8182-5f37b23e9d67 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 01 04:14:16.579333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:16.579333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:16.579333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:16.579333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:16.579333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:16.579333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:16.579333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:16.579333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:16.579333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:16.579333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:16.579333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:16.579333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 04:14:16.579333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 04:14:16.579333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 04:14:16.579333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 04:14:16.580450 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:16.580450 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:16.580450 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 04:14:16.580450 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:14:16.580450 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 04:14:16.580450 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:14:16.580450 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:16.580450 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:16.580450 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:16.580450 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:16.580450 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:16.580450 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:16.580450 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:16.580450 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:16.580450 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:16.580450 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:16.580450 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:16.580450 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:16.582365 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:16.582365 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:16.582365 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 04:14:16.582365 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 04:14:16.582365 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 04:14:16.582365 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 04:14:16.582365 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 04:14:16.582365 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 04:14:16.582365 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 01 04:14:16.582365 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:16.582365 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 427/851] 10.222.0.32 () {56 vars in 1096 bytes} [Wed Jun 1 04:14:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:16.582365 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb8aad-f718-4f22-8182-5f37b23e9d67 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:16.590970 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800c700-f015-4179-93a8-56fe05be78bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:16.591794 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800c700-f015-4179-93a8-56fe05be78bc None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:16.592082 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800c700-f015-4179-93a8-56fe05be78bc None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:16.592362 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800c700-f015-4179-93a8-56fe05be78bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:16.604528 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800c700-f015-4179-93a8-56fe05be78bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:16.606000 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800c700-f015-4179-93a8-56fe05be78bc None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:16.624077 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-3800c700-f015-4179-93a8-56fe05be78bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:16.624077 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:16.624077 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:16.624077 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:16.624077 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:16.624077 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:16.624077 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:16.624077 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:16.624077 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:16.624077 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:16.624077 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:16.624077 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:16.624077 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:14:16.624077 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:14:16.624077 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:14:16.625053 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:14:16.625053 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:16.625053 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:16.625053 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:16.625053 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:16.625053 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:16.625053 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:16.625053 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:16.625053 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:16.625053 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:16.625053 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:16.625053 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:16.625053 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:16.625053 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:16.625053 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:16.625053 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:16.625053 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:16.631481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:14:16.631481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:14:16.631481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:16.631481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:16.631481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 425/852] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:14:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:16.631481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800c700-f015-4179-93a8-56fe05be78bc None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:16.694089 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb8aad-f718-4f22-8182-5f37b23e9d67 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:16.695784 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:16.731522 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb498d-7f3e-4447-90dc-8aba11002730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:16.732299 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb498d-7f3e-4447-90dc-8aba11002730 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:16.732585 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb498d-7f3e-4447-90dc-8aba11002730 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:16.732860 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb498d-7f3e-4447-90dc-8aba11002730 None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:16.733639 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fb498d-7f3e-4447-90dc-8aba11002730 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:16.733944 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fb498d-7f3e-4447-90dc-8aba11002730 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:16.735417 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fb498d-7f3e-4447-90dc-8aba11002730 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:16.738173 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800c700-f015-4179-93a8-56fe05be78bc None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:16.752393 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 428/853] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Jun 1 04:14:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:16.752393 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb498d-7f3e-4447-90dc-8aba11002730 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:16.782507 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32084c44-6f1e-4aaa-b459-c006a4c3a83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:16.783192 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32084c44-6f1e-4aaa-b459-c006a4c3a83f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:16.783504 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32084c44-6f1e-4aaa-b459-c006a4c3a83f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:16.783791 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32084c44-6f1e-4aaa-b459-c006a4c3a83f None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:16.784598 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32084c44-6f1e-4aaa-b459-c006a4c3a83f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:16.784907 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32084c44-6f1e-4aaa-b459-c006a4c3a83f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:16.786925 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32084c44-6f1e-4aaa-b459-c006a4c3a83f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:16.806468 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 426/854] 10.222.0.32 () {56 vars in 1135 bytes} [Wed Jun 1 04:14:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:16.807243 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32084c44-6f1e-4aaa-b459-c006a4c3a83f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:16.824691 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:16.872243 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb498d-7f3e-4447-90dc-8aba11002730 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:16.912340 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcee859-67d4-4b1e-90ae-52c77714cd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:16.913041 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcee859-67d4-4b1e-90ae-52c77714cd98 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:16.913471 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcee859-67d4-4b1e-90ae-52c77714cd98 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:16.913737 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcee859-67d4-4b1e-90ae-52c77714cd98 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:16.914498 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcee859-67d4-4b1e-90ae-52c77714cd98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:16.914805 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcee859-67d4-4b1e-90ae-52c77714cd98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:16.915346 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32084c44-6f1e-4aaa-b459-c006a4c3a83f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:16.916195 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcee859-67d4-4b1e-90ae-52c77714cd98 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:16.935988 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 429/855] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:16.935988 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcee859-67d4-4b1e-90ae-52c77714cd98 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:16.962562 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:16.965114 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b92f76c-df42-4b4c-9b46-4b54e4f1e756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:16.965954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92f76c-df42-4b4c-9b46-4b54e4f1e756 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:16.966410 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92f76c-df42-4b4c-9b46-4b54e4f1e756 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:16.966732 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92f76c-df42-4b4c-9b46-4b54e4f1e756 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:16.967725 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b92f76c-df42-4b4c-9b46-4b54e4f1e756 None admin] RBAC: Adding query filter params (role.id=76fc054ad9544460a7be1e2010c23642, scope.project.id=31d68f64d21647688074554062952074, user.id=79d614f85f5541d3babbb41468cbf55c) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:16.968154 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b92f76c-df42-4b4c-9b46-4b54e4f1e756 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:16.969785 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b92f76c-df42-4b4c-9b46-4b54e4f1e756 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:16.977804 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 427/856] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:14:16 2022] GET /identity/v3/role_assignments?user.id=79d614f85f5541d3babbb41468cbf55c&scope.project.id=31d68f64d21647688074554062952074&role.id=76fc054ad9544460a7be1e2010c23642 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:16.978692 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b92f76c-df42-4b4c-9b46-4b54e4f1e756 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:17.076679 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcee859-67d4-4b1e-90ae-52c77714cd98 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:17.083078 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:17.117368 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b92f76c-df42-4b4c-9b46-4b54e4f1e756 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:17.130577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702655b-0eff-4885-8c49-138225547c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:17.132059 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702655b-0eff-4885-8c49-138225547c8a None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:17.132534 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702655b-0eff-4885-8c49-138225547c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:17.133272 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702655b-0eff-4885-8c49-138225547c8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:17.170838 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346a3ec-4e5d-4b43-8c36-25d5cfbf15b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:17.171668 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346a3ec-4e5d-4b43-8c36-25d5cfbf15b5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:17.171955 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346a3ec-4e5d-4b43-8c36-25d5cfbf15b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:17.172230 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346a3ec-4e5d-4b43-8c36-25d5cfbf15b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:17.183195 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5346a3ec-4e5d-4b43-8c36-25d5cfbf15b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:17.186388 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5346a3ec-4e5d-4b43-8c36-25d5cfbf15b5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:17.206015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-5346a3ec-4e5d-4b43-8c36-25d5cfbf15b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:14:17.206015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:17.206015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:17.206015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:17.206015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:17.206015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:17.206015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:17.206015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:17.206015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:17.206015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:17.206015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:17.206015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:17.206015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 04:14:17.206015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 04:14:17.206015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 04:14:17.206969 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 04:14:17.206969 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:17.206969 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:17.206969 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:17.206969 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:17.206969 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:17.206969 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:17.206969 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:17.206969 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:17.206969 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:17.206969 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:17.206969 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:17.206969 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:17.206969 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:17.206969 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:17.206969 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:17.206969 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:17.208446 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 04:14:17.208446 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 04:14:17.208446 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 04:14:17.208446 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 04:14:17.208446 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 04:14:17.208446 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 04:14:17.208446 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:14:17.208446 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:17.216306 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 428/857] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:14:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:17.217641 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346a3ec-4e5d-4b43-8c36-25d5cfbf15b5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:17.236248 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702655b-0eff-4885-8c49-138225547c8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:17.238556 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702655b-0eff-4885-8c49-138225547c8a None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:17.268033 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:17.361761 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346a3ec-4e5d-4b43-8c36-25d5cfbf15b5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:17.363960 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 430/858] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:14:16 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 01 04:14:17.365208 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50b21f-9950-4efd-86d3-9fd96bc2d1c4 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:17.365506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50b21f-9950-4efd-86d3-9fd96bc2d1c4 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:17.365784 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50b21f-9950-4efd-86d3-9fd96bc2d1c4 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:17.370463 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 431/859] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:14:17.370463 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd50b21f-9950-4efd-86d3-9fd96bc2d1c4 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:17.404614 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea2cde-f4c5-44e1-b06a-d7ae01a0dcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:17.405606 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea2cde-f4c5-44e1-b06a-d7ae01a0dcb7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:17.405959 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea2cde-f4c5-44e1-b06a-d7ae01a0dcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:17.406336 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea2cde-f4c5-44e1-b06a-d7ae01a0dcb7 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:17.407237 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea2cde-f4c5-44e1-b06a-d7ae01a0dcb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:17.407657 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea2cde-f4c5-44e1-b06a-d7ae01a0dcb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:17.409230 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea2cde-f4c5-44e1-b06a-d7ae01a0dcb7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:17.417647 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:17.423720 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 429/860] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Jun 1 04:14:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:17.425095 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc32c93-0fde-4fb0-82cf-a7ab931ba744 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:17.425777 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc32c93-0fde-4fb0-82cf-a7ab931ba744 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:17.426127 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc32c93-0fde-4fb0-82cf-a7ab931ba744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:17.444532 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7cc32c93-0fde-4fb0-82cf-a7ab931ba744 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:17.445823 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7cc32c93-0fde-4fb0-82cf-a7ab931ba744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:17.489804 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd50b21f-9950-4efd-86d3-9fd96bc2d1c4 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:17.516997 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:17.522088 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 430/861] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:14:17.522088 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc32c93-0fde-4fb0-82cf-a7ab931ba744 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:17.538969 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9dbee-3444-4971-8931-9db1ead9d6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:17.540348 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9dbee-3444-4971-8931-9db1ead9d6ae None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:17.541264 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9dbee-3444-4971-8931-9db1ead9d6ae None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:17.541552 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9dbee-3444-4971-8931-9db1ead9d6ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:17.556880 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9dbee-3444-4971-8931-9db1ead9d6ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:17.558449 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9dbee-3444-4971-8931-9db1ead9d6ae None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:17.577185 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-8dd9dbee-3444-4971-8931-9db1ead9d6ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:17.577185 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:17.577185 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:17.577185 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:17.577185 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:17.577185 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:17.577185 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:17.577185 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:17.577185 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:17.577185 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:17.577185 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:17.577185 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:17.577185 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:14:17.577185 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:14:17.577185 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:14:17.578792 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:14:17.578792 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:17.578792 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:17.578792 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:17.578792 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:17.578792 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:17.578792 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:17.578792 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:17.578792 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:17.578792 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:17.578792 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:17.578792 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:17.578792 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:17.578792 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:17.578792 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:17.578792 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:17.578792 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:17.579683 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:14:17.579683 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:14:17.579683 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:17.579683 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:17.579683 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 432/862] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:14:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:14:17.579683 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9dbee-3444-4971-8931-9db1ead9d6ae None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:17.641921 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc32c93-0fde-4fb0-82cf-a7ab931ba744 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:17.671845 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:17.681937 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95be812-7a84-4f15-9987-f0e3937a75ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:17.682618 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95be812-7a84-4f15-9987-f0e3937a75ab None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:17.682901 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95be812-7a84-4f15-9987-f0e3937a75ab None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:17.683172 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95be812-7a84-4f15-9987-f0e3937a75ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:17.683996 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95be812-7a84-4f15-9987-f0e3937a75ab None admin] RBAC: Adding query filter params (role.id=5e94b8f2c0b1418e8d2a18e4fe08d4f9, scope.project.id=31d68f64d21647688074554062952074, user.id=3fa2ad34164a4631adf76fbd042679ba) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:17.684410 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95be812-7a84-4f15-9987-f0e3937a75ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:17.685723 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95be812-7a84-4f15-9987-f0e3937a75ab None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:17.689585 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9dbee-3444-4971-8931-9db1ead9d6ae None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:17.693474 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 431/863] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:14:17 2022] GET /identity/v3/role_assignments?user.id=3fa2ad34164a4631adf76fbd042679ba&scope.project.id=31d68f64d21647688074554062952074&role.id=5e94b8f2c0b1418e8d2a18e4fe08d4f9 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:17.693718 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95be812-7a84-4f15-9987-f0e3937a75ab None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:17.735076 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda4fa3-26e6-4b34-a6c0-a8675491900a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:17.735916 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda4fa3-26e6-4b34-a6c0-a8675491900a None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:17.736202 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda4fa3-26e6-4b34-a6c0-a8675491900a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:17.736481 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda4fa3-26e6-4b34-a6c0-a8675491900a None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:17.737245 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda4fa3-26e6-4b34-a6c0-a8675491900a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:17.739371 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda4fa3-26e6-4b34-a6c0-a8675491900a None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:17.766104 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 433/864] 10.222.0.32 () {60 vars in 1141 bytes} [Wed Jun 1 04:14:17 2022] POST /identity/v3/services => generated 251 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:14:17.848228 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95be812-7a84-4f15-9987-f0e3937a75ab None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:17.899789 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9dcc5-88a2-473e-92f8-49cfa7025c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:17.900398 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9dcc5-88a2-473e-92f8-49cfa7025c2c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:17.900681 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9dcc5-88a2-473e-92f8-49cfa7025c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:17.900959 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9dcc5-88a2-473e-92f8-49cfa7025c2c None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:17.901760 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a9dcc5-88a2-473e-92f8-49cfa7025c2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:17.902119 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a9dcc5-88a2-473e-92f8-49cfa7025c2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:17.903569 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a9dcc5-88a2-473e-92f8-49cfa7025c2c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:17.919390 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 432/865] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:17.925247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda4fa3-26e6-4b34-a6c0-a8675491900a None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:17.967919 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:18.045625 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda4fa3-26e6-4b34-a6c0-a8675491900a None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:18.082197 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81af588-b121-4f39-a7c1-266fa64ee523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:18.083277 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81af588-b121-4f39-a7c1-266fa64ee523 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:18.083711 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81af588-b121-4f39-a7c1-266fa64ee523 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:18.084135 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81af588-b121-4f39-a7c1-266fa64ee523 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:18.091424 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81af588-b121-4f39-a7c1-266fa64ee523 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:18.093189 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81af588-b121-4f39-a7c1-266fa64ee523 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:18.108387 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-f81af588-b121-4f39-a7c1-266fa64ee523 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:14:18.108387 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:18.108387 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:18.108387 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:18.108387 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:18.108387 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:18.108387 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:18.108387 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:18.108387 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:18.108387 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:18.108387 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:18.108387 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:18.108387 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 04:14:18.108387 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 04:14:18.108387 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 04:14:18.109377 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 04:14:18.109377 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:18.109377 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:18.109377 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:18.109377 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:18.109377 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:18.109377 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:18.109377 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:18.109377 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:18.109377 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:18.109377 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:18.109377 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:18.109377 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:18.109377 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:18.109377 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:18.109377 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:18.109377 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:18.110302 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 04:14:18.110302 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 04:14:18.110302 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 04:14:18.110302 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 04:14:18.110302 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 04:14:18.110302 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 04:14:18.110302 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:14:18.110302 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:18.110733 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 434/866] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:14:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:18.116831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9dcc5-88a2-473e-92f8-49cfa7025c2c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:18.178740 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:18.234033 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9dcc5-88a2-473e-92f8-49cfa7025c2c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:18.273166 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80173d5b-265b-4572-8109-0164cba6dd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:18.273959 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80173d5b-265b-4572-8109-0164cba6dd9c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:18.274358 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80173d5b-265b-4572-8109-0164cba6dd9c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:18.274700 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80173d5b-265b-4572-8109-0164cba6dd9c None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:18.275654 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80173d5b-265b-4572-8109-0164cba6dd9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:18.276074 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80173d5b-265b-4572-8109-0164cba6dd9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:18.277525 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80173d5b-265b-4572-8109-0164cba6dd9c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:18.291251 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 433/867] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Jun 1 04:14:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:18.296784 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81af588-b121-4f39-a7c1-266fa64ee523 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:18.396434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:18.405219 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81af588-b121-4f39-a7c1-266fa64ee523 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:18.444020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb3594-d603-4b50-8e25-21394e8f106e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:18.444589 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb3594-d603-4b50-8e25-21394e8f106e None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:18.444870 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb3594-d603-4b50-8e25-21394e8f106e None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:18.445144 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb3594-d603-4b50-8e25-21394e8f106e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:18.445966 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb3594-d603-4b50-8e25-21394e8f106e None admin] RBAC: Adding query filter params (role.id=76fc054ad9544460a7be1e2010c23642, scope.project.id=31d68f64d21647688074554062952074, user.id=413c6613b4ec4e53aeeaf6828c807273) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:18.446298 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb3594-d603-4b50-8e25-21394e8f106e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:18.447728 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb3594-d603-4b50-8e25-21394e8f106e None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:18.454359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 435/868] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:14:18 2022] GET /identity/v3/role_assignments?user.id=413c6613b4ec4e53aeeaf6828c807273&scope.project.id=31d68f64d21647688074554062952074&role.id=76fc054ad9544460a7be1e2010c23642 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:19.570998 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b915f-f172-4a46-ac63-22f5d222c26e None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:19.571555 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b915f-f172-4a46-ac63-22f5d222c26e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:19.571555 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b915f-f172-4a46-ac63-22f5d222c26e None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:19.573215 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 434/869] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:14:19.578700 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35deffd2-b858-48d1-a091-07d89346a7de None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:19.579129 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35deffd2-b858-48d1-a091-07d89346a7de None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:19.579327 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35deffd2-b858-48d1-a091-07d89346a7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:19.604154 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-35deffd2-b858-48d1-a091-07d89346a7de None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:19.605358 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-35deffd2-b858-48d1-a091-07d89346a7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:19.759414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 436/870] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:19 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 04:14:19.782450 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b915f-f172-4a46-ac63-22f5d222c26e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:19.987741 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b915f-f172-4a46-ac63-22f5d222c26e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:20.005320 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:20.051532 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139da00-a9a2-41ae-9d7d-7cb821254a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:20.052951 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139da00-a9a2-41ae-9d7d-7cb821254a72 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:20.053452 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139da00-a9a2-41ae-9d7d-7cb821254a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:20.053954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139da00-a9a2-41ae-9d7d-7cb821254a72 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:20.055336 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139da00-a9a2-41ae-9d7d-7cb821254a72 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:20.058046 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139da00-a9a2-41ae-9d7d-7cb821254a72 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:20.075931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-d139da00-a9a2-41ae-9d7d-7cb821254a72 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 01 04:14:20.075931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:20.075931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 04:14:20.075931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 04:14:20.075931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 04:14:20.075931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 04:14:20.075931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 04:14:20.075931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:20.075931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 01 04:14:20.075931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:20.075931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 04:14:20.075931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:20.075931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:20.075931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:20.075931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:20.075931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:20.076933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:20.076933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:20.076933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:20.076933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:20.076933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:20.076933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:20.076933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:20.076933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 04:14:20.076933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 04:14:20.076933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 04:14:20.076933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 04:14:20.076933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:20.076933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:20.076933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:20.076933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:20.076933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:20.077768 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:20.077768 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:20.077768 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:20.077768 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:20.077768 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:20.077768 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:20.077768 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:20.077768 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:20.077768 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:20.077768 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:20.077768 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:20.077768 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 04:14:20.077768 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:20.077768 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 01 04:14:20.077768 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:20.077768 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 435/871] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Jun 1 04:14:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:20.084171 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35deffd2-b858-48d1-a091-07d89346a7de None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:20.130584 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395eb05-8523-406c-a326-d60f0cd80020 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:20.130873 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395eb05-8523-406c-a326-d60f0cd80020 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:20.131160 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395eb05-8523-406c-a326-d60f0cd80020 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:20.132842 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 436/872] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:14:20.138487 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6b404-db3a-4380-b989-9e027eadc016 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:20.138857 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6b404-db3a-4380-b989-9e027eadc016 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:20.139215 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6b404-db3a-4380-b989-9e027eadc016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:20.172587 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-f8c6b404-db3a-4380-b989-9e027eadc016 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:20.174134 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f8c6b404-db3a-4380-b989-9e027eadc016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:20.192669 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:20.210880 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35deffd2-b858-48d1-a091-07d89346a7de None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:20.249052 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0e9cf-53c6-454a-8825-6f4a03a216ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:20.250105 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0e9cf-53c6-454a-8825-6f4a03a216ac None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:20.250587 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0e9cf-53c6-454a-8825-6f4a03a216ac None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:20.251056 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0e9cf-53c6-454a-8825-6f4a03a216ac None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:20.251936 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f0e9cf-53c6-454a-8825-6f4a03a216ac None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:20.252519 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f0e9cf-53c6-454a-8825-6f4a03a216ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:20.254172 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f0e9cf-53c6-454a-8825-6f4a03a216ac None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:20.257169 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 437/873] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:20 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 04:14:20.258869 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce283a-9574-4138-b60b-302e5751a68d None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:20.259169 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce283a-9574-4138-b60b-302e5751a68d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:20.259453 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce283a-9574-4138-b60b-302e5751a68d None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:20.260979 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 438/874] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:14:20.261405 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 437/875] 10.222.0.32 () {56 vars in 1126 bytes} [Wed Jun 1 04:14:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:20.267831 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b2c27-59bb-4315-9141-20d247fced34 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:20.268131 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b2c27-59bb-4315-9141-20d247fced34 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:20.268420 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b2c27-59bb-4315-9141-20d247fced34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:20.271164 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce283a-9574-4138-b60b-302e5751a68d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:20.288153 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-c65b2c27-59bb-4315-9141-20d247fced34 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:20.289437 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c65b2c27-59bb-4315-9141-20d247fced34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:20.367539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 438/876] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:20 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 04:14:20.368805 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b2c27-59bb-4315-9141-20d247fced34 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:20.411416 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce283a-9574-4138-b60b-302e5751a68d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:20.413155 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:20.451028 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4796afc-aa5e-45a5-a290-165d7c31be5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:20.451705 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4796afc-aa5e-45a5-a290-165d7c31be5b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:20.451999 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4796afc-aa5e-45a5-a290-165d7c31be5b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:20.452290 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4796afc-aa5e-45a5-a290-165d7c31be5b None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:20.453015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4796afc-aa5e-45a5-a290-165d7c31be5b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:20.453329 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4796afc-aa5e-45a5-a290-165d7c31be5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:20.454771 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4796afc-aa5e-45a5-a290-165d7c31be5b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:20.460259 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 439/877] 10.222.0.32 () {56 vars in 1126 bytes} [Wed Jun 1 04:14:20 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:20.461125 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4796afc-aa5e-45a5-a290-165d7c31be5b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:20.480325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:20.514635 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b2c27-59bb-4315-9141-20d247fced34 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:20.571193 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401c085-afaa-4115-b120-552bf44a50fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:20.572371 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401c085-afaa-4115-b120-552bf44a50fe None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:20.572840 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401c085-afaa-4115-b120-552bf44a50fe None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:20.573263 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401c085-afaa-4115-b120-552bf44a50fe None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:20.590777 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401c085-afaa-4115-b120-552bf44a50fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:14:20.602769 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4796afc-aa5e-45a5-a290-165d7c31be5b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:20.603977 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-4401c085-afaa-4115-b120-552bf44a50fe None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 01 04:14:20.603977 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:20.603977 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:20.603977 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:20.603977 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:20.603977 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:20.603977 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:20.603977 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:20.603977 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:20.603977 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:20.603977 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:20.603977 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:20.603977 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:14:20.603977 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:14:20.603977 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:14:20.603977 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:14:20.605066 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:14:20.605066 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:14:20.605066 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:14:20.605066 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:14:20.605066 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:20.605066 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:20.605066 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:20.605066 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:20.605066 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:20.605066 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:20.605066 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:20.605066 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:20.605066 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:20.605066 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:20.605066 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:20.605066 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:20.606123 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:20.606123 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:20.606123 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:20.606123 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:20.606123 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:14:20.606123 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:14:20.606123 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:14:20.606123 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:14:20.606123 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:14:20.606123 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:14:20.606123 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 01 04:14:20.606123 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:20.615357 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 439/878] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Jun 1 04:14:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:20.618005 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401c085-afaa-4115-b120-552bf44a50fe None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:20.655355 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca7926-d40c-4945-8881-51528eb45680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:20.656821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca7926-d40c-4945-8881-51528eb45680 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:20.657285 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca7926-d40c-4945-8881-51528eb45680 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:20.657658 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca7926-d40c-4945-8881-51528eb45680 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:20.658355 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca7926-d40c-4945-8881-51528eb45680 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:20.660720 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca7926-d40c-4945-8881-51528eb45680 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:20.678344 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-75ca7926-d40c-4945-8881-51528eb45680 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 01 04:14:20.678344 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:20.678344 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 04:14:20.678344 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 04:14:20.678344 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 04:14:20.678344 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 04:14:20.678344 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 04:14:20.678344 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:20.678344 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 01 04:14:20.678344 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:20.678344 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 04:14:20.678344 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:20.678344 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:20.678344 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:20.678344 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:20.678344 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:20.678344 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:20.680632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:20.680632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:20.680632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:20.680632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:20.680632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:20.680632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:20.680632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 04:14:20.680632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 04:14:20.680632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 04:14:20.680632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 04:14:20.680632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:20.680632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:20.680632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:20.680632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:20.680632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:20.680632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:20.682809 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:20.682809 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:20.682809 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:20.682809 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:20.682809 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:20.682809 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:20.682809 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:20.682809 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:20.682809 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:20.682809 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:20.682809 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 04:14:20.682809 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:20.682809 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 01 04:14:20.682809 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:20.682809 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 440/879] 10.222.0.32 () {56 vars in 1114 bytes} [Wed Jun 1 04:14:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:20.685807 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca7926-d40c-4945-8881-51528eb45680 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:20.736136 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:20.782852 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401c085-afaa-4115-b120-552bf44a50fe None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:20.821668 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5705c8-1a18-412c-bfd1-43d5d8d9565a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:20.822385 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5705c8-1a18-412c-bfd1-43d5d8d9565a None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:20.822673 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5705c8-1a18-412c-bfd1-43d5d8d9565a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:20.822954 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5705c8-1a18-412c-bfd1-43d5d8d9565a None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:20.823709 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5705c8-1a18-412c-bfd1-43d5d8d9565a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:20.824020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5705c8-1a18-412c-bfd1-43d5d8d9565a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:20.825004 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca7926-d40c-4945-8881-51528eb45680 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:20.825462 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5705c8-1a18-412c-bfd1-43d5d8d9565a None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:20.839311 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 440/880] 10.222.0.32 () {56 vars in 1115 bytes} [Wed Jun 1 04:14:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:20.841310 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5705c8-1a18-412c-bfd1-43d5d8d9565a None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:20.846849 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:20.867846 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990489bb-7a00-4dae-b123-22436d2fa5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:20.868534 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990489bb-7a00-4dae-b123-22436d2fa5b9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:20.868824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990489bb-7a00-4dae-b123-22436d2fa5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:20.869149 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990489bb-7a00-4dae-b123-22436d2fa5b9 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:20.869806 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990489bb-7a00-4dae-b123-22436d2fa5b9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:20.870161 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990489bb-7a00-4dae-b123-22436d2fa5b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:20.871604 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990489bb-7a00-4dae-b123-22436d2fa5b9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:20.882156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 441/881] 10.222.0.32 () {56 vars in 1114 bytes} [Wed Jun 1 04:14:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:20.883821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990489bb-7a00-4dae-b123-22436d2fa5b9 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:20.977439 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5705c8-1a18-412c-bfd1-43d5d8d9565a None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:21.017867 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8ad3e-d91f-4feb-a084-786d472a8f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:21.018702 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8ad3e-d91f-4feb-a084-786d472a8f36 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:21.018984 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8ad3e-d91f-4feb-a084-786d472a8f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:21.019258 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8ad3e-d91f-4feb-a084-786d472a8f36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:21.020440 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:21.028879 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990489bb-7a00-4dae-b123-22436d2fa5b9 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:21.034445 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8ad3e-d91f-4feb-a084-786d472a8f36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:21.036523 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8ad3e-d91f-4feb-a084-786d472a8f36 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:21.056789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-b2f8ad3e-d91f-4feb-a084-786d472a8f36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:21.056789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:21.056789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:21.056789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:21.056789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:21.056789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:21.056789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:21.056789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:21.056789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:21.056789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:21.056789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:21.056789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:21.056789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:14:21.056789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:14:21.056789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:14:21.057752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:14:21.057752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:21.057752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:21.057752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:21.057752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:21.057752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:21.057752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:21.057752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:21.057752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:21.057752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:21.057752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:21.057752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:21.057752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:21.057752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:21.057752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:21.057752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:21.057752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:21.058993 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:14:21.058993 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:14:21.058993 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:21.058993 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:21.058993 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 441/882] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:14:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:14:21.059631 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423968e-847c-4521-bdc3-dfef751cb736 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:21.059914 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423968e-847c-4521-bdc3-dfef751cb736 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:21.060191 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423968e-847c-4521-bdc3-dfef751cb736 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:21.061646 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 442/883] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:14:21.066430 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423968e-847c-4521-bdc3-dfef751cb736 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:21.066975 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74527a8-fa33-4383-9c7b-47f4cbbedd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:21.067650 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74527a8-fa33-4383-9c7b-47f4cbbedd24 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:21.068199 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74527a8-fa33-4383-9c7b-47f4cbbedd24 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:21.068474 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74527a8-fa33-4383-9c7b-47f4cbbedd24 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:21.069183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74527a8-fa33-4383-9c7b-47f4cbbedd24 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:21.069599 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74527a8-fa33-4383-9c7b-47f4cbbedd24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:21.071122 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74527a8-fa33-4383-9c7b-47f4cbbedd24 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:21.076556 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 442/884] 10.222.0.32 () {56 vars in 1114 bytes} [Wed Jun 1 04:14:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:21.077842 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990e236-f8ab-4ea9-8281-6739cb129a30 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:21.078234 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990e236-f8ab-4ea9-8281-6739cb129a30 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:21.078422 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990e236-f8ab-4ea9-8281-6739cb129a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:21.095404 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b990e236-f8ab-4ea9-8281-6739cb129a30 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:21.096599 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b990e236-f8ab-4ea9-8281-6739cb129a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:21.140897 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:21.195093 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423968e-847c-4521-bdc3-dfef751cb736 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:21.198337 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 443/885] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:21 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:14:21.199063 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990e236-f8ab-4ea9-8281-6739cb129a30 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:21.232005 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce48d29-5245-4d46-96a8-72c93f8c605d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:21.232672 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce48d29-5245-4d46-96a8-72c93f8c605d None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:21.232959 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce48d29-5245-4d46-96a8-72c93f8c605d None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:21.233237 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce48d29-5245-4d46-96a8-72c93f8c605d None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:21.233957 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce48d29-5245-4d46-96a8-72c93f8c605d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:21.234316 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce48d29-5245-4d46-96a8-72c93f8c605d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:21.235703 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce48d29-5245-4d46-96a8-72c93f8c605d None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:21.253154 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 443/886] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:21.253154 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce48d29-5245-4d46-96a8-72c93f8c605d None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:21.305708 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:21.321876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990e236-f8ab-4ea9-8281-6739cb129a30 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:21.359872 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbd3bb-922f-4eee-98a7-f839c7396eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:21.360697 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbd3bb-922f-4eee-98a7-f839c7396eda None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:21.360808 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbd3bb-922f-4eee-98a7-f839c7396eda None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:21.361077 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbd3bb-922f-4eee-98a7-f839c7396eda None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:21.361865 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecbd3bb-922f-4eee-98a7-f839c7396eda None admin] RBAC: Adding query filter params (interface=public, service_id=a8745e8e2c5a4c3ca6bc385e3ce58815, region_id=RegionOne) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:21.362210 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecbd3bb-922f-4eee-98a7-f839c7396eda None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:21.364140 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecbd3bb-922f-4eee-98a7-f839c7396eda None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:21.368146 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce48d29-5245-4d46-96a8-72c93f8c605d None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:21.374025 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 444/887] 10.222.0.32 () {56 vars in 1251 bytes} [Wed Jun 1 04:14:21 2022] GET /identity/v3/endpoints?service_id=a8745e8e2c5a4c3ca6bc385e3ce58815&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:21.374025 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbd3bb-922f-4eee-98a7-f839c7396eda None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:21.392046 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:21.412628 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755eba5-4baa-41cf-9587-6912eab38a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:21.413522 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755eba5-4baa-41cf-9587-6912eab38a0e None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:21.413880 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755eba5-4baa-41cf-9587-6912eab38a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:21.414280 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755eba5-4baa-41cf-9587-6912eab38a0e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:21.415026 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755eba5-4baa-41cf-9587-6912eab38a0e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:21.416494 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755eba5-4baa-41cf-9587-6912eab38a0e None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:21.429310 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-b755eba5-4baa-41cf-9587-6912eab38a0e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 01 04:14:21.429310 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:21.429310 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 04:14:21.429310 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 04:14:21.429310 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 04:14:21.429310 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 04:14:21.429310 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 04:14:21.429310 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:21.429310 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 01 04:14:21.429310 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:21.429310 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 04:14:21.429310 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:21.429310 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:21.429310 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:21.429310 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:21.429310 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:21.429310 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:21.430598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:21.430598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:21.430598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:21.430598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:21.430598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:21.430598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:21.430598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 04:14:21.430598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 04:14:21.430598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 04:14:21.430598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 04:14:21.430598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:21.430598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:21.430598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:21.430598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:21.430598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:21.430598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:21.431615 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:21.431615 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:21.431615 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:21.431615 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:21.431615 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:21.431615 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:21.431615 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:21.431615 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:21.431615 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:21.431615 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:21.431615 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 04:14:21.431615 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:21.431615 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 01 04:14:21.431615 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:21.432862 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 444/888] 10.222.0.32 () {56 vars in 1126 bytes} [Wed Jun 1 04:14:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:21.433671 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755eba5-4baa-41cf-9587-6912eab38a0e None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:21.494322 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbd3bb-922f-4eee-98a7-f839c7396eda None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:21.532299 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f052d-4700-4594-b6f7-b7a9eddd8a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:21.533210 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f052d-4700-4594-b6f7-b7a9eddd8a81 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:21.533593 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f052d-4700-4594-b6f7-b7a9eddd8a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:21.533871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f052d-4700-4594-b6f7-b7a9eddd8a81 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:21.541710 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755eba5-4baa-41cf-9587-6912eab38a0e None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:21.542430 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f052d-4700-4594-b6f7-b7a9eddd8a81 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:21.544098 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f052d-4700-4594-b6f7-b7a9eddd8a81 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:21.561876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-ff0f052d-4700-4594-b6f7-b7a9eddd8a81 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 01 04:14:21.561876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:21.561876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:21.561876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:21.561876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:21.561876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:21.561876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:21.561876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:21.561876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:21.561876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:21.561876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:21.561876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:21.561876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 04:14:21.561876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 04:14:21.561876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 04:14:21.561876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 04:14:21.563069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:21.563069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:21.563069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 04:14:21.563069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:14:21.563069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 04:14:21.563069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:14:21.563069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:21.563069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:21.563069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:21.563069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:21.563069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:21.563069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:21.563069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:21.563069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:21.563069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:21.563069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:21.563069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:21.563069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:21.564075 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:21.564075 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:21.564075 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 04:14:21.564075 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 04:14:21.564075 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 04:14:21.564075 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 04:14:21.564075 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 04:14:21.564075 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 04:14:21.564075 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 01 04:14:21.564075 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:21.564075 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 445/889] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Jun 1 04:14:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:21.564075 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f052d-4700-4594-b6f7-b7a9eddd8a81 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:21.581142 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:21.588842 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a956c6-57d4-48ad-b97b-f562478cf408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:21.589509 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a956c6-57d4-48ad-b97b-f562478cf408 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:21.590012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a956c6-57d4-48ad-b97b-f562478cf408 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:21.590116 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a956c6-57d4-48ad-b97b-f562478cf408 None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:21.591835 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a956c6-57d4-48ad-b97b-f562478cf408 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:21.594499 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a956c6-57d4-48ad-b97b-f562478cf408 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:21.606021 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 445/890] 10.222.0.32 () {56 vars in 1087 bytes} [Wed Jun 1 04:14:21 2022] GET /identity/v3/services => generated 1011 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:14:21.606021 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a956c6-57d4-48ad-b97b-f562478cf408 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:21.663323 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:21.726316 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f052d-4700-4594-b6f7-b7a9eddd8a81 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:21.731082 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a956c6-57d4-48ad-b97b-f562478cf408 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:21.777991 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3855084-1c99-4d09-b00c-425177be5640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:21.779107 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3855084-1c99-4d09-b00c-425177be5640 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:21.779735 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3855084-1c99-4d09-b00c-425177be5640 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:21.780202 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3855084-1c99-4d09-b00c-425177be5640 None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:21.781121 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64715a09-b5da-4cce-9e69-865979088262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:21.781595 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3855084-1c99-4d09-b00c-425177be5640 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:21.781943 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64715a09-b5da-4cce-9e69-865979088262 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:21.782304 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3855084-1c99-4d09-b00c-425177be5640 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:21.782422 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64715a09-b5da-4cce-9e69-865979088262 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:21.782652 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64715a09-b5da-4cce-9e69-865979088262 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:21.783459 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64715a09-b5da-4cce-9e69-865979088262 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:21.783877 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64715a09-b5da-4cce-9e69-865979088262 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:21.784667 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3855084-1c99-4d09-b00c-425177be5640 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:21.786000 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64715a09-b5da-4cce-9e69-865979088262 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:21.793439 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 446/891] 10.222.0.32 () {56 vars in 1122 bytes} [Wed Jun 1 04:14:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:21.798968 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64715a09-b5da-4cce-9e69-865979088262 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:21.808354 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 446/892] 10.222.0.32 () {56 vars in 1149 bytes} [Wed Jun 1 04:14:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:21.814390 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3855084-1c99-4d09-b00c-425177be5640 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:21.892874 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:21.919751 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64715a09-b5da-4cce-9e69-865979088262 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:21.936620 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3855084-1c99-4d09-b00c-425177be5640 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:21.940331 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:21.961376 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0dc4f-6b93-4abf-add4-b54dadfface8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:21.962229 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0dc4f-6b93-4abf-add4-b54dadfface8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:21.962611 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0dc4f-6b93-4abf-add4-b54dadfface8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:21.962983 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0dc4f-6b93-4abf-add4-b54dadfface8 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:21.963799 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca0dc4f-6b93-4abf-add4-b54dadfface8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:21.964200 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca0dc4f-6b93-4abf-add4-b54dadfface8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:21.965667 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca0dc4f-6b93-4abf-add4-b54dadfface8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:21.971373 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 447/893] 10.222.0.32 () {56 vars in 1122 bytes} [Wed Jun 1 04:14:21 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:21.986627 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158c60a-42e1-4ceb-92e9-df2b0d7db5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:21.987576 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158c60a-42e1-4ceb-92e9-df2b0d7db5ab None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:21.988007 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158c60a-42e1-4ceb-92e9-df2b0d7db5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:21.988463 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158c60a-42e1-4ceb-92e9-df2b0d7db5ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:22.072403 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158c60a-42e1-4ceb-92e9-df2b0d7db5ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:22.074148 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158c60a-42e1-4ceb-92e9-df2b0d7db5ab None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:22.196627 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 447/894] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:14:21 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 01 04:14:22.202681 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0dc4f-6b93-4abf-add4-b54dadfface8 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:22.308389 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0dc4f-6b93-4abf-add4-b54dadfface8 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:22.345222 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202115cb-358a-4717-ab7a-ab53f7e90733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:22.346129 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202115cb-358a-4717-ab7a-ab53f7e90733 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:22.346509 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202115cb-358a-4717-ab7a-ab53f7e90733 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:22.346877 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202115cb-358a-4717-ab7a-ab53f7e90733 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:22.356214 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:22.362694 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202115cb-358a-4717-ab7a-ab53f7e90733 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:22.365107 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202115cb-358a-4717-ab7a-ab53f7e90733 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:22.385156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-202115cb-358a-4717-ab7a-ab53f7e90733 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:22.385156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:22.385156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:22.385156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:22.385156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:22.385156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:22.385156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:22.385156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:22.385156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:22.385156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:22.385156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:22.385156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:22.385156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:14:22.385156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:14:22.385156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:14:22.386283 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:14:22.386283 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:22.386283 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:22.386283 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:22.386283 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:22.386283 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:22.386283 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:22.386283 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:22.386283 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:22.386283 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:22.386283 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:22.386283 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:22.386283 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:22.386283 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:22.386283 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:22.386283 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:22.386283 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:22.387340 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:14:22.387340 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:14:22.387340 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:22.387340 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:22.393687 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 448/895] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:14:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:22.395279 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158c60a-42e1-4ceb-92e9-df2b0d7db5ab None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:22.414909 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:22.505046 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158c60a-42e1-4ceb-92e9-df2b0d7db5ab None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:22.550721 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a85c8f-11ce-4427-9bb0-2ad107a69277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:22.551992 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a85c8f-11ce-4427-9bb0-2ad107a69277 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:22.552280 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a85c8f-11ce-4427-9bb0-2ad107a69277 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:22.552561 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a85c8f-11ce-4427-9bb0-2ad107a69277 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:22.553291 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a85c8f-11ce-4427-9bb0-2ad107a69277 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:22.553597 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a85c8f-11ce-4427-9bb0-2ad107a69277 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:22.555030 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a85c8f-11ce-4427-9bb0-2ad107a69277 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:22.569465 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 448/896] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:22.574949 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202115cb-358a-4717-ab7a-ab53f7e90733 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:22.700356 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202115cb-358a-4717-ab7a-ab53f7e90733 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:22.737931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452adc81-54a5-4c09-af1f-3989e27022f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:22.739326 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452adc81-54a5-4c09-af1f-3989e27022f6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:22.740490 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452adc81-54a5-4c09-af1f-3989e27022f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:22.740490 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452adc81-54a5-4c09-af1f-3989e27022f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:22.748369 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452adc81-54a5-4c09-af1f-3989e27022f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:22.749868 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452adc81-54a5-4c09-af1f-3989e27022f6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:22.765375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-452adc81-54a5-4c09-af1f-3989e27022f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:14:22.765375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:22.765375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:22.765375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:22.765375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:22.765375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:22.765375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:22.765375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:22.765375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:22.765375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:22.765375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:22.765375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:22.765375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 04:14:22.765375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 04:14:22.765375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 04:14:22.766363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 04:14:22.766363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:22.766363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:22.766363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:22.766363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:22.766363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:22.766363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:22.766363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:22.766363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:22.766363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:22.766363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:22.766363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:22.766363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:22.766363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:22.766363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:22.766363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:22.766363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:22.767256 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 04:14:22.767256 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 04:14:22.767256 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 04:14:22.767256 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 04:14:22.767256 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 04:14:22.767256 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 04:14:22.767256 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:14:22.767256 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:22.767256 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 449/897] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:14:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:14:22.775161 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a85c8f-11ce-4427-9bb0-2ad107a69277 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:22.847159 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:22.889180 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a85c8f-11ce-4427-9bb0-2ad107a69277 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:22.913347 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38c412-7ddf-4cf0-ae02-dd8e1c85ec5c None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:22.913692 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38c412-7ddf-4cf0-ae02-dd8e1c85ec5c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:22.913952 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38c412-7ddf-4cf0-ae02-dd8e1c85ec5c None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:22.918609 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 450/898] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:14:22.922443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b0d2f-f0f0-4689-8817-ccb747c73118 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:22.922834 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b0d2f-f0f0-4689-8817-ccb747c73118 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:22.923118 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b0d2f-f0f0-4689-8817-ccb747c73118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:22.931361 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6fa96-8b38-4662-aac1-803d1833b3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:22.933012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6fa96-8b38-4662-aac1-803d1833b3ea None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:22.933367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6fa96-8b38-4662-aac1-803d1833b3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:22.933652 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6fa96-8b38-4662-aac1-803d1833b3ea None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:22.934544 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6fa96-8b38-4662-aac1-803d1833b3ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:22.934859 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6fa96-8b38-4662-aac1-803d1833b3ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:22.936302 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6fa96-8b38-4662-aac1-803d1833b3ea None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:22.945296 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-838b0d2f-f0f0-4689-8817-ccb747c73118 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:22.946557 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-838b0d2f-f0f0-4689-8817-ccb747c73118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:22.957889 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 449/899] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Jun 1 04:14:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:22.964627 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6fa96-8b38-4662-aac1-803d1833b3ea None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:23.006006 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:23.028975 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 451/900] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:22 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 04:14:23.052419 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b0d2f-f0f0-4689-8817-ccb747c73118 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:23.082462 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6fa96-8b38-4662-aac1-803d1833b3ea None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:23.109769 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:23.125467 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf75099-56a6-4a50-9068-34f149c42327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:23.126322 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf75099-56a6-4a50-9068-34f149c42327 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:23.126707 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf75099-56a6-4a50-9068-34f149c42327 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:23.127064 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf75099-56a6-4a50-9068-34f149c42327 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:23.128044 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf75099-56a6-4a50-9068-34f149c42327 None admin] RBAC: Adding query filter params (role.id=0f6437212f954ee1a3bdb42ffc3458e7, scope.project.id=31d68f64d21647688074554062952074, user.id=3fa2ad34164a4631adf76fbd042679ba) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:23.128453 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf75099-56a6-4a50-9068-34f149c42327 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:23.130087 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf75099-56a6-4a50-9068-34f149c42327 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:23.142006 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 450/901] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:14:22 2022] GET /identity/v3/role_assignments?user.id=3fa2ad34164a4631adf76fbd042679ba&scope.project.id=31d68f64d21647688074554062952074&role.id=0f6437212f954ee1a3bdb42ffc3458e7 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:23.200295 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b0d2f-f0f0-4689-8817-ccb747c73118 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:23.245602 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc19a7-59e2-4952-a4ee-7d0591270048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:23.246650 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc19a7-59e2-4952-a4ee-7d0591270048 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:23.247132 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc19a7-59e2-4952-a4ee-7d0591270048 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:23.247653 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc19a7-59e2-4952-a4ee-7d0591270048 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:23.248610 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc19a7-59e2-4952-a4ee-7d0591270048 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:23.250271 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc19a7-59e2-4952-a4ee-7d0591270048 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:23.270625 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 452/902] 10.222.0.32 () {60 vars in 1141 bytes} [Wed Jun 1 04:14:23 2022] POST /identity/v3/services => generated 269 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:14:24.117087 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4ae6d-8ad4-4522-b1a6-4301fffd05e0 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:24.117614 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4ae6d-8ad4-4522-b1a6-4301fffd05e0 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:24.117692 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4ae6d-8ad4-4522-b1a6-4301fffd05e0 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:24.119307 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 451/903] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:14:24.124612 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f9455-0736-42c3-ab01-a3105fa03823 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:24.125046 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f9455-0736-42c3-ab01-a3105fa03823 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:24.125141 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f9455-0736-42c3-ab01-a3105fa03823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:24.142076 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-200f9455-0736-42c3-ab01-a3105fa03823 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:24.143270 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-200f9455-0736-42c3-ab01-a3105fa03823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:24.190613 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:24.229603 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 453/904] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:14:24.251519 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4ae6d-8ad4-4522-b1a6-4301fffd05e0 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:24.372501 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4ae6d-8ad4-4522-b1a6-4301fffd05e0 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:24.415574 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8a360-26ad-41fb-bd2e-ef8d8b7e466a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:24.416517 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8a360-26ad-41fb-bd2e-ef8d8b7e466a None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:24.416859 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8a360-26ad-41fb-bd2e-ef8d8b7e466a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:24.417197 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8a360-26ad-41fb-bd2e-ef8d8b7e466a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:24.417994 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8a360-26ad-41fb-bd2e-ef8d8b7e466a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:24.419635 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8a360-26ad-41fb-bd2e-ef8d8b7e466a None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:24.427249 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae10c16-6d3f-462d-ab32-085565e48713 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:24.427540 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae10c16-6d3f-462d-ab32-085565e48713 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:24.427822 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae10c16-6d3f-462d-ab32-085565e48713 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:24.429472 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 454/905] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:14:24.434938 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6ac7b-134a-423c-8832-fde7cc596cc9 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:24.435085 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-5be8a360-26ad-41fb-bd2e-ef8d8b7e466a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 01 04:14:24.435085 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:24.435085 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 04:14:24.435085 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 04:14:24.435085 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 04:14:24.435085 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 04:14:24.435085 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 04:14:24.435085 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:24.435085 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 01 04:14:24.435085 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:24.435085 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 04:14:24.435085 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:24.435085 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:24.435085 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:24.435085 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:24.435085 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:24.435085 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:24.436017 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:24.436017 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:24.436017 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:24.436017 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:24.436017 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:24.436017 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:24.436017 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 04:14:24.436017 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 04:14:24.436017 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 04:14:24.436017 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 04:14:24.436017 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:24.436017 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:24.436017 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:24.436017 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:24.436017 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:24.436017 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:24.436853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:24.436853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:24.436853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:24.436853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:24.436853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:24.436853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:24.436853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:24.436853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:24.436853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:24.436853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:24.436853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 04:14:24.436853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:24.436853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 01 04:14:24.436853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:24.437586 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6ac7b-134a-423c-8832-fde7cc596cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:24.437586 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6ac7b-134a-423c-8832-fde7cc596cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:24.437725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 452/906] 10.222.0.32 () {56 vars in 1114 bytes} [Wed Jun 1 04:14:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:24.442366 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8a360-26ad-41fb-bd2e-ef8d8b7e466a None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:24.456062 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e2b6ac7b-134a-423c-8832-fde7cc596cc9 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:24.457805 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e2b6ac7b-134a-423c-8832-fde7cc596cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:24.509461 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:24.542318 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 455/907] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:14:24.562422 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6ac7b-134a-423c-8832-fde7cc596cc9 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:24.576848 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8a360-26ad-41fb-bd2e-ef8d8b7e466a None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:24.621625 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e71cf-4148-4eba-b4a9-28ee52be2cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:24.622326 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e71cf-4148-4eba-b4a9-28ee52be2cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:24.622695 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e71cf-4148-4eba-b4a9-28ee52be2cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:24.623483 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e71cf-4148-4eba-b4a9-28ee52be2cc9 None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:24.624200 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e71cf-4148-4eba-b4a9-28ee52be2cc9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:24.624503 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e71cf-4148-4eba-b4a9-28ee52be2cc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:24.626228 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e71cf-4148-4eba-b4a9-28ee52be2cc9 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:24.638207 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 453/908] 10.222.0.32 () {56 vars in 1114 bytes} [Wed Jun 1 04:14:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:24.639151 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e71cf-4148-4eba-b4a9-28ee52be2cc9 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:24.680144 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:24.685177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6ac7b-134a-423c-8832-fde7cc596cc9 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:24.724364 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345fcec-a059-4eb0-9102-e942c8d284e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:24.725046 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345fcec-a059-4eb0-9102-e942c8d284e6 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:24.725333 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345fcec-a059-4eb0-9102-e942c8d284e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:24.725613 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345fcec-a059-4eb0-9102-e942c8d284e6 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:24.726377 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c345fcec-a059-4eb0-9102-e942c8d284e6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:24.727774 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c345fcec-a059-4eb0-9102-e942c8d284e6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:24.747112 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 456/909] 10.222.0.32 () {60 vars in 1141 bytes} [Wed Jun 1 04:14:24 2022] POST /identity/v3/services => generated 241 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:14:24.795258 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e71cf-4148-4eba-b4a9-28ee52be2cc9 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:24.826624 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:24.877664 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8db37-6cb4-4655-9727-cf0e7d0f1482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:24.878867 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8db37-6cb4-4655-9727-cf0e7d0f1482 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:24.879364 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8db37-6cb4-4655-9727-cf0e7d0f1482 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:24.879844 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8db37-6cb4-4655-9727-cf0e7d0f1482 None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:24.881191 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8db37-6cb4-4655-9727-cf0e7d0f1482 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:24.881717 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8db37-6cb4-4655-9727-cf0e7d0f1482 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:24.884220 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8db37-6cb4-4655-9727-cf0e7d0f1482 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:24.894214 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 454/910] 10.222.0.32 () {56 vars in 1114 bytes} [Wed Jun 1 04:14:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:24.899869 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345fcec-a059-4eb0-9102-e942c8d284e6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:25.021341 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345fcec-a059-4eb0-9102-e942c8d284e6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:25.060817 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e6214-74cb-446c-a420-6b33cb9e5dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:25.061850 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e6214-74cb-446c-a420-6b33cb9e5dc7 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:25.062403 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e6214-74cb-446c-a420-6b33cb9e5dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:25.062874 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e6214-74cb-446c-a420-6b33cb9e5dc7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:25.063837 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e6214-74cb-446c-a420-6b33cb9e5dc7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:25.065465 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e6214-74cb-446c-a420-6b33cb9e5dc7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:25.089659 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 457/911] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Jun 1 04:14:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:14:25.560179 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8a601-924c-48d5-93bd-505f8ec4f4a0 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:25.560739 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8a601-924c-48d5-93bd-505f8ec4f4a0 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:25.560739 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8a601-924c-48d5-93bd-505f8ec4f4a0 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:25.562445 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 455/912] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:14:25.568981 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a088f2-3dc8-4b18-9f55-6de2976adfc1 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:25.569481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a088f2-3dc8-4b18-9f55-6de2976adfc1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:25.569559 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a088f2-3dc8-4b18-9f55-6de2976adfc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:25.587604 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-88a088f2-3dc8-4b18-9f55-6de2976adfc1 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:25.588841 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-88a088f2-3dc8-4b18-9f55-6de2976adfc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:25.599645 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:25.677651 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 458/913] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:14:25.705106 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8a601-924c-48d5-93bd-505f8ec4f4a0 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:25.790702 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a008f-a191-4134-ae56-8b3f343ec483 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:25.790990 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a008f-a191-4134-ae56-8b3f343ec483 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:25.791309 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a008f-a191-4134-ae56-8b3f343ec483 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:25.794010 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 459/914] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:14:25.798208 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07826b55-63e6-4b9b-8cba-479145bb9d7b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:25.798507 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07826b55-63e6-4b9b-8cba-479145bb9d7b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:25.798771 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07826b55-63e6-4b9b-8cba-479145bb9d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:25.815873 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-07826b55-63e6-4b9b-8cba-479145bb9d7b None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:25.817506 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-07826b55-63e6-4b9b-8cba-479145bb9d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:25.854935 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8a601-924c-48d5-93bd-505f8ec4f4a0 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:25.893870 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 460/915] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 04:14:25.902325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4bed7-2ed6-434c-9bfc-3605e4603d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:25.903500 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4bed7-2ed6-434c-9bfc-3605e4603d20 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:25.904007 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4bed7-2ed6-434c-9bfc-3605e4603d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:25.904533 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4bed7-2ed6-434c-9bfc-3605e4603d20 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:25.917377 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07826b55-63e6-4b9b-8cba-479145bb9d7b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:25.924929 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da4bed7-2ed6-434c-9bfc-3605e4603d20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:14:25.934666 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-8da4bed7-2ed6-434c-9bfc-3605e4603d20 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 01 04:14:25.934666 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:25.934666 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:25.934666 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:25.934666 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:25.934666 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:25.934666 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:25.934666 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:25.934666 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:25.934666 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:25.934666 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:25.934666 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:25.934666 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:14:25.934666 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:14:25.934666 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:14:25.934666 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:14:25.935642 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:14:25.935642 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:14:25.935642 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:14:25.935642 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:14:25.935642 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:25.935642 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:25.935642 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:25.935642 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:25.935642 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:25.935642 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:25.935642 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:25.935642 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:25.935642 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:25.935642 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:25.935642 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:25.935642 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:25.936506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:25.936506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:25.936506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:25.936506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:25.936506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:14:25.936506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:14:25.936506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:14:25.936506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:14:25.936506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:14:25.936506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:14:25.936506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 01 04:14:25.936506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:25.939648 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 456/916] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Jun 1 04:14:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:25.948977 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4bed7-2ed6-434c-9bfc-3605e4603d20 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:25.994911 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:26.022406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:26.058483 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07826b55-63e6-4b9b-8cba-479145bb9d7b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:26.082391 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4bed7-2ed6-434c-9bfc-3605e4603d20 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:26.121621 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841001f-7462-4ba1-ad1c-0b5eb081d83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:26.122938 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841001f-7462-4ba1-ad1c-0b5eb081d83b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:26.123229 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841001f-7462-4ba1-ad1c-0b5eb081d83b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:26.123504 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841001f-7462-4ba1-ad1c-0b5eb081d83b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:26.124549 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8841001f-7462-4ba1-ad1c-0b5eb081d83b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:26.126695 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8841001f-7462-4ba1-ad1c-0b5eb081d83b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:26.134813 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf27d7-7dfd-41f6-a6fb-844cc95030f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:26.135843 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf27d7-7dfd-41f6-a6fb-844cc95030f5 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:26.136352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf27d7-7dfd-41f6-a6fb-844cc95030f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:26.136841 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf27d7-7dfd-41f6-a6fb-844cc95030f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:26.137793 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf27d7-7dfd-41f6-a6fb-844cc95030f5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:26.138322 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf27d7-7dfd-41f6-a6fb-844cc95030f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:26.139984 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf27d7-7dfd-41f6-a6fb-844cc95030f5 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:26.143437 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-8841001f-7462-4ba1-ad1c-0b5eb081d83b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 01 04:14:26.143437 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:26.143437 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 04:14:26.143437 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 04:14:26.143437 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 04:14:26.143437 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 04:14:26.143437 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 04:14:26.143437 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:26.143437 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 01 04:14:26.143437 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:26.143437 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 04:14:26.143437 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:26.143437 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:26.143437 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:26.143437 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:26.143437 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:26.144475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:26.144475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:26.144475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:26.144475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:26.144475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:26.144475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:26.144475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:26.144475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 04:14:26.144475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 04:14:26.144475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 04:14:26.144475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 04:14:26.144475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:26.144475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:26.144475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:26.144475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:26.144475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:26.145356 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:26.145356 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:26.145356 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:26.145356 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:26.145356 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:26.145356 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:26.145356 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:26.145356 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:26.145356 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:26.145356 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:26.145356 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:26.145356 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 04:14:26.145356 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:26.145356 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 01 04:14:26.145356 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:26.155796 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 461/917] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Jun 1 04:14:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:14:26.155986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 457/918] 10.222.0.32 () {56 vars in 1115 bytes} [Wed Jun 1 04:14:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:26.165572 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf27d7-7dfd-41f6-a6fb-844cc95030f5 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:26.165692 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841001f-7462-4ba1-ad1c-0b5eb081d83b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:26.313882 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:26.321643 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841001f-7462-4ba1-ad1c-0b5eb081d83b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:26.328870 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf27d7-7dfd-41f6-a6fb-844cc95030f5 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:26.358554 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86366466-5a14-4363-8809-0f130ddf5d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:26.359764 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86366466-5a14-4363-8809-0f130ddf5d53 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:26.359764 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86366466-5a14-4363-8809-0f130ddf5d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:26.359764 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86366466-5a14-4363-8809-0f130ddf5d53 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:26.360478 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86366466-5a14-4363-8809-0f130ddf5d53 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:26.360788 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86366466-5a14-4363-8809-0f130ddf5d53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:26.362359 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86366466-5a14-4363-8809-0f130ddf5d53 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:26.364405 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:26.376650 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 462/919] 10.222.0.32 () {56 vars in 1126 bytes} [Wed Jun 1 04:14:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:26.379699 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86366466-5a14-4363-8809-0f130ddf5d53 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:26.398761 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bacc070-7022-4084-a344-2ac415f402af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:26.399565 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacc070-7022-4084-a344-2ac415f402af None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:26.399847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacc070-7022-4084-a344-2ac415f402af None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:26.400120 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacc070-7022-4084-a344-2ac415f402af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:26.414833 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bacc070-7022-4084-a344-2ac415f402af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:26.416305 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bacc070-7022-4084-a344-2ac415f402af None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:26.438028 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-9bacc070-7022-4084-a344-2ac415f402af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:26.438028 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:26.438028 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:26.438028 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:26.438028 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:26.438028 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:26.438028 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:26.438028 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:26.438028 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:26.438028 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:26.438028 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:26.438028 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:26.438028 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:14:26.438028 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:14:26.438028 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:14:26.439732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:14:26.439732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:26.439732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:26.439732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:26.439732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:26.439732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:26.439732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:26.439732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:26.439732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:26.439732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:26.439732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:26.439732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:26.439732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:26.439732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:26.439732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:26.439732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:26.439732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:26.442385 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:14:26.442385 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:14:26.442385 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:26.442385 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:26.445305 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 458/920] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:14:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:26.447044 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bacc070-7022-4084-a344-2ac415f402af None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:26.589744 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bacc070-7022-4084-a344-2ac415f402af None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:26.602625 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86366466-5a14-4363-8809-0f130ddf5d53 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:26.626322 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3857f-f547-4f0c-ad03-40ab6c222b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:26.627319 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3857f-f547-4f0c-ad03-40ab6c222b18 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:26.627830 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3857f-f547-4f0c-ad03-40ab6c222b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:26.628307 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3857f-f547-4f0c-ad03-40ab6c222b18 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:26.629765 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3857f-f547-4f0c-ad03-40ab6c222b18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:26.630367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3857f-f547-4f0c-ad03-40ab6c222b18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:26.632010 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3857f-f547-4f0c-ad03-40ab6c222b18 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:26.640340 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10272eb8-338f-4a65-976e-a6e1d753d380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:26.641020 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10272eb8-338f-4a65-976e-a6e1d753d380 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:26.641307 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10272eb8-338f-4a65-976e-a6e1d753d380 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:26.641587 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10272eb8-338f-4a65-976e-a6e1d753d380 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:26.642336 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10272eb8-338f-4a65-976e-a6e1d753d380 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:26.642642 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10272eb8-338f-4a65-976e-a6e1d753d380 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:26.644046 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10272eb8-338f-4a65-976e-a6e1d753d380 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:26.650847 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 463/921] 10.222.0.32 () {56 vars in 1126 bytes} [Wed Jun 1 04:14:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:26.654911 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 459/922] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:26.659521 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3857f-f547-4f0c-ad03-40ab6c222b18 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:26.660874 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10272eb8-338f-4a65-976e-a6e1d753d380 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:26.675124 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:26.742346 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:26.792599 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10272eb8-338f-4a65-976e-a6e1d753d380 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:26.792799 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3857f-f547-4f0c-ad03-40ab6c222b18 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:26.833166 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2ebc6-8326-4590-af05-a8f2850e6b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:26.834024 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2ebc6-8326-4590-af05-a8f2850e6b73 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:26.834290 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8a0c9-b552-42d6-8bd1-33aac0d5f304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:26.834410 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2ebc6-8326-4590-af05-a8f2850e6b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:26.834589 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2ebc6-8326-4590-af05-a8f2850e6b73 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:26.835625 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8a0c9-b552-42d6-8bd1-33aac0d5f304 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:26.836263 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8a0c9-b552-42d6-8bd1-33aac0d5f304 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:26.836925 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8a0c9-b552-42d6-8bd1-33aac0d5f304 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:26.838477 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed8a0c9-b552-42d6-8bd1-33aac0d5f304 None admin] RBAC: Adding query filter params (interface=public, service_id=6c007145c418464ea72f292a1d0d090b, region_id=RegionOne) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:26.838999 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed8a0c9-b552-42d6-8bd1-33aac0d5f304 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:26.840581 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed8a0c9-b552-42d6-8bd1-33aac0d5f304 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:26.842262 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2ebc6-8326-4590-af05-a8f2850e6b73 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:26.844305 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2ebc6-8326-4590-af05-a8f2850e6b73 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:26.852797 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 464/923] 10.222.0.32 () {56 vars in 1251 bytes} [Wed Jun 1 04:14:26 2022] GET /identity/v3/endpoints?service_id=6c007145c418464ea72f292a1d0d090b&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:26.854478 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8a0c9-b552-42d6-8bd1-33aac0d5f304 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:26.863712 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-4be2ebc6-8326-4590-af05-a8f2850e6b73 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 01 04:14:26.863712 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:26.863712 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:26.863712 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:26.863712 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:26.863712 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:26.863712 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:26.863712 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:26.863712 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:26.863712 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:26.863712 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:26.863712 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:26.863712 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 04:14:26.863712 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 04:14:26.863712 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 04:14:26.863712 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 04:14:26.864708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:26.864708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:26.864708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 04:14:26.864708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:14:26.864708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 04:14:26.864708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:14:26.864708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:26.864708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:26.864708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:26.864708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:26.864708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:26.864708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:26.864708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:26.864708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:26.864708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:26.864708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:26.864708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:26.864708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:26.866311 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:26.866311 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:26.866311 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 04:14:26.866311 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 04:14:26.866311 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 04:14:26.866311 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 04:14:26.866311 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 04:14:26.866311 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 04:14:26.866311 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 01 04:14:26.866311 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:26.870063 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 460/924] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Jun 1 04:14:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:26.872957 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2ebc6-8326-4590-af05-a8f2850e6b73 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:26.956654 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:27.003057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8a0c9-b552-42d6-8bd1-33aac0d5f304 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:27.008688 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2ebc6-8326-4590-af05-a8f2850e6b73 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:27.034295 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:27.051617 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791466e8-0084-4e24-9726-9c44472ee4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:27.052706 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791466e8-0084-4e24-9726-9c44472ee4bf None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:27.053171 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791466e8-0084-4e24-9726-9c44472ee4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:27.053644 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791466e8-0084-4e24-9726-9c44472ee4bf None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:27.055305 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791466e8-0084-4e24-9726-9c44472ee4bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:27.057702 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791466e8-0084-4e24-9726-9c44472ee4bf None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:27.064888 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc733e1-edde-4956-9d7d-68f86329f0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:27.065995 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc733e1-edde-4956-9d7d-68f86329f0dd None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:27.066557 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc733e1-edde-4956-9d7d-68f86329f0dd None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:27.067055 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc733e1-edde-4956-9d7d-68f86329f0dd None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:27.068395 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc733e1-edde-4956-9d7d-68f86329f0dd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:27.068929 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc733e1-edde-4956-9d7d-68f86329f0dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:27.078020 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 465/925] 10.222.0.32 () {56 vars in 1087 bytes} [Wed Jun 1 04:14:26 2022] GET /identity/v3/services => generated 1497 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 04:14:27.078239 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc733e1-edde-4956-9d7d-68f86329f0dd None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:27.111118 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 461/926] 10.222.0.32 () {56 vars in 1149 bytes} [Wed Jun 1 04:14:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:27.123538 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791466e8-0084-4e24-9726-9c44472ee4bf None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:27.260538 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791466e8-0084-4e24-9726-9c44472ee4bf None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:27.301405 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b0e0a-2891-4139-9893-44888ea3645d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:27.302652 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b0e0a-2891-4139-9893-44888ea3645d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:27.303162 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b0e0a-2891-4139-9893-44888ea3645d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:27.303649 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b0e0a-2891-4139-9893-44888ea3645d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:27.316155 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b0e0a-2891-4139-9893-44888ea3645d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:27.318244 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b0e0a-2891-4139-9893-44888ea3645d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:27.336963 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-fd1b0e0a-2891-4139-9893-44888ea3645d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:27.336963 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:27.336963 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:27.336963 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:27.336963 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:27.336963 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:27.336963 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:27.336963 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:27.336963 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:27.336963 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:27.336963 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:27.336963 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:27.336963 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:14:27.336963 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:14:27.336963 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:14:27.337933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:14:27.337933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:27.337933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:27.337933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:27.337933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:27.337933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:27.337933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:27.337933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:27.337933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:27.337933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:27.337933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:27.337933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:27.337933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:27.337933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:27.337933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:27.337933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:27.337933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:27.338870 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:14:27.338870 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:14:27.338870 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:27.338870 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:27.344812 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 466/927] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:14:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:27.346491 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc733e1-edde-4956-9d7d-68f86329f0dd None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:27.509725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc733e1-edde-4956-9d7d-68f86329f0dd None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:27.524341 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1cd8d-78a6-4ea8-bbb3-d892a194cc15 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:27.524685 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1cd8d-78a6-4ea8-bbb3-d892a194cc15 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:27.525104 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1cd8d-78a6-4ea8-bbb3-d892a194cc15 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:27.527770 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 467/928] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:14:27.537217 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe96a9e-a2f0-4b8b-af69-47bc42a26ee7 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:27.537948 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe96a9e-a2f0-4b8b-af69-47bc42a26ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:27.538517 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe96a9e-a2f0-4b8b-af69-47bc42a26ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:27.549215 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:27.560156 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186a2cd-0c04-41ce-a472-ff2929d7f121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:27.560824 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186a2cd-0c04-41ce-a472-ff2929d7f121 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:27.561111 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186a2cd-0c04-41ce-a472-ff2929d7f121 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:27.561383 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186a2cd-0c04-41ce-a472-ff2929d7f121 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:27.562144 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186a2cd-0c04-41ce-a472-ff2929d7f121 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:27.562445 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186a2cd-0c04-41ce-a472-ff2929d7f121 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:27.563829 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186a2cd-0c04-41ce-a472-ff2929d7f121 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:27.572049 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-afe96a9e-a2f0-4b8b-af69-47bc42a26ee7 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:27.574048 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-afe96a9e-a2f0-4b8b-af69-47bc42a26ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:27.577422 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 462/929] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:27.582816 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c59973-2046-40e6-8730-02de61fd19d6 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:27.582816 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c59973-2046-40e6-8730-02de61fd19d6 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:27.582816 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c59973-2046-40e6-8730-02de61fd19d6 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:27.582816 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 463/930] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:14:27.586302 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c59973-2046-40e6-8730-02de61fd19d6 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:27.647647 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:27.682836 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 468/931] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 04:14:27.684606 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48968653-f99f-4e15-b940-e490ba8c2774 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:27.684950 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48968653-f99f-4e15-b940-e490ba8c2774 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:27.685199 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48968653-f99f-4e15-b940-e490ba8c2774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:27.709953 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-48968653-f99f-4e15-b940-e490ba8c2774 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:27.711801 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-48968653-f99f-4e15-b940-e490ba8c2774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:27.742161 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c59973-2046-40e6-8730-02de61fd19d6 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:27.788198 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737cc40-ccee-4e76-a7dc-90b64ef072ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:27.789312 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737cc40-ccee-4e76-a7dc-90b64ef072ae None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:27.789765 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737cc40-ccee-4e76-a7dc-90b64ef072ae None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:27.790333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737cc40-ccee-4e76-a7dc-90b64ef072ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:27.802546 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9737cc40-ccee-4e76-a7dc-90b64ef072ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:27.804844 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9737cc40-ccee-4e76-a7dc-90b64ef072ae None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:27.818075 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 469/932] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:14:27.818075 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48968653-f99f-4e15-b940-e490ba8c2774 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:27.826178 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-9737cc40-ccee-4e76-a7dc-90b64ef072ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:14:27.826178 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:27.826178 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:27.826178 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:27.826178 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:27.826178 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:27.826178 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:27.826178 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:27.826178 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:27.826178 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:27.826178 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:27.826178 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:27.826178 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 04:14:27.826178 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 04:14:27.826178 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 04:14:27.827135 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 04:14:27.827135 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:27.827135 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:27.827135 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:27.827135 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:27.827135 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:27.827135 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:27.827135 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:27.827135 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:27.827135 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:27.827135 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:27.827135 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:27.827135 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:27.827135 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:27.827135 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:27.827135 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:27.827135 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:27.828038 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 04:14:27.828038 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 04:14:27.828038 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 04:14:27.828038 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 04:14:27.828038 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 04:14:27.828038 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 04:14:27.828038 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:14:27.828038 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:27.835541 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 464/933] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:14:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:27.837356 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737cc40-ccee-4e76-a7dc-90b64ef072ae None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:27.915369 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:27.982757 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48968653-f99f-4e15-b940-e490ba8c2774 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:27.987764 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:28.006167 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737cc40-ccee-4e76-a7dc-90b64ef072ae None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:28.032108 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8afb46c-d34c-470a-b34e-6d438c6e5d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:28.032880 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afb46c-d34c-470a-b34e-6d438c6e5d92 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:28.033171 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afb46c-d34c-470a-b34e-6d438c6e5d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:28.033454 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afb46c-d34c-470a-b34e-6d438c6e5d92 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:28.034197 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8afb46c-d34c-470a-b34e-6d438c6e5d92 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:28.036267 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8afb46c-d34c-470a-b34e-6d438c6e5d92 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:28.037792 dv-cinder-667108-37-smb devstack@keystone.service[80231]: WARNING keystone.server.flask.common [None req-f8afb46c-d34c-470a-b34e-6d438c6e5d92 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 01 04:14:28.054578 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1af1b-f520-4eda-ad83-7f2f77de7d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:28.055226 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1af1b-f520-4eda-ad83-7f2f77de7d96 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:28.055470 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1af1b-f520-4eda-ad83-7f2f77de7d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:28.055783 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1af1b-f520-4eda-ad83-7f2f77de7d96 None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:28.056775 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1af1b-f520-4eda-ad83-7f2f77de7d96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:28.057051 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1af1b-f520-4eda-ad83-7f2f77de7d96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:28.058532 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1af1b-f520-4eda-ad83-7f2f77de7d96 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:28.060622 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.sql.core [None req-f8afb46c-d34c-470a-b34e-6d438c6e5d92 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 01 04:14:28.060622 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 01 04:14:28.060622 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [parameters: {'id': 'ae80ac053ff1421f836ffef9d8741b67', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 01 04:14:28.060622 dv-cinder-667108-37-smb devstack@keystone.service[80231]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80231) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 01 04:14:28.068524 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-f8afb46c-d34c-470a-b34e-6d438c6e5d92 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ae80ac053ff1421f836ffef9d8741b67.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ae80ac053ff1421f836ffef9d8741b67. Jun 01 04:14:28.068524 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:28.068524 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 01 04:14:28.068524 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 01 04:14:28.068524 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 01 04:14:28.068524 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 01 04:14:28.068524 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 01 04:14:28.068524 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result = self._query(query) Jun 01 04:14:28.068524 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 01 04:14:28.068524 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application conn.query(q) Jun 01 04:14:28.068524 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 01 04:14:28.068524 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 01 04:14:28.068524 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 01 04:14:28.069387 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result.read() Jun 01 04:14:28.069387 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 01 04:14:28.069387 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 01 04:14:28.069387 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 01 04:14:28.069387 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 01 04:14:28.069387 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 01 04:14:28.069387 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 01 04:14:28.069387 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 01 04:14:28.069387 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 01 04:14:28.069387 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 01 04:14:28.069387 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:28.069387 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 01 04:14:28.069387 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:28.069387 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:28.069387 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 01 04:14:28.069387 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 01 04:14:28.069387 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 01 04:14:28.069387 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 01 04:14:28.070408 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 01 04:14:28.070408 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application next(self.gen) Jun 01 04:14:28.070408 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 01 04:14:28.070408 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application yield resource Jun 01 04:14:28.070408 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 01 04:14:28.070408 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application next(self.gen) Jun 01 04:14:28.070408 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 01 04:14:28.070408 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.session.rollback() Jun 01 04:14:28.070408 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 01 04:14:28.070408 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.force_reraise() Jun 01 04:14:28.070408 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 01 04:14:28.070408 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise self.value Jun 01 04:14:28.070408 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 01 04:14:28.070408 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 01 04:14:28.070408 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 01 04:14:28.070408 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application session.commit() Jun 01 04:14:28.070408 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 01 04:14:28.071716 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 01 04:14:28.071716 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 01 04:14:28.071716 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._prepare_impl() Jun 01 04:14:28.071716 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 01 04:14:28.071716 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.session.flush() Jun 01 04:14:28.071716 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 01 04:14:28.071716 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._flush(objects) Jun 01 04:14:28.071716 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 01 04:14:28.071716 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 01 04:14:28.071716 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 01 04:14:28.071716 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application compat.raise_( Jun 01 04:14:28.071716 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 01 04:14:28.071716 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception Jun 01 04:14:28.071716 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 01 04:14:28.071716 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application flush_context.execute() Jun 01 04:14:28.071716 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 01 04:14:28.071716 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rec.execute(self) Jun 01 04:14:28.072606 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 01 04:14:28.072606 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 01 04:14:28.072606 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 01 04:14:28.072606 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 01 04:14:28.072606 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 01 04:14:28.072606 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 01 04:14:28.072606 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 01 04:14:28.072606 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 01 04:14:28.072606 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 01 04:14:28.072606 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 01 04:14:28.072606 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 01 04:14:28.072606 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 01 04:14:28.072606 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 01 04:14:28.072606 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 01 04:14:28.072606 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 01 04:14:28.073404 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 01 04:14:28.073404 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 01 04:14:28.073404 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception Jun 01 04:14:28.073404 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 01 04:14:28.073404 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 01 04:14:28.073404 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 01 04:14:28.073404 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 01 04:14:28.073404 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 01 04:14:28.073404 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result = self._query(query) Jun 01 04:14:28.073404 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 01 04:14:28.073404 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application conn.query(q) Jun 01 04:14:28.073404 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 01 04:14:28.073404 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 01 04:14:28.073404 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 01 04:14:28.073404 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result.read() Jun 01 04:14:28.073404 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 01 04:14:28.073404 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 01 04:14:28.074311 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 01 04:14:28.074311 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 01 04:14:28.074311 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 01 04:14:28.074311 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 01 04:14:28.074311 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 01 04:14:28.074311 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 01 04:14:28.074311 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 01 04:14:28.074311 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 01 04:14:28.074311 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [parameters: {'id': 'ae80ac053ff1421f836ffef9d8741b67', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 01 04:14:28.074311 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 01 04:14:28.074311 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:28.074311 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 04:14:28.074311 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:28.074311 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:28.074311 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 01 04:14:28.076932 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 01 04:14:28.076932 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 01 04:14:28.076932 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 01 04:14:28.076932 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 01 04:14:28.076932 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:28.076932 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 04:14:28.076932 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:28.076932 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:28.076932 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:28.076932 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:28.076932 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:28.076932 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:28.076932 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:28.076932 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:28.076932 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:28.076932 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:28.076932 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:28.079077 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:28.079077 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 01 04:14:28.079077 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 01 04:14:28.079077 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:28.079077 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:28.079077 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 01 04:14:28.079077 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 01 04:14:28.079077 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ae80ac053ff1421f836ffef9d8741b67. Jun 01 04:14:28.079077 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:28.079077 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 470/934] 10.222.0.32 () {60 vars in 1140 bytes} [Wed Jun 1 04:14:27 2022] POST /identity/v3/projects => generated 262 bytes in 260 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:28.079077 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8afb46c-d34c-470a-b34e-6d438c6e5d92 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:28.087376 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 465/935] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Jun 1 04:14:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:28.088728 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1af1b-f520-4eda-ad83-7f2f77de7d96 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:28.205915 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8afb46c-d34c-470a-b34e-6d438c6e5d92 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:28.227280 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1af1b-f520-4eda-ad83-7f2f77de7d96 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:28.235600 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:28.254539 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d35629-925a-4834-9e68-b746b6c5adbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:28.255374 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d35629-925a-4834-9e68-b746b6c5adbf None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:28.255661 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d35629-925a-4834-9e68-b746b6c5adbf None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:28.255943 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d35629-925a-4834-9e68-b746b6c5adbf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:28.256625 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d35629-925a-4834-9e68-b746b6c5adbf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:28.258242 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d35629-925a-4834-9e68-b746b6c5adbf None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:28.271276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-c7d35629-925a-4834-9e68-b746b6c5adbf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 01 04:14:28.271276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:28.271276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 04:14:28.271276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 04:14:28.271276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 04:14:28.271276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 04:14:28.271276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 04:14:28.271276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:28.271276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 01 04:14:28.271276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:28.271276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 04:14:28.271276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:28.271276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:28.271276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:28.271276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:28.271276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:28.271276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:28.272299 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:28.272299 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:28.272299 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:28.272299 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:28.272299 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:28.272299 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:28.272299 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 04:14:28.272299 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 04:14:28.272299 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 04:14:28.272299 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 04:14:28.272299 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:28.272299 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:28.272299 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:28.272299 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:28.272299 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:28.272299 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:28.273781 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:28.273781 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:28.273781 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:28.273781 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:28.273781 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:28.273781 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:28.273781 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:28.273781 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:28.273781 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:28.273781 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:28.273781 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 04:14:28.273781 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:28.273781 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 01 04:14:28.273781 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:28.273781 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 471/936] 10.222.0.32 () {56 vars in 1126 bytes} [Wed Jun 1 04:14:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:28.275345 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d35629-925a-4834-9e68-b746b6c5adbf None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:28.277118 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d7a95-d4a6-40e8-8f50-cdcdaf7acfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:28.278887 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d7a95-d4a6-40e8-8f50-cdcdaf7acfe2 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:28.279567 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d7a95-d4a6-40e8-8f50-cdcdaf7acfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:28.280385 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d7a95-d4a6-40e8-8f50-cdcdaf7acfe2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:28.292815 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d7a95-d4a6-40e8-8f50-cdcdaf7acfe2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:28.295892 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d7a95-d4a6-40e8-8f50-cdcdaf7acfe2 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:28.313325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-fb7d7a95-d4a6-40e8-8f50-cdcdaf7acfe2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:14:28.313325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:28.313325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:28.313325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:28.313325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:28.313325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:28.313325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:28.313325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:28.313325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:28.313325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:28.313325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:28.313325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:28.313325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 04:14:28.313325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 04:14:28.313325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 04:14:28.315208 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 04:14:28.315208 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:28.315208 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:28.315208 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:28.315208 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:28.315208 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:28.315208 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:28.315208 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:28.315208 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:28.315208 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:28.315208 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:28.315208 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:28.315208 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:28.315208 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:28.315208 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:28.315208 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:28.315208 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:28.317276 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 04:14:28.317276 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 04:14:28.317276 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 04:14:28.317276 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 04:14:28.317276 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 04:14:28.317276 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 04:14:28.317276 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:14:28.317276 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:28.317276 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 466/937] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:14:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:28.320561 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d7a95-d4a6-40e8-8f50-cdcdaf7acfe2 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:28.335628 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:28.443561 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d35629-925a-4834-9e68-b746b6c5adbf None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:28.443952 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d7a95-d4a6-40e8-8f50-cdcdaf7acfe2 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:28.484447 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7412b-19be-424f-9245-6e208fbf415f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:28.485348 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7412b-19be-424f-9245-6e208fbf415f None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:28.485627 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7412b-19be-424f-9245-6e208fbf415f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:28.485930 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7412b-19be-424f-9245-6e208fbf415f None admin] PATH_INFO: `/v3/projects/31d68f64d21647688074554062952074/users/3fa2ad34164a4631adf76fbd042679ba/roles/0f6437212f954ee1a3bdb42ffc3458e7` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:28.486717 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e9c10-10a0-4f0c-899f-73de4cd02bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:28.487377 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e9c10-10a0-4f0c-899f-73de4cd02bae None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:28.487655 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e9c10-10a0-4f0c-899f-73de4cd02bae None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:28.487958 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e9c10-10a0-4f0c-899f-73de4cd02bae None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:28.488325 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7412b-19be-424f-9245-6e208fbf415f None admin] RBAC: Authorizing `identity:create_grant(project_id=31d68f64d21647688074554062952074, user_id=3fa2ad34164a4631adf76fbd042679ba, role_id=0f6437212f954ee1a3bdb42ffc3458e7)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:28.488656 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e9c10-10a0-4f0c-899f-73de4cd02bae None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:28.488959 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e9c10-10a0-4f0c-899f-73de4cd02bae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:28.489750 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7412b-19be-424f-9245-6e208fbf415f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:28.490484 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e9c10-10a0-4f0c-899f-73de4cd02bae None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:28.496009 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 467/938] 10.222.0.32 () {56 vars in 1122 bytes} [Wed Jun 1 04:14:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:28.496841 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e9c10-10a0-4f0c-899f-73de4cd02bae None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:28.511739 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 472/939] 10.222.0.32 () {58 vars in 1439 bytes} [Wed Jun 1 04:14:28 2022] PUT /identity/v3/projects/31d68f64d21647688074554062952074/users/3fa2ad34164a4631adf76fbd042679ba/roles/0f6437212f954ee1a3bdb42ffc3458e7 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:14:28.513515 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7412b-19be-424f-9245-6e208fbf415f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:28.533669 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:28.645203 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e9c10-10a0-4f0c-899f-73de4cd02bae None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:28.648738 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:28.696302 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7412b-19be-424f-9245-6e208fbf415f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:28.713668 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ce126-85b8-4bbb-be0b-b1c6fc438c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:28.714737 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ce126-85b8-4bbb-be0b-b1c6fc438c26 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:28.715017 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ce126-85b8-4bbb-be0b-b1c6fc438c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:28.715281 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ce126-85b8-4bbb-be0b-b1c6fc438c26 None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:28.716176 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ce126-85b8-4bbb-be0b-b1c6fc438c26 None admin] RBAC: Adding query filter params (name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:28.716484 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ce126-85b8-4bbb-be0b-b1c6fc438c26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:28.718328 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ce126-85b8-4bbb-be0b-b1c6fc438c26 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:28.739485 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 468/940] 10.222.0.32 () {56 vars in 1112 bytes} [Wed Jun 1 04:14:28 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:28.761299 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f397ad-505b-4ba7-885b-821d09fd14b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:28.763471 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f397ad-505b-4ba7-885b-821d09fd14b2 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:28.763764 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f397ad-505b-4ba7-885b-821d09fd14b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:28.764045 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f397ad-505b-4ba7-885b-821d09fd14b2 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:28.764802 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f397ad-505b-4ba7-885b-821d09fd14b2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:28.765118 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f397ad-505b-4ba7-885b-821d09fd14b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:28.768184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f397ad-505b-4ba7-885b-821d09fd14b2 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:28.778249 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 473/941] 10.222.0.32 () {56 vars in 1122 bytes} [Wed Jun 1 04:14:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:28.784152 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ce126-85b8-4bbb-be0b-b1c6fc438c26 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:28.914394 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:28.927056 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ce126-85b8-4bbb-be0b-b1c6fc438c26 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:28.970157 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8dc7ce-1244-43ae-ba52-1222090235e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:28.970971 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8dc7ce-1244-43ae-ba52-1222090235e9 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:28.971254 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8dc7ce-1244-43ae-ba52-1222090235e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:28.971531 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8dc7ce-1244-43ae-ba52-1222090235e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:28.972474 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8dc7ce-1244-43ae-ba52-1222090235e9 None admin] RBAC: Adding query filter params (interface=public, service_id=c843ba4048fc456a81cd2816de0bc4ff, region_id=RegionOne) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:28.972892 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8dc7ce-1244-43ae-ba52-1222090235e9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:28.975095 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8dc7ce-1244-43ae-ba52-1222090235e9 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:28.984270 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 469/942] 10.222.0.32 () {56 vars in 1251 bytes} [Wed Jun 1 04:14:28 2022] GET /identity/v3/endpoints?service_id=c843ba4048fc456a81cd2816de0bc4ff&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:28.992491 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f397ad-505b-4ba7-885b-821d09fd14b2 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:29.109965 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f397ad-505b-4ba7-885b-821d09fd14b2 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:29.145385 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de6e02-0f0e-4984-9c3c-213517ecf3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:29.146092 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de6e02-0f0e-4984-9c3c-213517ecf3f1 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:29.146381 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de6e02-0f0e-4984-9c3c-213517ecf3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:29.146661 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de6e02-0f0e-4984-9c3c-213517ecf3f1 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:29.147355 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de6e02-0f0e-4984-9c3c-213517ecf3f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:29.148781 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de6e02-0f0e-4984-9c3c-213517ecf3f1 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:29.155617 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 474/943] 10.222.0.32 () {56 vars in 1087 bytes} [Wed Jun 1 04:14:28 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:14:29.615381 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703096da-106a-4db4-87d6-4717576372d6 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:29.615770 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703096da-106a-4db4-87d6-4717576372d6 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:29.615996 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703096da-106a-4db4-87d6-4717576372d6 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:29.617560 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 470/944] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:14:29.623280 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818f45b-41ac-4ead-bd5d-58b0cce33000 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:29.623574 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818f45b-41ac-4ead-bd5d-58b0cce33000 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:29.623861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818f45b-41ac-4ead-bd5d-58b0cce33000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:29.641576 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d818f45b-41ac-4ead-bd5d-58b0cce33000 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:29.643160 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d818f45b-41ac-4ead-bd5d-58b0cce33000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:29.646853 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:29.714200 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 475/945] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:14:29.742317 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703096da-106a-4db4-87d6-4717576372d6 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:29.870036 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703096da-106a-4db4-87d6-4717576372d6 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:29.908873 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6960a74-c45c-4b56-a61a-66ae6a0c03be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:29.909735 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6960a74-c45c-4b56-a61a-66ae6a0c03be None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:29.910632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6960a74-c45c-4b56-a61a-66ae6a0c03be None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:29.910914 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6960a74-c45c-4b56-a61a-66ae6a0c03be None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:29.911586 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6960a74-c45c-4b56-a61a-66ae6a0c03be None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:29.913079 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6960a74-c45c-4b56-a61a-66ae6a0c03be None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:29.926730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-d6960a74-c45c-4b56-a61a-66ae6a0c03be None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 01 04:14:29.926730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:29.926730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 04:14:29.926730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 04:14:29.926730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 04:14:29.926730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 04:14:29.926730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 04:14:29.926730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:29.926730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 01 04:14:29.926730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:29.926730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 04:14:29.926730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:29.926730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:29.926730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:29.926730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:29.926730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:29.929045 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:29.929045 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:29.929045 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:29.929045 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:29.929045 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:29.929045 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:29.929045 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:29.929045 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 04:14:29.929045 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 04:14:29.929045 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 04:14:29.929045 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 04:14:29.929045 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:29.929045 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:29.929045 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:29.929045 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:29.929045 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:29.931981 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:29.931981 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:29.931981 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:29.931981 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:29.931981 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:29.931981 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:29.931981 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:29.931981 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:29.931981 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:29.931981 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:29.931981 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:29.931981 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 04:14:29.931981 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:29.931981 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 01 04:14:29.931981 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:29.931981 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 471/946] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Jun 1 04:14:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:29.938663 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818f45b-41ac-4ead-bd5d-58b0cce33000 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:30.104837 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818f45b-41ac-4ead-bd5d-58b0cce33000 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:30.167920 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc33ca0-de10-47ab-be90-cde5f5e83da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:30.169048 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc33ca0-de10-47ab-be90-cde5f5e83da0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:30.169552 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc33ca0-de10-47ab-be90-cde5f5e83da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:30.170086 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc33ca0-de10-47ab-be90-cde5f5e83da0 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:30.171423 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc33ca0-de10-47ab-be90-cde5f5e83da0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:30.171975 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc33ca0-de10-47ab-be90-cde5f5e83da0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:30.174611 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc33ca0-de10-47ab-be90-cde5f5e83da0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:30.184074 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 476/947] 10.222.0.32 () {56 vars in 1126 bytes} [Wed Jun 1 04:14:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:30.189374 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6960a74-c45c-4b56-a61a-66ae6a0c03be None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:30.211162 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:30.297300 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6960a74-c45c-4b56-a61a-66ae6a0c03be None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:30.335585 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168ab54-4c14-4e55-83bd-b9b839b75bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:30.336260 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168ab54-4c14-4e55-83bd-b9b839b75bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:30.336545 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168ab54-4c14-4e55-83bd-b9b839b75bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:30.336826 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168ab54-4c14-4e55-83bd-b9b839b75bd0 None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:30.337541 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0168ab54-4c14-4e55-83bd-b9b839b75bd0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:30.337848 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0168ab54-4c14-4e55-83bd-b9b839b75bd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:30.339263 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0168ab54-4c14-4e55-83bd-b9b839b75bd0 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:30.345033 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 472/948] 10.222.0.32 () {56 vars in 1126 bytes} [Wed Jun 1 04:14:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:30.350822 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc33ca0-de10-47ab-be90-cde5f5e83da0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:30.357516 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:30.458126 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc33ca0-de10-47ab-be90-cde5f5e83da0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:30.493195 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552243a-b22b-4351-82be-e982e3d81ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:30.493865 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552243a-b22b-4351-82be-e982e3d81ea9 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:30.494178 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552243a-b22b-4351-82be-e982e3d81ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:30.494462 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552243a-b22b-4351-82be-e982e3d81ea9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:30.495207 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552243a-b22b-4351-82be-e982e3d81ea9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:30.496576 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552243a-b22b-4351-82be-e982e3d81ea9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:30.520229 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 477/949] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Jun 1 04:14:30 2022] POST /identity/v3/endpoints => generated 347 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:14:31.013906 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73383ef1-3449-4cb7-bf9e-d9059e6983d7 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:31.014476 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73383ef1-3449-4cb7-bf9e-d9059e6983d7 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:31.014752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73383ef1-3449-4cb7-bf9e-d9059e6983d7 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:31.016565 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 473/950] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:14:31.022405 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e229d65-5754-42bb-94a7-b840e3b8877f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:31.022902 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e229d65-5754-42bb-94a7-b840e3b8877f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:31.023167 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e229d65-5754-42bb-94a7-b840e3b8877f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:31.041100 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-1e229d65-5754-42bb-94a7-b840e3b8877f None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:31.042378 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1e229d65-5754-42bb-94a7-b840e3b8877f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:31.103643 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:31.130094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 478/951] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:14:31.146502 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73383ef1-3449-4cb7-bf9e-d9059e6983d7 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:31.244388 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:31.268678 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73383ef1-3449-4cb7-bf9e-d9059e6983d7 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:31.279789 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75430a8a-5057-44ed-88dc-b59fa0c0a020 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:31.280096 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75430a8a-5057-44ed-88dc-b59fa0c0a020 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:31.280362 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75430a8a-5057-44ed-88dc-b59fa0c0a020 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:31.285998 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 479/952] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:14:31.288020 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e1291-2ce2-400b-89f1-b5c49d209a2f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:31.288311 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e1291-2ce2-400b-89f1-b5c49d209a2f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:31.288591 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e1291-2ce2-400b-89f1-b5c49d209a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:31.306288 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a21e1291-2ce2-400b-89f1-b5c49d209a2f None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:31.307469 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a21e1291-2ce2-400b-89f1-b5c49d209a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:31.318435 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872194c8-268b-4fcc-b77f-a0785e7e29a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:31.319691 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872194c8-268b-4fcc-b77f-a0785e7e29a2 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:31.320209 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872194c8-268b-4fcc-b77f-a0785e7e29a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:31.320726 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872194c8-268b-4fcc-b77f-a0785e7e29a2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:31.332942 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872194c8-268b-4fcc-b77f-a0785e7e29a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:14:31.341577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-872194c8-268b-4fcc-b77f-a0785e7e29a2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 01 04:14:31.341577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:31.341577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:31.341577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:31.341577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:31.341577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:31.341577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:31.341577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:31.341577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:31.341577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:31.341577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:31.341577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:31.341577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:14:31.341577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:14:31.341577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:14:31.341577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:14:31.342675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:14:31.342675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:14:31.342675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:14:31.342675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:14:31.342675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:31.342675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:31.342675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:31.342675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:31.342675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:31.342675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:31.342675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:31.342675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:31.342675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:31.342675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:31.342675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:31.342675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:31.343556 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:31.343556 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:31.343556 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:31.343556 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:31.343556 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:14:31.343556 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:14:31.343556 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:14:31.343556 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:14:31.343556 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:14:31.343556 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:14:31.343556 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 01 04:14:31.343556 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:31.351645 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 474/953] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Jun 1 04:14:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:14:31.353355 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872194c8-268b-4fcc-b77f-a0785e7e29a2 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:31.386133 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 480/954] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:14:31.411044 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e1291-2ce2-400b-89f1-b5c49d209a2f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:31.476073 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872194c8-268b-4fcc-b77f-a0785e7e29a2 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:31.515441 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6e5e3-2a47-4b3e-a6e5-14b1ffbba164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:31.516123 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6e5e3-2a47-4b3e-a6e5-14b1ffbba164 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:31.516414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6e5e3-2a47-4b3e-a6e5-14b1ffbba164 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:31.517078 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6e5e3-2a47-4b3e-a6e5-14b1ffbba164 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:31.517839 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6e5e3-2a47-4b3e-a6e5-14b1ffbba164 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:31.518189 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6e5e3-2a47-4b3e-a6e5-14b1ffbba164 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:31.519667 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6e5e3-2a47-4b3e-a6e5-14b1ffbba164 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:31.521716 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e1291-2ce2-400b-89f1-b5c49d209a2f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:31.528161 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 475/955] 10.222.0.32 () {56 vars in 1115 bytes} [Wed Jun 1 04:14:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:31.529471 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15454768-b8eb-4776-b73f-522350a13837 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:31.529760 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15454768-b8eb-4776-b73f-522350a13837 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:31.530107 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15454768-b8eb-4776-b73f-522350a13837 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:31.531560 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 476/956] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:14:31.535320 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15454768-b8eb-4776-b73f-522350a13837 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:31.539383 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:31.543307 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:31.564782 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c654fdf-fa87-4cd0-8781-e2c90c5932ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:31.565864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c654fdf-fa87-4cd0-8781-e2c90c5932ea None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:31.566344 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c654fdf-fa87-4cd0-8781-e2c90c5932ea None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:31.566851 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c654fdf-fa87-4cd0-8781-e2c90c5932ea None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:31.567685 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c654fdf-fa87-4cd0-8781-e2c90c5932ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:31.569758 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c654fdf-fa87-4cd0-8781-e2c90c5932ea None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:31.583525 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.sql.core [None req-6c654fdf-fa87-4cd0-8781-e2c90c5932ea None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 01 04:14:31.583525 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 01 04:14:31.583525 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [parameters: {'user_id': '6bd14cd19b5741089eadc70858f45bf9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 01 04:14:31.583525 dv-cinder-667108-37-smb devstack@keystone.service[80231]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80231) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 01 04:14:31.591466 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-6c654fdf-fa87-4cd0-8781-e2c90c5932ea None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 01 04:14:31.591466 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:31.591466 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 01 04:14:31.591466 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 01 04:14:31.591466 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 01 04:14:31.591466 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 01 04:14:31.591466 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 01 04:14:31.591466 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result = self._query(query) Jun 01 04:14:31.591466 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 01 04:14:31.591466 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application conn.query(q) Jun 01 04:14:31.591466 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 01 04:14:31.591466 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 01 04:14:31.591466 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 01 04:14:31.591466 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result.read() Jun 01 04:14:31.591466 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 01 04:14:31.592511 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 01 04:14:31.592511 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 01 04:14:31.592511 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 01 04:14:31.592511 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 01 04:14:31.592511 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 01 04:14:31.592511 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 01 04:14:31.592511 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 01 04:14:31.592511 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 01 04:14:31.592511 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:31.592511 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 01 04:14:31.592511 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:31.592511 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:31.592511 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 01 04:14:31.592511 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 01 04:14:31.592511 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 01 04:14:31.592511 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 01 04:14:31.592511 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 01 04:14:31.592511 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application next(self.gen) Jun 01 04:14:31.595044 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 01 04:14:31.595044 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application yield resource Jun 01 04:14:31.595044 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 01 04:14:31.595044 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application next(self.gen) Jun 01 04:14:31.595044 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 01 04:14:31.595044 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.session.rollback() Jun 01 04:14:31.595044 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 01 04:14:31.595044 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.force_reraise() Jun 01 04:14:31.595044 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 01 04:14:31.595044 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise self.value Jun 01 04:14:31.595044 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 01 04:14:31.595044 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 01 04:14:31.595044 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 01 04:14:31.595044 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application session.commit() Jun 01 04:14:31.595044 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 01 04:14:31.595044 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 01 04:14:31.595044 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 01 04:14:31.595960 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._prepare_impl() Jun 01 04:14:31.595960 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 01 04:14:31.595960 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.session.flush() Jun 01 04:14:31.595960 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 01 04:14:31.595960 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._flush(objects) Jun 01 04:14:31.595960 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 01 04:14:31.595960 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 01 04:14:31.595960 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 01 04:14:31.595960 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application compat.raise_( Jun 01 04:14:31.595960 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 01 04:14:31.595960 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception Jun 01 04:14:31.595960 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 01 04:14:31.595960 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application flush_context.execute() Jun 01 04:14:31.595960 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 01 04:14:31.595960 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rec.execute(self) Jun 01 04:14:31.595960 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 01 04:14:31.595960 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 01 04:14:31.596864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 01 04:14:31.596864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 01 04:14:31.596864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 01 04:14:31.596864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 01 04:14:31.596864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 01 04:14:31.596864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 01 04:14:31.596864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 01 04:14:31.596864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 01 04:14:31.596864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 01 04:14:31.596864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 01 04:14:31.596864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 01 04:14:31.596864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 01 04:14:31.596864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 01 04:14:31.596864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 01 04:14:31.596864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 01 04:14:31.596864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception Jun 01 04:14:31.598296 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 01 04:14:31.598296 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 01 04:14:31.598296 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 01 04:14:31.598296 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 01 04:14:31.598296 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 01 04:14:31.598296 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result = self._query(query) Jun 01 04:14:31.598296 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 01 04:14:31.598296 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application conn.query(q) Jun 01 04:14:31.598296 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 01 04:14:31.598296 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 01 04:14:31.598296 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 01 04:14:31.598296 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result.read() Jun 01 04:14:31.598296 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 01 04:14:31.598296 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 01 04:14:31.598296 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 01 04:14:31.598296 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 01 04:14:31.600527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 01 04:14:31.600527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 01 04:14:31.600527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 01 04:14:31.600527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 01 04:14:31.600527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 01 04:14:31.600527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 01 04:14:31.600527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [parameters: {'user_id': '6bd14cd19b5741089eadc70858f45bf9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 01 04:14:31.600527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 01 04:14:31.600527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:31.600527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 04:14:31.600527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:31.600527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:31.600527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:31.600527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:31.600527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:31.602235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:31.602235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:31.602235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:31.602235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:31.602235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:31.602235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:31.602235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:31.602235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 01 04:14:31.602235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 01 04:14:31.602235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:31.602235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:31.602235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 04:14:31.602235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:14:31.602235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 04:14:31.602235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:14:31.602235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 01 04:14:31.602235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 01 04:14:31.603468 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 01 04:14:31.603468 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 01 04:14:31.603468 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 01 04:14:31.603468 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 01 04:14:31.603468 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 01 04:14:31.603468 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:31.603468 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 481/957] 10.222.0.32 () {60 vars in 1131 bytes} [Wed Jun 1 04:14:31 2022] POST /identity/v3/users => generated 160 bytes in 182 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:31.603468 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6249dbc-cac9-45e1-b253-d5ffb6ef0ed1 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:31.603468 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6249dbc-cac9-45e1-b253-d5ffb6ef0ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:31.603468 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6249dbc-cac9-45e1-b253-d5ffb6ef0ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:31.620490 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c6249dbc-cac9-45e1-b253-d5ffb6ef0ed1 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:31.622248 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c6249dbc-cac9-45e1-b253-d5ffb6ef0ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:31.655156 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15454768-b8eb-4776-b73f-522350a13837 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:31.694120 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d69e8c-0b05-4417-aab4-06206abd4b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:31.694919 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d69e8c-0b05-4417-aab4-06206abd4b8b None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:31.695201 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d69e8c-0b05-4417-aab4-06206abd4b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:31.698039 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d69e8c-0b05-4417-aab4-06206abd4b8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:31.698183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 482/958] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:14:31.698183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6249dbc-cac9-45e1-b253-d5ffb6ef0ed1 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:31.719525 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d69e8c-0b05-4417-aab4-06206abd4b8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:31.721584 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d69e8c-0b05-4417-aab4-06206abd4b8b None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:31.743806 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-50d69e8c-0b05-4417-aab4-06206abd4b8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:31.743806 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:31.743806 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:31.743806 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:31.743806 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:31.743806 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:31.743806 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:31.743806 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:31.743806 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:31.743806 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:31.743806 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:31.743806 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:31.743806 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:14:31.743806 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:14:31.743806 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:14:31.744953 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:14:31.744953 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:31.744953 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:31.744953 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:31.744953 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:31.744953 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:31.744953 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:31.744953 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:31.744953 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:31.744953 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:31.744953 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:31.744953 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:31.744953 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:31.744953 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:31.744953 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:31.744953 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:31.744953 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:31.746112 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:14:31.746112 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:14:31.746112 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:31.746112 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:31.751942 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 477/959] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:14:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:31.751942 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d69e8c-0b05-4417-aab4-06206abd4b8b None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:31.809808 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:31.821351 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6249dbc-cac9-45e1-b253-d5ffb6ef0ed1 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:31.834681 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:31.861298 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d69e8c-0b05-4417-aab4-06206abd4b8b None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:31.871546 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0bded-f397-4d03-a001-745d430cf9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:31.872610 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0bded-f397-4d03-a001-745d430cf9af None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:31.872962 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0bded-f397-4d03-a001-745d430cf9af None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:31.873295 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0bded-f397-4d03-a001-745d430cf9af None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:31.882746 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0bded-f397-4d03-a001-745d430cf9af None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:31.884424 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0bded-f397-4d03-a001-745d430cf9af None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:31.900050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-44a0bded-f397-4d03-a001-745d430cf9af None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 01 04:14:31.900050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:31.900050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:31.900050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:31.900050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:31.900050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:31.900050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:31.900050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:31.900050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:31.900050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:31.900050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:31.900050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:31.900050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 04:14:31.900050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 04:14:31.900050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 04:14:31.900050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 04:14:31.910377 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:31.910377 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:31.910377 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 04:14:31.910377 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:14:31.910377 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 04:14:31.910377 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:14:31.910377 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:31.910377 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:31.910377 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:31.910377 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:31.910377 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:31.910377 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:31.910377 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:31.910377 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:31.910377 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:31.910377 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:31.910377 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:31.910377 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:31.912271 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:31.912271 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:31.912271 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 04:14:31.912271 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 04:14:31.912271 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 04:14:31.912271 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 04:14:31.912271 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 04:14:31.912271 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 04:14:31.912271 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 01 04:14:31.912271 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:31.912271 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 483/960] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:14:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:31.912271 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0bded-f397-4d03-a001-745d430cf9af None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:31.915583 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385a3a9-691f-4612-b77b-8e8322a48714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:31.916949 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385a3a9-691f-4612-b77b-8e8322a48714 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:31.917490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385a3a9-691f-4612-b77b-8e8322a48714 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:31.918070 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385a3a9-691f-4612-b77b-8e8322a48714 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:31.919242 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4385a3a9-691f-4612-b77b-8e8322a48714 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:31.921714 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4385a3a9-691f-4612-b77b-8e8322a48714 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:31.936619 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-4385a3a9-691f-4612-b77b-8e8322a48714 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 01 04:14:31.936619 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:31.936619 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 04:14:31.936619 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 04:14:31.936619 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 04:14:31.936619 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 04:14:31.936619 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 04:14:31.936619 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:31.936619 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 01 04:14:31.936619 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:31.936619 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 04:14:31.936619 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:31.936619 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:31.936619 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:31.936619 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:31.936619 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:31.936619 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:31.937951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:31.937951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:31.937951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:31.937951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:31.937951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:31.937951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:31.937951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 04:14:31.937951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 04:14:31.937951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 04:14:31.937951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 04:14:31.937951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:31.937951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:31.937951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:31.937951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:31.937951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:31.937951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:31.939011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:31.939011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:31.939011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:31.939011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:31.939011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:31.939011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:31.939011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:31.939011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:31.939011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:31.939011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:31.939011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 04:14:31.939011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:31.939011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 01 04:14:31.939011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:31.942516 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 478/961] 10.222.0.32 () {56 vars in 1126 bytes} [Wed Jun 1 04:14:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:31.942516 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385a3a9-691f-4612-b77b-8e8322a48714 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:32.036203 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0bded-f397-4d03-a001-745d430cf9af None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:32.060408 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385a3a9-691f-4612-b77b-8e8322a48714 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:32.078204 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678e148-3aca-4a8b-8187-3a3d32ebb480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:32.078980 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678e148-3aca-4a8b-8187-3a3d32ebb480 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:32.079265 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678e148-3aca-4a8b-8187-3a3d32ebb480 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:32.079831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678e148-3aca-4a8b-8187-3a3d32ebb480 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:32.080372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678e148-3aca-4a8b-8187-3a3d32ebb480 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:32.080683 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678e148-3aca-4a8b-8187-3a3d32ebb480 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:32.082905 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678e148-3aca-4a8b-8187-3a3d32ebb480 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:32.087059 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:32.107014 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 484/962] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:32.107014 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678e148-3aca-4a8b-8187-3a3d32ebb480 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:32.110509 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ccb838-420a-4b27-8771-a20cc57de71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:32.110986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccb838-420a-4b27-8771-a20cc57de71d None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:32.111273 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccb838-420a-4b27-8771-a20cc57de71d None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:32.111547 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccb838-420a-4b27-8771-a20cc57de71d None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:32.112362 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ccb838-420a-4b27-8771-a20cc57de71d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:32.112663 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ccb838-420a-4b27-8771-a20cc57de71d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:32.114828 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ccb838-420a-4b27-8771-a20cc57de71d None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:32.152132 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:32.155905 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 479/963] 10.222.0.32 () {56 vars in 1101 bytes} [Wed Jun 1 04:14:31 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:32.155905 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ccb838-420a-4b27-8771-a20cc57de71d None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:32.261495 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678e148-3aca-4a8b-8187-3a3d32ebb480 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:32.294439 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ccb838-420a-4b27-8771-a20cc57de71d None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:32.307851 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83032b36-ff7f-482b-a30a-ca51d0f03aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:32.308902 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83032b36-ff7f-482b-a30a-ca51d0f03aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:32.309396 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83032b36-ff7f-482b-a30a-ca51d0f03aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:32.309903 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83032b36-ff7f-482b-a30a-ca51d0f03aa0 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:32.310993 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83032b36-ff7f-482b-a30a-ca51d0f03aa0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:32.311516 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83032b36-ff7f-482b-a30a-ca51d0f03aa0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:32.313427 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83032b36-ff7f-482b-a30a-ca51d0f03aa0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:32.320778 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 485/964] 10.222.0.32 () {56 vars in 1122 bytes} [Wed Jun 1 04:14:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:32.326843 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83032b36-ff7f-482b-a30a-ca51d0f03aa0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:32.335296 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bba931-2c7e-4906-aeb9-5b05a72da01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:32.336180 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bba931-2c7e-4906-aeb9-5b05a72da01a None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:32.336462 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bba931-2c7e-4906-aeb9-5b05a72da01a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:32.336738 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bba931-2c7e-4906-aeb9-5b05a72da01a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:32.345332 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bba931-2c7e-4906-aeb9-5b05a72da01a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:32.346875 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bba931-2c7e-4906-aeb9-5b05a72da01a None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:32.363406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-d4bba931-2c7e-4906-aeb9-5b05a72da01a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 01 04:14:32.363406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:32.363406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:32.363406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:32.363406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:32.363406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:32.363406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:32.363406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:32.363406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:32.363406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:32.363406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:32.363406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:32.363406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 04:14:32.363406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 04:14:32.363406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 04:14:32.363406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 04:14:32.364434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:32.364434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:32.364434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 04:14:32.364434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:14:32.364434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 04:14:32.364434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:14:32.364434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:32.364434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:32.364434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:32.364434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:32.364434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:32.364434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:32.364434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:32.364434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:32.364434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:32.364434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:32.364434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:32.364434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:32.365372 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:32.365372 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:32.365372 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 04:14:32.365372 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 04:14:32.365372 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 04:14:32.365372 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 04:14:32.365372 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 04:14:32.365372 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 04:14:32.365372 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 01 04:14:32.365372 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:32.369480 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 480/965] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Jun 1 04:14:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:32.370472 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bba931-2c7e-4906-aeb9-5b05a72da01a None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:32.419791 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:32.460252 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:32.471698 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83032b36-ff7f-482b-a30a-ca51d0f03aa0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:32.509483 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bba931-2c7e-4906-aeb9-5b05a72da01a None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:32.518360 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb63c00-d132-4b9a-826a-77f0d025f76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:32.520280 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb63c00-d132-4b9a-826a-77f0d025f76c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:32.520584 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb63c00-d132-4b9a-826a-77f0d025f76c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:32.520863 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb63c00-d132-4b9a-826a-77f0d025f76c None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:32.521612 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb63c00-d132-4b9a-826a-77f0d025f76c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:32.521918 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb63c00-d132-4b9a-826a-77f0d025f76c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:32.524306 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb63c00-d132-4b9a-826a-77f0d025f76c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:32.531085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 486/966] 10.222.0.32 () {56 vars in 1122 bytes} [Wed Jun 1 04:14:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:32.536601 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb63c00-d132-4b9a-826a-77f0d025f76c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:32.557350 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22adf84-d987-4f2f-a979-8ddce5824e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:32.558405 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22adf84-d987-4f2f-a979-8ddce5824e2e None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:32.558692 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22adf84-d987-4f2f-a979-8ddce5824e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:32.558974 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22adf84-d987-4f2f-a979-8ddce5824e2e None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:32.560482 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22adf84-d987-4f2f-a979-8ddce5824e2e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:32.560831 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22adf84-d987-4f2f-a979-8ddce5824e2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:32.562561 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22adf84-d987-4f2f-a979-8ddce5824e2e None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:32.591016 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 481/967] 10.222.0.32 () {56 vars in 1149 bytes} [Wed Jun 1 04:14:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:32.592158 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22adf84-d987-4f2f-a979-8ddce5824e2e None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:32.651333 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb63c00-d132-4b9a-826a-77f0d025f76c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:32.686024 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c9662-4bc1-44b0-8ff5-9de4a8019193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:32.686694 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c9662-4bc1-44b0-8ff5-9de4a8019193 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:32.686984 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c9662-4bc1-44b0-8ff5-9de4a8019193 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:32.687264 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c9662-4bc1-44b0-8ff5-9de4a8019193 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:32.688005 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9c9662-4bc1-44b0-8ff5-9de4a8019193 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:32.689374 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9c9662-4bc1-44b0-8ff5-9de4a8019193 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:32.695697 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:32.703629 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22adf84-d987-4f2f-a979-8ddce5824e2e None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:32.722010 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 487/968] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Jun 1 04:14:32 2022] POST /identity/v3/endpoints => generated 349 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:14:32.762068 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5c471-0e3f-40a9-85d7-2cc1ed38cccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:32.762736 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5c471-0e3f-40a9-85d7-2cc1ed38cccb None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:32.763018 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5c471-0e3f-40a9-85d7-2cc1ed38cccb None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:32.763293 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5c471-0e3f-40a9-85d7-2cc1ed38cccb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:32.840252 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d5c471-0e3f-40a9-85d7-2cc1ed38cccb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:32.841654 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d5c471-0e3f-40a9-85d7-2cc1ed38cccb None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:32.900105 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98accd-4e1b-4031-8b47-c356b261444b None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:32.900399 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98accd-4e1b-4031-8b47-c356b261444b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:32.900682 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98accd-4e1b-4031-8b47-c356b261444b None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:32.902323 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 488/969] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:14:32.907817 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbf7de-7108-4a4f-885e-3cb3a26b770e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:32.908118 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbf7de-7108-4a4f-885e-3cb3a26b770e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:32.908398 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbf7de-7108-4a4f-885e-3cb3a26b770e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:32.928227 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-22bbf7de-7108-4a4f-885e-3cb3a26b770e None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:32.929444 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-22bbf7de-7108-4a4f-885e-3cb3a26b770e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:32.937458 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:32.947066 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:32.960030 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 482/970] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:14:32 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 01 04:14:32.965784 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5c471-0e3f-40a9-85d7-2cc1ed38cccb None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:33.011899 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 489/971] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 04:14:33.033642 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbf7de-7108-4a4f-885e-3cb3a26b770e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:33.070819 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5c471-0e3f-40a9-85d7-2cc1ed38cccb None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:33.107115 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa5ac1-36da-4244-b8a3-5f3d2f30d064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:33.107829 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa5ac1-36da-4244-b8a3-5f3d2f30d064 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:33.108113 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa5ac1-36da-4244-b8a3-5f3d2f30d064 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:33.108392 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa5ac1-36da-4244-b8a3-5f3d2f30d064 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:33.120050 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa5ac1-36da-4244-b8a3-5f3d2f30d064 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:33.121502 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa5ac1-36da-4244-b8a3-5f3d2f30d064 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:33.139837 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-f8fa5ac1-36da-4244-b8a3-5f3d2f30d064 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:33.139837 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:33.139837 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:33.139837 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:33.139837 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:33.139837 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:33.139837 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:33.139837 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:33.139837 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:33.139837 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:33.139837 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:33.139837 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:33.139837 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:14:33.139837 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:14:33.139837 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:14:33.140784 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:14:33.140784 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:33.140784 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:33.140784 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:33.140784 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:33.140784 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:33.140784 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:33.140784 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:33.140784 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:33.140784 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:33.140784 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:33.140784 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:33.140784 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:33.140784 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:33.140784 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:33.140784 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:33.140784 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:33.146447 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:14:33.146447 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:14:33.146447 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:33.146447 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:33.146689 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbf7de-7108-4a4f-885e-3cb3a26b770e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:33.147097 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 483/972] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:14:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:14:33.147097 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa5ac1-36da-4244-b8a3-5f3d2f30d064 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:33.188485 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65765120-9eea-4d13-a783-4965674bc1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:33.189297 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65765120-9eea-4d13-a783-4965674bc1ab None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:33.189582 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65765120-9eea-4d13-a783-4965674bc1ab None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:33.189858 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65765120-9eea-4d13-a783-4965674bc1ab None admin] PATH_INFO: `/v3/services/compute` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:33.190556 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65765120-9eea-4d13-a783-4965674bc1ab None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:33.191989 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65765120-9eea-4d13-a783-4965674bc1ab None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:33.199784 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:33.206098 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-65765120-9eea-4d13-a783-4965674bc1ab None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 01 04:14:33.206098 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:33.206098 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 04:14:33.206098 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 04:14:33.206098 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 04:14:33.206098 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 04:14:33.206098 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 04:14:33.206098 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:33.206098 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 01 04:14:33.206098 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:33.206098 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 04:14:33.206098 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:33.206098 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:33.206098 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:33.206098 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:33.206098 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:33.206098 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:33.207276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:33.207276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:33.207276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:33.207276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:33.207276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:33.207276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:33.207276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 04:14:33.207276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 04:14:33.207276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 04:14:33.207276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 04:14:33.207276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:33.207276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:33.207276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:33.207276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:33.207276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:33.207276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:33.208119 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:33.208119 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:33.208119 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:33.208119 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:33.208119 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:33.208119 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:33.208119 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:33.208119 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:33.208119 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:33.208119 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:33.208119 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 04:14:33.208119 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:33.208119 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 01 04:14:33.208119 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:33.208119 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 490/973] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:14:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:14:33.213521 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65765120-9eea-4d13-a783-4965674bc1ab None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:33.223803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:33.264698 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa5ac1-36da-4244-b8a3-5f3d2f30d064 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:33.302868 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6142aa6-0a00-4d3e-ac47-f3e162787147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:33.303534 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6142aa6-0a00-4d3e-ac47-f3e162787147 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:33.303815 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6142aa6-0a00-4d3e-ac47-f3e162787147 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:33.304090 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6142aa6-0a00-4d3e-ac47-f3e162787147 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:33.304836 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6142aa6-0a00-4d3e-ac47-f3e162787147 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:33.305139 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6142aa6-0a00-4d3e-ac47-f3e162787147 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:33.306552 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6142aa6-0a00-4d3e-ac47-f3e162787147 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:33.319070 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 484/974] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:14:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:33.324596 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6142aa6-0a00-4d3e-ac47-f3e162787147 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:33.333313 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65765120-9eea-4d13-a783-4965674bc1ab None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:33.370464 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05299b6f-845d-4850-820e-1e2ad9f486c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:33.371138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05299b6f-845d-4850-820e-1e2ad9f486c5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:33.371494 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05299b6f-845d-4850-820e-1e2ad9f486c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:33.371779 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05299b6f-845d-4850-820e-1e2ad9f486c5 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:33.372603 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05299b6f-845d-4850-820e-1e2ad9f486c5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:33.372913 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05299b6f-845d-4850-820e-1e2ad9f486c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:33.374301 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05299b6f-845d-4850-820e-1e2ad9f486c5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:33.379451 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 491/975] 10.222.0.32 () {56 vars in 1112 bytes} [Wed Jun 1 04:14:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:33.384765 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05299b6f-845d-4850-820e-1e2ad9f486c5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:33.436947 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6142aa6-0a00-4d3e-ac47-f3e162787147 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:33.440411 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:33.461734 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:33.478001 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf5834-22e0-4174-9be1-cdabf84ec324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:33.478827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf5834-22e0-4174-9be1-cdabf84ec324 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:33.479113 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf5834-22e0-4174-9be1-cdabf84ec324 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:33.479526 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf5834-22e0-4174-9be1-cdabf84ec324 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:33.487291 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf5834-22e0-4174-9be1-cdabf84ec324 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:33.488796 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf5834-22e0-4174-9be1-cdabf84ec324 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:33.495303 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05299b6f-845d-4850-820e-1e2ad9f486c5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:33.506087 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-00bf5834-22e0-4174-9be1-cdabf84ec324 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:14:33.506087 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:33.506087 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:33.506087 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:33.506087 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:33.506087 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:33.506087 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:33.506087 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:33.506087 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:33.506087 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:33.506087 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:33.506087 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:33.506087 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 04:14:33.506087 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 04:14:33.506087 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 04:14:33.507151 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 04:14:33.507151 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:33.507151 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:33.507151 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:33.507151 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:33.507151 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:33.507151 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:33.507151 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:33.507151 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:33.507151 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:33.507151 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:33.507151 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:33.507151 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:33.507151 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:33.507151 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:33.507151 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:33.507151 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:33.508084 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 04:14:33.508084 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 04:14:33.508084 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 04:14:33.508084 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 04:14:33.508084 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 04:14:33.508084 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 04:14:33.508084 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:14:33.508084 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:33.508084 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 485/976] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:14:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:14:33.512947 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf5834-22e0-4174-9be1-cdabf84ec324 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:33.538838 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662493f-84d7-427d-b9bd-cffef046d040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:33.539512 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662493f-84d7-427d-b9bd-cffef046d040 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:33.539795 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662493f-84d7-427d-b9bd-cffef046d040 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:33.540081 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662493f-84d7-427d-b9bd-cffef046d040 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:33.540791 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662493f-84d7-427d-b9bd-cffef046d040 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:33.541210 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662493f-84d7-427d-b9bd-cffef046d040 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:33.542512 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662493f-84d7-427d-b9bd-cffef046d040 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:33.547274 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 492/977] 10.222.0.32 () {56 vars in 1112 bytes} [Wed Jun 1 04:14:33 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:33.628492 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf5834-22e0-4174-9be1-cdabf84ec324 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:33.666661 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36cb72c-860d-4aaa-80f0-bfb2536b7e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:33.667344 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cb72c-860d-4aaa-80f0-bfb2536b7e75 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:33.667631 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cb72c-860d-4aaa-80f0-bfb2536b7e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:33.667943 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cb72c-860d-4aaa-80f0-bfb2536b7e75 None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:33.668743 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36cb72c-860d-4aaa-80f0-bfb2536b7e75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:33.669053 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36cb72c-860d-4aaa-80f0-bfb2536b7e75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:33.670597 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36cb72c-860d-4aaa-80f0-bfb2536b7e75 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:33.688948 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 486/978] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Jun 1 04:14:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:33.690312 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662493f-84d7-427d-b9bd-cffef046d040 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:33.803503 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662493f-84d7-427d-b9bd-cffef046d040 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:33.837748 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb81af5-c156-4f38-8478-c514fea14c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:33.838443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb81af5-c156-4f38-8478-c514fea14c7e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:33.838730 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb81af5-c156-4f38-8478-c514fea14c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:33.839007 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb81af5-c156-4f38-8478-c514fea14c7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:33.839836 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb81af5-c156-4f38-8478-c514fea14c7e None admin] RBAC: Adding query filter params (role.id=0f6437212f954ee1a3bdb42ffc3458e7, scope.project.id=31d68f64d21647688074554062952074, user.id=3fa2ad34164a4631adf76fbd042679ba) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:33.840149 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb81af5-c156-4f38-8478-c514fea14c7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:33.841576 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb81af5-c156-4f38-8478-c514fea14c7e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:33.843521 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:33.858028 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 493/979] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:14:33 2022] GET /identity/v3/role_assignments?user.id=3fa2ad34164a4631adf76fbd042679ba&scope.project.id=31d68f64d21647688074554062952074&role.id=0f6437212f954ee1a3bdb42ffc3458e7 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:35.045746 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdac8aa-e3b5-4a76-8913-28503cfe328b None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:35.046312 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdac8aa-e3b5-4a76-8913-28503cfe328b None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:35.046422 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdac8aa-e3b5-4a76-8913-28503cfe328b None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:35.047870 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 487/980] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:14:35.053679 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8318824-17ab-4f48-9e1c-a726ad05169f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:35.054131 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8318824-17ab-4f48-9e1c-a726ad05169f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:35.054324 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8318824-17ab-4f48-9e1c-a726ad05169f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:35.071469 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b8318824-17ab-4f48-9e1c-a726ad05169f None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:35.072645 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b8318824-17ab-4f48-9e1c-a726ad05169f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:35.139622 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 494/981] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:14:35.166340 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdac8aa-e3b5-4a76-8913-28503cfe328b None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:35.193438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:35.283464 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdac8aa-e3b5-4a76-8913-28503cfe328b None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:35.319168 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be568922-3ed7-4fe2-9f66-4a4afcd36ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:35.319898 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be568922-3ed7-4fe2-9f66-4a4afcd36ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:35.320177 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be568922-3ed7-4fe2-9f66-4a4afcd36ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:35.320450 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be568922-3ed7-4fe2-9f66-4a4afcd36ba6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:35.321090 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be568922-3ed7-4fe2-9f66-4a4afcd36ba6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:35.322483 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be568922-3ed7-4fe2-9f66-4a4afcd36ba6 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:35.335309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-be568922-3ed7-4fe2-9f66-4a4afcd36ba6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 01 04:14:35.335309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:35.335309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 04:14:35.335309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 04:14:35.335309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 04:14:35.335309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 04:14:35.335309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 04:14:35.335309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:35.335309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 01 04:14:35.335309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:35.335309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 04:14:35.335309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:35.335309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:35.335309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:35.335309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:35.335309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:35.335309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:35.336326 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:35.336326 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:35.336326 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:35.336326 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:35.336326 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:35.336326 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:35.336326 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 04:14:35.336326 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 04:14:35.336326 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 04:14:35.336326 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 04:14:35.336326 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:35.336326 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:35.336326 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:35.336326 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:35.336326 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:35.336326 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:35.337163 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:35.337163 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:35.337163 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:35.337163 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:35.337163 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:35.337163 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:35.337163 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:35.337163 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:35.337163 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:35.337163 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:35.337163 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 04:14:35.337163 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:35.337163 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 01 04:14:35.337163 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:35.337163 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 488/982] 10.222.0.32 () {56 vars in 1126 bytes} [Wed Jun 1 04:14:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:35.344022 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8318824-17ab-4f48-9e1c-a726ad05169f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:35.444965 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8318824-17ab-4f48-9e1c-a726ad05169f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:35.471866 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:35.481196 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855089a-2fc0-401e-adb8-0bb106764d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:35.481867 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855089a-2fc0-401e-adb8-0bb106764d85 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:35.482178 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855089a-2fc0-401e-adb8-0bb106764d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:35.482454 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855089a-2fc0-401e-adb8-0bb106764d85 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:35.483156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855089a-2fc0-401e-adb8-0bb106764d85 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:35.483458 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855089a-2fc0-401e-adb8-0bb106764d85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:35.484838 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855089a-2fc0-401e-adb8-0bb106764d85 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:35.494816 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 495/983] 10.222.0.32 () {56 vars in 1122 bytes} [Wed Jun 1 04:14:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:35.495797 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be568922-3ed7-4fe2-9f66-4a4afcd36ba6 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:35.591552 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:35.605206 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be568922-3ed7-4fe2-9f66-4a4afcd36ba6 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:35.639720 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371315f-553e-4ddc-b3b6-c9b5c45dc874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:35.640396 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371315f-553e-4ddc-b3b6-c9b5c45dc874 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:35.640688 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371315f-553e-4ddc-b3b6-c9b5c45dc874 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:35.641008 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371315f-553e-4ddc-b3b6-c9b5c45dc874 None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:35.641706 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371315f-553e-4ddc-b3b6-c9b5c45dc874 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:35.642046 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371315f-553e-4ddc-b3b6-c9b5c45dc874 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:35.643539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371315f-553e-4ddc-b3b6-c9b5c45dc874 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:35.648788 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 489/984] 10.222.0.32 () {56 vars in 1122 bytes} [Wed Jun 1 04:14:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:35.654399 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855089a-2fc0-401e-adb8-0bb106764d85 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:35.756642 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855089a-2fc0-401e-adb8-0bb106764d85 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:35.791690 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b5870-ca86-4b86-9bb7-fa2c1961e668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:35.792383 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b5870-ca86-4b86-9bb7-fa2c1961e668 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:35.792665 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b5870-ca86-4b86-9bb7-fa2c1961e668 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:35.792941 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b5870-ca86-4b86-9bb7-fa2c1961e668 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:35.793765 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b5870-ca86-4b86-9bb7-fa2c1961e668 None admin] RBAC: Adding query filter params (interface=admin, service_id=c843ba4048fc456a81cd2816de0bc4ff, region_id=RegionOne) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:35.794111 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b5870-ca86-4b86-9bb7-fa2c1961e668 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:35.795468 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b5870-ca86-4b86-9bb7-fa2c1961e668 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:35.805546 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 496/985] 10.222.0.32 () {56 vars in 1249 bytes} [Wed Jun 1 04:14:35 2022] GET /identity/v3/endpoints?service_id=c843ba4048fc456a81cd2816de0bc4ff&interface=admin®ion_id=RegionOne => generated 193 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:35.806914 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371315f-553e-4ddc-b3b6-c9b5c45dc874 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:35.848850 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9eb35b-bb7e-4e5b-aff6-3fefaa534fd3 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:35.849060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9eb35b-bb7e-4e5b-aff6-3fefaa534fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:35.849417 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9eb35b-bb7e-4e5b-aff6-3fefaa534fd3 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:35.850817 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 497/986] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:14:35.856668 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4b91b-79dd-4e98-bcee-08c1923cbd0c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:35.856982 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4b91b-79dd-4e98-bcee-08c1923cbd0c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:35.857240 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4b91b-79dd-4e98-bcee-08c1923cbd0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:35.873775 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-52b4b91b-79dd-4e98-bcee-08c1923cbd0c None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:35.874994 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-52b4b91b-79dd-4e98-bcee-08c1923cbd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:35.925860 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371315f-553e-4ddc-b3b6-c9b5c45dc874 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:35.934005 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:35.953581 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 498/987] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 04:14:35.963156 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d19e5-3275-47f9-8656-fa08b0edfeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:35.963829 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d19e5-3275-47f9-8656-fa08b0edfeb4 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:35.964113 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d19e5-3275-47f9-8656-fa08b0edfeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:35.964392 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d19e5-3275-47f9-8656-fa08b0edfeb4 None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:35.965084 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d19e5-3275-47f9-8656-fa08b0edfeb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:35.966486 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d19e5-3275-47f9-8656-fa08b0edfeb4 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:35.973395 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 490/988] 10.222.0.32 () {56 vars in 1087 bytes} [Wed Jun 1 04:14:35 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:14:35.979592 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4b91b-79dd-4e98-bcee-08c1923cbd0c None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:36.094089 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4b91b-79dd-4e98-bcee-08c1923cbd0c None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:36.132298 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120d497-e5d1-4a21-90dd-6305939ee427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:36.132911 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120d497-e5d1-4a21-90dd-6305939ee427 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:36.133183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120d497-e5d1-4a21-90dd-6305939ee427 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:36.133465 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120d497-e5d1-4a21-90dd-6305939ee427 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:36.134229 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120d497-e5d1-4a21-90dd-6305939ee427 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:36.135643 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120d497-e5d1-4a21-90dd-6305939ee427 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:36.155066 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 499/989] 10.222.0.32 () {60 vars in 1141 bytes} [Wed Jun 1 04:14:35 2022] POST /identity/v3/services => generated 242 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:14:36.174818 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf7993-4f1d-44d0-97d3-b890ece41077 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:36.175392 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf7993-4f1d-44d0-97d3-b890ece41077 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:36.175392 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf7993-4f1d-44d0-97d3-b890ece41077 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:36.177031 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 491/990] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:14:36.183420 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b32a8-51c4-4e43-b0dd-9d5bb3783d80 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:36.183713 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b32a8-51c4-4e43-b0dd-9d5bb3783d80 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:36.183995 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b32a8-51c4-4e43-b0dd-9d5bb3783d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:36.202982 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d77b32a8-51c4-4e43-b0dd-9d5bb3783d80 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:36.204197 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d77b32a8-51c4-4e43-b0dd-9d5bb3783d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:36.252307 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:36.290399 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 500/991] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:36 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:14:36.313698 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf7993-4f1d-44d0-97d3-b890ece41077 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:36.335420 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:36.429415 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf7993-4f1d-44d0-97d3-b890ece41077 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:36.464746 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5046a83-7c60-47bd-b279-f9844014cf53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:36.465990 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5046a83-7c60-47bd-b279-f9844014cf53 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:36.466484 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5046a83-7c60-47bd-b279-f9844014cf53 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:36.466964 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5046a83-7c60-47bd-b279-f9844014cf53 None admin] PATH_INFO: `/v3/services/image` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:36.467818 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5046a83-7c60-47bd-b279-f9844014cf53 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:36.469406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5046a83-7c60-47bd-b279-f9844014cf53 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:36.481924 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-b5046a83-7c60-47bd-b279-f9844014cf53 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 01 04:14:36.481924 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:36.481924 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 04:14:36.481924 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 04:14:36.481924 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 04:14:36.481924 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 04:14:36.481924 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 04:14:36.481924 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:36.481924 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 01 04:14:36.481924 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:36.481924 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 04:14:36.481924 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:36.481924 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:36.481924 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:36.481924 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:36.481924 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:36.481924 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:36.482986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:36.482986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:36.482986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:36.482986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:36.482986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:36.482986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:36.482986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 04:14:36.482986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 04:14:36.482986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 04:14:36.482986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 04:14:36.482986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:36.482986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:36.482986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:36.482986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:36.482986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:36.482986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:36.483839 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:36.483839 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:36.483839 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:36.483839 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:36.483839 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:36.483839 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:36.483839 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:36.483839 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:36.483839 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:36.483839 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:36.483839 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 04:14:36.483839 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:36.483839 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 01 04:14:36.483839 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:36.486057 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 492/992] 10.222.0.32 () {56 vars in 1105 bytes} [Wed Jun 1 04:14:36 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:36.490694 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b32a8-51c4-4e43-b0dd-9d5bb3783d80 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:36.593549 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b32a8-51c4-4e43-b0dd-9d5bb3783d80 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:36.627997 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39701682-d574-40f9-be66-aeacd4a33038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:36.629229 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39701682-d574-40f9-be66-aeacd4a33038 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:36.629511 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39701682-d574-40f9-be66-aeacd4a33038 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:36.629783 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39701682-d574-40f9-be66-aeacd4a33038 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:36.630511 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39701682-d574-40f9-be66-aeacd4a33038 None admin] RBAC: Adding query filter params (name=image) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:36.630817 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39701682-d574-40f9-be66-aeacd4a33038 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:36.632175 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39701682-d574-40f9-be66-aeacd4a33038 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:36.641688 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 501/993] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:14:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:36.642849 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5046a83-7c60-47bd-b279-f9844014cf53 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:36.733539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:36.758324 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5046a83-7c60-47bd-b279-f9844014cf53 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:36.800695 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a34ff5-2565-44d8-9af4-cfee999d7525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:36.801368 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a34ff5-2565-44d8-9af4-cfee999d7525 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:36.801655 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a34ff5-2565-44d8-9af4-cfee999d7525 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:36.801936 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a34ff5-2565-44d8-9af4-cfee999d7525 None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:36.802675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a34ff5-2565-44d8-9af4-cfee999d7525 None admin] RBAC: Adding query filter params (type=image) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:36.802982 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a34ff5-2565-44d8-9af4-cfee999d7525 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:36.804351 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a34ff5-2565-44d8-9af4-cfee999d7525 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:36.818022 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 493/994] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:14:36 2022] GET /identity/v3/services?type=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:38.302753 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28912b-30c2-419e-ad84-ba116d693c60 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:38.303471 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28912b-30c2-419e-ad84-ba116d693c60 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:38.303471 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28912b-30c2-419e-ad84-ba116d693c60 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:38.304855 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 502/995] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:14:38.310442 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b53c07-b26b-4484-b180-110d213391e8 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:38.310913 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b53c07-b26b-4484-b180-110d213391e8 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:38.311025 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b53c07-b26b-4484-b180-110d213391e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:38.334456 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-79b53c07-b26b-4484-b180-110d213391e8 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:38.335777 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-79b53c07-b26b-4484-b180-110d213391e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:38.419809 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 494/996] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:38 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:14:38.443629 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28912b-30c2-419e-ad84-ba116d693c60 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:38.464211 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72adadf1-9619-4192-b771-a8fe7502c34c None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:38.464605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72adadf1-9619-4192-b771-a8fe7502c34c None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:38.464896 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72adadf1-9619-4192-b771-a8fe7502c34c None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:38.466406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 495/997] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:14:38.473945 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c352f3-e500-4e40-a521-2ec16d7e3fe8 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:38.474323 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c352f3-e500-4e40-a521-2ec16d7e3fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:38.474712 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c352f3-e500-4e40-a521-2ec16d7e3fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:38.488191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:38.497466 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-65c352f3-e500-4e40-a521-2ec16d7e3fe8 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:38.498701 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-65c352f3-e500-4e40-a521-2ec16d7e3fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:38.570296 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28912b-30c2-419e-ad84-ba116d693c60 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:38.581889 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 496/998] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:38 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:14:38.607512 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c352f3-e500-4e40-a521-2ec16d7e3fe8 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:38.610862 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:38.617278 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126c14d-bbe1-49be-a221-55bbb4ce32e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:38.618294 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126c14d-bbe1-49be-a221-55bbb4ce32e9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:38.618700 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126c14d-bbe1-49be-a221-55bbb4ce32e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:38.620926 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126c14d-bbe1-49be-a221-55bbb4ce32e9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:38.620926 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126c14d-bbe1-49be-a221-55bbb4ce32e9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:38.620926 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126c14d-bbe1-49be-a221-55bbb4ce32e9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:38.639103 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-0126c14d-bbe1-49be-a221-55bbb4ce32e9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 01 04:14:38.639103 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:38.639103 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 04:14:38.639103 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 04:14:38.639103 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 04:14:38.639103 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 04:14:38.639103 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 04:14:38.639103 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:38.639103 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 01 04:14:38.639103 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:38.639103 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 04:14:38.639103 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:38.639103 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:38.639103 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:38.639103 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:38.639103 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:38.639103 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:38.640402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:38.640402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:38.640402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:38.640402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:38.640402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:38.640402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:38.640402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 04:14:38.640402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 04:14:38.640402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 04:14:38.640402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 04:14:38.640402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:38.640402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:38.640402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:38.640402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:38.640402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:38.640402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:38.641452 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:38.641452 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:38.641452 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:38.641452 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:38.641452 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:38.641452 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:38.641452 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:38.641452 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:38.641452 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:38.641452 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:38.641452 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 04:14:38.641452 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:38.641452 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 01 04:14:38.641452 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:38.641452 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 503/999] 10.222.0.32 () {56 vars in 1126 bytes} [Wed Jun 1 04:14:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:38.647286 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126c14d-bbe1-49be-a221-55bbb4ce32e9 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:38.752009 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c352f3-e500-4e40-a521-2ec16d7e3fe8 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:38.780363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:38.784287 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126c14d-bbe1-49be-a221-55bbb4ce32e9 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:38.797685 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1843089-5c25-4c0a-b50b-c3ea0fd69398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:38.798787 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1843089-5c25-4c0a-b50b-c3ea0fd69398 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:38.799264 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1843089-5c25-4c0a-b50b-c3ea0fd69398 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:38.799696 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1843089-5c25-4c0a-b50b-c3ea0fd69398 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:38.800562 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1843089-5c25-4c0a-b50b-c3ea0fd69398 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:38.802182 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1843089-5c25-4c0a-b50b-c3ea0fd69398 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:38.818893 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-a1843089-5c25-4c0a-b50b-c3ea0fd69398 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 01 04:14:38.818893 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:38.818893 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 04:14:38.818893 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 04:14:38.818893 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 04:14:38.818893 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 04:14:38.818893 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 04:14:38.818893 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:38.818893 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 01 04:14:38.818893 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:38.818893 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 04:14:38.818893 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:38.818893 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:38.818893 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:38.818893 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:38.818893 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:38.818893 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:38.820885 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:38.820885 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:38.820885 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:38.820885 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:38.820885 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:38.820885 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:38.820885 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 04:14:38.820885 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 04:14:38.820885 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 04:14:38.820885 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 04:14:38.820885 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:38.820885 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:38.820885 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:38.820885 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:38.820885 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:38.820885 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:38.822261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:38.822261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:38.822261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:38.822261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:38.822261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:38.822261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:38.822261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:38.822261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:38.822261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:38.822261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:38.822261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 04:14:38.822261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:38.822261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 01 04:14:38.822261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:38.822261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 497/1000] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:14:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:38.827407 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1843089-5c25-4c0a-b50b-c3ea0fd69398 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:38.838354 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af79bff-afe1-4e5e-8b4b-d1430e484c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:38.839217 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af79bff-afe1-4e5e-8b4b-d1430e484c28 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:38.839652 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af79bff-afe1-4e5e-8b4b-d1430e484c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:38.839991 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af79bff-afe1-4e5e-8b4b-d1430e484c28 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:38.840804 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af79bff-afe1-4e5e-8b4b-d1430e484c28 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:38.841148 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af79bff-afe1-4e5e-8b4b-d1430e484c28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:38.842972 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af79bff-afe1-4e5e-8b4b-d1430e484c28 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:38.857035 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 504/1001] 10.222.0.32 () {56 vars in 1122 bytes} [Wed Jun 1 04:14:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:38.858198 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af79bff-afe1-4e5e-8b4b-d1430e484c28 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:38.910316 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:38.956994 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1843089-5c25-4c0a-b50b-c3ea0fd69398 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:38.997943 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af79bff-afe1-4e5e-8b4b-d1430e484c28 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:39.006179 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e1cd7-b1b3-46ce-b5f0-ee5d35f90fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:39.007673 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e1cd7-b1b3-46ce-b5f0-ee5d35f90fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:39.008083 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e1cd7-b1b3-46ce-b5f0-ee5d35f90fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:39.008363 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e1cd7-b1b3-46ce-b5f0-ee5d35f90fb5 None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:39.009923 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e1cd7-b1b3-46ce-b5f0-ee5d35f90fb5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:39.010590 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e1cd7-b1b3-46ce-b5f0-ee5d35f90fb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:39.013261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e1cd7-b1b3-46ce-b5f0-ee5d35f90fb5 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:39.020345 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 498/1002] 10.222.0.32 () {56 vars in 1112 bytes} [Wed Jun 1 04:14:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:39.026300 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e1cd7-b1b3-46ce-b5f0-ee5d35f90fb5 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:39.040245 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc35d83-36cd-4e81-97b2-14f44f5ab427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:39.041349 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc35d83-36cd-4e81-97b2-14f44f5ab427 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:39.041643 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc35d83-36cd-4e81-97b2-14f44f5ab427 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:39.042120 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc35d83-36cd-4e81-97b2-14f44f5ab427 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:39.042865 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc35d83-36cd-4e81-97b2-14f44f5ab427 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:39.043218 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc35d83-36cd-4e81-97b2-14f44f5ab427 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:39.044811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc35d83-36cd-4e81-97b2-14f44f5ab427 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:39.051425 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 505/1003] 10.222.0.32 () {56 vars in 1122 bytes} [Wed Jun 1 04:14:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:39.057722 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc35d83-36cd-4e81-97b2-14f44f5ab427 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:39.096552 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:39.153165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e1cd7-b1b3-46ce-b5f0-ee5d35f90fb5 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:39.186786 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:39.193043 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525acf1-5b1d-4aee-b4da-23f33a8ba6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:39.193709 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525acf1-5b1d-4aee-b4da-23f33a8ba6dc None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:39.194002 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525acf1-5b1d-4aee-b4da-23f33a8ba6dc None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:39.194294 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525acf1-5b1d-4aee-b4da-23f33a8ba6dc None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:39.195001 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525acf1-5b1d-4aee-b4da-23f33a8ba6dc None admin] RBAC: Adding query filter params (type=compute) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:39.195304 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525acf1-5b1d-4aee-b4da-23f33a8ba6dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:39.196674 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525acf1-5b1d-4aee-b4da-23f33a8ba6dc None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:39.202080 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 499/1004] 10.222.0.32 () {56 vars in 1112 bytes} [Wed Jun 1 04:14:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:39.203012 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc35d83-36cd-4e81-97b2-14f44f5ab427 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:39.203598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cec99d-a9ba-4fea-a456-4771c0d9d962 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:39.203888 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cec99d-a9ba-4fea-a456-4771c0d9d962 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:39.204173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cec99d-a9ba-4fea-a456-4771c0d9d962 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:39.206013 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 500/1005] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:14:39.209063 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cec99d-a9ba-4fea-a456-4771c0d9d962 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:39.248527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6fb08-32a8-4464-83b2-639b2d86bf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:39.249297 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6fb08-32a8-4464-83b2-639b2d86bf97 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:39.249671 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6fb08-32a8-4464-83b2-639b2d86bf97 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:39.250000 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6fb08-32a8-4464-83b2-639b2d86bf97 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:39.250783 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6fb08-32a8-4464-83b2-639b2d86bf97 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:39.252559 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6fb08-32a8-4464-83b2-639b2d86bf97 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:39.270108 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 506/1006] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Jun 1 04:14:39 2022] POST /identity/v3/endpoints => generated 325 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:14:39.271481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900209bf-be4c-4991-afc1-b3ace3431eb5 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:39.272123 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900209bf-be4c-4991-afc1-b3ace3431eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:39.272123 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900209bf-be4c-4991-afc1-b3ace3431eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:39.294505 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-900209bf-be4c-4991-afc1-b3ace3431eb5 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:39.296091 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-900209bf-be4c-4991-afc1-b3ace3431eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:39.353759 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cec99d-a9ba-4fea-a456-4771c0d9d962 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:39.392052 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 507/1007] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:39 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:14:39.415727 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab426f1-3194-4b10-b558-fbb08bfb44a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:39.416672 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab426f1-3194-4b10-b558-fbb08bfb44a8 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:39.416963 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab426f1-3194-4b10-b558-fbb08bfb44a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:39.417240 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab426f1-3194-4b10-b558-fbb08bfb44a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:39.417509 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900209bf-be4c-4991-afc1-b3ace3431eb5 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:39.418165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab426f1-3194-4b10-b558-fbb08bfb44a8 None admin] RBAC: Adding query filter params (interface=public, service_id=0f7aafc4a7d74c3fbb15aea2b858fdb3, region_id=RegionOne) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:39.418482 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab426f1-3194-4b10-b558-fbb08bfb44a8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:39.419998 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab426f1-3194-4b10-b558-fbb08bfb44a8 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:39.429211 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 501/1008] 10.222.0.32 () {56 vars in 1251 bytes} [Wed Jun 1 04:14:39 2022] GET /identity/v3/endpoints?service_id=0f7aafc4a7d74c3fbb15aea2b858fdb3&interface=public®ion_id=RegionOne => generated 194 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:39.435348 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab426f1-3194-4b10-b558-fbb08bfb44a8 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:39.446373 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:39.513679 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:39.566734 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900209bf-be4c-4991-afc1-b3ace3431eb5 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:39.572440 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab426f1-3194-4b10-b558-fbb08bfb44a8 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:39.603695 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc715c0-e9ae-457f-9500-827e7579590c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:39.604366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc715c0-e9ae-457f-9500-827e7579590c None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:39.604649 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc715c0-e9ae-457f-9500-827e7579590c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:39.604924 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc715c0-e9ae-457f-9500-827e7579590c None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:39.605665 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc715c0-e9ae-457f-9500-827e7579590c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:39.607073 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc715c0-e9ae-457f-9500-827e7579590c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:39.622153 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 508/1009] 10.222.0.32 () {60 vars in 1141 bytes} [Wed Jun 1 04:14:39 2022] POST /identity/v3/services => generated 242 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:14:39.646213 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9e5d7-c32f-4046-9ddf-658afe160c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:39.647294 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9e5d7-c32f-4046-9ddf-658afe160c80 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:39.647818 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9e5d7-c32f-4046-9ddf-658afe160c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:39.648322 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9e5d7-c32f-4046-9ddf-658afe160c80 None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:39.649238 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9e5d7-c32f-4046-9ddf-658afe160c80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:39.650909 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9e5d7-c32f-4046-9ddf-658afe160c80 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:39.667457 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 502/1010] 10.222.0.32 () {56 vars in 1087 bytes} [Wed Jun 1 04:14:39 2022] GET /identity/v3/services => generated 1957 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:14:41.636051 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cd0ef-a41c-4389-a384-23499dd60495 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:41.636657 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cd0ef-a41c-4389-a384-23499dd60495 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:41.636657 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cd0ef-a41c-4389-a384-23499dd60495 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:41.638217 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 509/1011] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:14:41.645181 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7205d-3449-46a3-9118-74002e205bbd None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:41.645763 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7205d-3449-46a3-9118-74002e205bbd None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:41.645763 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7205d-3449-46a3-9118-74002e205bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:41.664278 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-34b7205d-3449-46a3-9118-74002e205bbd None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:41.665501 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-34b7205d-3449-46a3-9118-74002e205bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:41.738576 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 503/1012] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:41 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:14:41.762126 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7cd0ef-a41c-4389-a384-23499dd60495 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:41.843372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:41.869398 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7cd0ef-a41c-4389-a384-23499dd60495 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:41.908897 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e594e-0d41-4803-84f4-493d9608705c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:41.909626 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e594e-0d41-4803-84f4-493d9608705c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:41.909911 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e594e-0d41-4803-84f4-493d9608705c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:41.910285 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e594e-0d41-4803-84f4-493d9608705c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:41.911590 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e594e-0d41-4803-84f4-493d9608705c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:41.913130 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e594e-0d41-4803-84f4-493d9608705c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:41.915233 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 510/1013] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:14:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:41.921075 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b7205d-3449-46a3-9118-74002e205bbd None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:41.971931 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:41.978803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947e40c-7a6f-40d4-ba52-f4454bc4a0f0 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:41.979147 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947e40c-7a6f-40d4-ba52-f4454bc4a0f0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:41.979377 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947e40c-7a6f-40d4-ba52-f4454bc4a0f0 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:41.980946 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 511/1014] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:14:41.986223 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa688e10-6052-4ce4-8527-5c6a44d31b63 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:41.986508 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa688e10-6052-4ce4-8527-5c6a44d31b63 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:41.986784 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa688e10-6052-4ce4-8527-5c6a44d31b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:42.005364 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-fa688e10-6052-4ce4-8527-5c6a44d31b63 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:42.006591 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-fa688e10-6052-4ce4-8527-5c6a44d31b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:42.033071 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b7205d-3449-46a3-9118-74002e205bbd None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:42.070080 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247a64d-3545-43e2-be47-975988efe0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:42.070735 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247a64d-3545-43e2-be47-975988efe0f9 None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:42.071015 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247a64d-3545-43e2-be47-975988efe0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:42.071291 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247a64d-3545-43e2-be47-975988efe0f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:42.072000 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247a64d-3545-43e2-be47-975988efe0f9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:42.073411 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247a64d-3545-43e2-be47-975988efe0f9 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:42.074710 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 512/1015] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:41 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 04:14:42.076048 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a238ba-af4c-43ef-8551-ec9f468c3245 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:42.076332 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a238ba-af4c-43ef-8551-ec9f468c3245 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:42.076611 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a238ba-af4c-43ef-8551-ec9f468c3245 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:42.078039 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 513/1016] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:14:42.083743 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b40893-d934-4d2e-9a95-a67b915dcdb0 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:42.084045 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b40893-d934-4d2e-9a95-a67b915dcdb0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:42.084326 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b40893-d934-4d2e-9a95-a67b915dcdb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:42.101868 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-16b40893-d934-4d2e-9a95-a67b915dcdb0 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:42.103097 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-16b40893-d934-4d2e-9a95-a67b915dcdb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:42.106096 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 504/1017] 10.222.0.32 () {60 vars in 1141 bytes} [Wed Jun 1 04:14:41 2022] POST /identity/v3/projects => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:14:42.106939 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247a64d-3545-43e2-be47-975988efe0f9 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:42.184053 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 514/1018] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:42 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:14:42.207411 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b40893-d934-4d2e-9a95-a67b915dcdb0 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:42.217041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:42.224196 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:42.228829 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247a64d-3545-43e2-be47-975988efe0f9 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:42.270308 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5d145-a929-4893-8eae-7b4cb064a962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:42.271125 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5d145-a929-4893-8eae-7b4cb064a962 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:42.271449 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5d145-a929-4893-8eae-7b4cb064a962 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:42.271694 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5d145-a929-4893-8eae-7b4cb064a962 None admin] PATH_INFO: `/v3/services/image` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:42.272366 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5d145-a929-4893-8eae-7b4cb064a962 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:42.274124 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5d145-a929-4893-8eae-7b4cb064a962 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:42.287506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-c2b5d145-a929-4893-8eae-7b4cb064a962 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 01 04:14:42.287506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:42.287506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 04:14:42.287506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 04:14:42.287506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 04:14:42.287506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 04:14:42.287506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 04:14:42.287506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:42.287506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 01 04:14:42.287506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:42.287506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 04:14:42.287506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:42.287506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:42.287506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:42.287506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:42.287506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:42.287506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:42.288732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:42.288732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:42.288732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:42.288732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:42.288732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:42.288732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:42.288732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 04:14:42.288732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 04:14:42.288732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 04:14:42.288732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 04:14:42.288732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:42.288732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:42.288732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:42.288732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:42.288732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:42.288732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:42.289657 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:42.289657 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:42.289657 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:42.289657 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:42.289657 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:42.289657 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:42.289657 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:42.289657 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:42.289657 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:42.289657 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:42.289657 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 04:14:42.289657 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:42.289657 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 01 04:14:42.289657 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:42.289657 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 505/1019] 10.222.0.32 () {56 vars in 1105 bytes} [Wed Jun 1 04:14:42 2022] GET /identity/v3/services/image => generated 86 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:42.295402 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5d145-a929-4893-8eae-7b4cb064a962 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:42.328830 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b40893-d934-4d2e-9a95-a67b915dcdb0 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:42.373265 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc054b-44af-4d2d-b3a1-362d6989399b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:42.374128 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc054b-44af-4d2d-b3a1-362d6989399b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:42.374413 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc054b-44af-4d2d-b3a1-362d6989399b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:42.375994 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc054b-44af-4d2d-b3a1-362d6989399b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:42.375994 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc054b-44af-4d2d-b3a1-362d6989399b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:42.376714 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc054b-44af-4d2d-b3a1-362d6989399b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:42.389656 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-c2dc054b-44af-4d2d-b3a1-362d6989399b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 01 04:14:42.389656 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:42.389656 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 04:14:42.389656 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 04:14:42.389656 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 04:14:42.389656 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 04:14:42.389656 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 04:14:42.389656 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:42.389656 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 01 04:14:42.389656 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:42.389656 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 04:14:42.389656 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:42.389656 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:42.389656 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:42.389656 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:42.389656 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:42.389656 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:42.390954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:42.390954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:42.390954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:42.390954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:42.390954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:42.390954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:42.390954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 04:14:42.390954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 04:14:42.390954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 04:14:42.390954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 04:14:42.390954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:42.390954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:42.390954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:42.390954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:42.390954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:42.390954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:42.391804 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:42.391804 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:42.391804 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:42.391804 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:42.391804 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:42.391804 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:42.391804 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:42.391804 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:42.391804 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:42.391804 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:42.391804 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 04:14:42.391804 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:42.391804 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 01 04:14:42.391804 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:42.391804 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 515/1020] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:14:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:14:42.397475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc054b-44af-4d2d-b3a1-362d6989399b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:42.444857 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5d145-a929-4893-8eae-7b4cb064a962 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:42.497678 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7346ba-dec2-4b59-96c7-78bca3fd4631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:42.498712 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7346ba-dec2-4b59-96c7-78bca3fd4631 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:42.499172 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7346ba-dec2-4b59-96c7-78bca3fd4631 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:42.499627 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7346ba-dec2-4b59-96c7-78bca3fd4631 None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:42.500529 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7346ba-dec2-4b59-96c7-78bca3fd4631 None admin] RBAC: Adding query filter params (name=image) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:42.501030 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7346ba-dec2-4b59-96c7-78bca3fd4631 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:42.503444 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7346ba-dec2-4b59-96c7-78bca3fd4631 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:42.504653 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:42.510331 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 506/1021] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:14:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:42.516015 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7346ba-dec2-4b59-96c7-78bca3fd4631 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:42.544655 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc054b-44af-4d2d-b3a1-362d6989399b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:42.545574 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:42.583609 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48910a-0ad2-4e3a-8577-c68255e9a26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:42.584520 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48910a-0ad2-4e3a-8577-c68255e9a26c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:42.585091 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48910a-0ad2-4e3a-8577-c68255e9a26c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:42.585382 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48910a-0ad2-4e3a-8577-c68255e9a26c None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:42.586375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e48910a-0ad2-4e3a-8577-c68255e9a26c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:42.586857 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e48910a-0ad2-4e3a-8577-c68255e9a26c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:42.588231 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e48910a-0ad2-4e3a-8577-c68255e9a26c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:42.598324 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 516/1022] 10.222.0.32 () {56 vars in 1112 bytes} [Wed Jun 1 04:14:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:42.599860 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48910a-0ad2-4e3a-8577-c68255e9a26c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:42.629535 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7346ba-dec2-4b59-96c7-78bca3fd4631 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:42.667440 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f5a91-5ea8-4eeb-8535-09b5e6bc2fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:42.668122 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f5a91-5ea8-4eeb-8535-09b5e6bc2fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:42.668380 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f5a91-5ea8-4eeb-8535-09b5e6bc2fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:42.668657 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f5a91-5ea8-4eeb-8535-09b5e6bc2fc8 None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:42.669365 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f5a91-5ea8-4eeb-8535-09b5e6bc2fc8 None admin] RBAC: Adding query filter params (type=image) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:42.669675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f5a91-5ea8-4eeb-8535-09b5e6bc2fc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:42.671114 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f5a91-5ea8-4eeb-8535-09b5e6bc2fc8 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:42.676551 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 507/1023] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:14:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:42.682365 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f5a91-5ea8-4eeb-8535-09b5e6bc2fc8 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:42.712672 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48910a-0ad2-4e3a-8577-c68255e9a26c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:42.750760 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e23606-0ea5-4cb7-8814-d21ccf626ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:42.751434 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e23606-0ea5-4cb7-8814-d21ccf626ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:42.751720 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e23606-0ea5-4cb7-8814-d21ccf626ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:42.751997 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e23606-0ea5-4cb7-8814-d21ccf626ab2 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:42.752705 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e23606-0ea5-4cb7-8814-d21ccf626ab2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:42.753048 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e23606-0ea5-4cb7-8814-d21ccf626ab2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:42.754547 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e23606-0ea5-4cb7-8814-d21ccf626ab2 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:42.756019 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:42.761806 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 517/1024] 10.222.0.32 () {56 vars in 1112 bytes} [Wed Jun 1 04:14:42 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:42.768593 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e23606-0ea5-4cb7-8814-d21ccf626ab2 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:42.784926 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:42.796940 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f5a91-5ea8-4eeb-8535-09b5e6bc2fc8 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:42.836715 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa999502-51ac-4093-9227-b0b3ff60aefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:42.837472 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa999502-51ac-4093-9227-b0b3ff60aefd None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:42.837755 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa999502-51ac-4093-9227-b0b3ff60aefd None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:42.838058 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa999502-51ac-4093-9227-b0b3ff60aefd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:42.838847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa999502-51ac-4093-9227-b0b3ff60aefd None admin] RBAC: Adding query filter params (interface=public, service_id=0c1ee148bdc2498596d9e1ad413d6f3d, region_id=RegionOne) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:42.839383 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa999502-51ac-4093-9227-b0b3ff60aefd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:42.840512 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa999502-51ac-4093-9227-b0b3ff60aefd None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:42.851172 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 508/1025] 10.222.0.32 () {56 vars in 1251 bytes} [Wed Jun 1 04:14:42 2022] GET /identity/v3/endpoints?service_id=0c1ee148bdc2498596d9e1ad413d6f3d&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:42.852319 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa999502-51ac-4093-9227-b0b3ff60aefd None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:42.890434 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e23606-0ea5-4cb7-8814-d21ccf626ab2 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:42.927037 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546aeb2-91a2-4695-99bb-0431ce513faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:42.927710 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546aeb2-91a2-4695-99bb-0431ce513faf None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:42.927987 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546aeb2-91a2-4695-99bb-0431ce513faf None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:42.928264 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546aeb2-91a2-4695-99bb-0431ce513faf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:42.929004 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9546aeb2-91a2-4695-99bb-0431ce513faf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:42.930413 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9546aeb2-91a2-4695-99bb-0431ce513faf None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:42.953034 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 518/1026] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Jun 1 04:14:42 2022] POST /identity/v3/endpoints => generated 334 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:14:42.970825 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa999502-51ac-4093-9227-b0b3ff60aefd None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:43.023379 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12eb124-4ba5-4df3-891e-43bced13ffb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:43.024073 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12eb124-4ba5-4df3-891e-43bced13ffb5 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:43.024356 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12eb124-4ba5-4df3-891e-43bced13ffb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:43.024634 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12eb124-4ba5-4df3-891e-43bced13ffb5 None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:43.025342 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12eb124-4ba5-4df3-891e-43bced13ffb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:43.026796 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12eb124-4ba5-4df3-891e-43bced13ffb5 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:43.042029 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 509/1027] 10.222.0.32 () {56 vars in 1087 bytes} [Wed Jun 1 04:14:42 2022] GET /identity/v3/services => generated 1957 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 04:14:44.490747 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765d396-2f81-48dc-b820-f9f722b1a2c3 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:44.491273 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765d396-2f81-48dc-b820-f9f722b1a2c3 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:44.491445 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765d396-2f81-48dc-b820-f9f722b1a2c3 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:44.492823 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 519/1028] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:14:44.497968 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974c61a-460e-4f12-8b79-e671938aff8d None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:44.498419 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974c61a-460e-4f12-8b79-e671938aff8d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:44.498598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974c61a-460e-4f12-8b79-e671938aff8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:44.515804 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-c974c61a-460e-4f12-8b79-e671938aff8d None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:44.517216 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c974c61a-460e-4f12-8b79-e671938aff8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:44.527793 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:44.590117 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 510/1029] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:14:44.613143 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765d396-2f81-48dc-b820-f9f722b1a2c3 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:44.672536 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:44.722418 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765d396-2f81-48dc-b820-f9f722b1a2c3 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:44.756744 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1796e3e-9c22-466f-8eef-09c7939a23cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:44.757470 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1796e3e-9c22-466f-8eef-09c7939a23cf None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:44.757755 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1796e3e-9c22-466f-8eef-09c7939a23cf None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:44.758058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1796e3e-9c22-466f-8eef-09c7939a23cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:44.759243 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1796e3e-9c22-466f-8eef-09c7939a23cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:44.760673 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1796e3e-9c22-466f-8eef-09c7939a23cf None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:44.766922 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 520/1030] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:14:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:44.767970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974c61a-460e-4f12-8b79-e671938aff8d None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:44.868770 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974c61a-460e-4f12-8b79-e671938aff8d None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:44.909053 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c8785-1121-42d2-b1b7-d66fac2d3c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:44.910072 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c8785-1121-42d2-b1b7-d66fac2d3c94 None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:44.910360 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c8785-1121-42d2-b1b7-d66fac2d3c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:44.910637 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c8785-1121-42d2-b1b7-d66fac2d3c94 None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:44.911359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c8785-1121-42d2-b1b7-d66fac2d3c94 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:44.913206 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c8785-1121-42d2-b1b7-d66fac2d3c94 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:44.930483 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:44.942290 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 511/1031] 10.222.0.32 () {60 vars in 1132 bytes} [Wed Jun 1 04:14:44 2022] POST /identity/v3/users => generated 285 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:14:45.381592 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331d081-f8d2-4e0a-81c6-18d63ae5d9a1 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:45.381901 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331d081-f8d2-4e0a-81c6-18d63ae5d9a1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:45.382165 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331d081-f8d2-4e0a-81c6-18d63ae5d9a1 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:45.383653 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 521/1032] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:14:45.389206 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cc2ed-8b93-488d-a28d-a88a2921b9e4 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:45.389498 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cc2ed-8b93-488d-a28d-a88a2921b9e4 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:45.389780 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cc2ed-8b93-488d-a28d-a88a2921b9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:45.407031 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-896cc2ed-8b93-488d-a28d-a88a2921b9e4 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:45.408265 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-896cc2ed-8b93-488d-a28d-a88a2921b9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:45.438561 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ee95c-883f-4fa1-91b2-665a55abff8a None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:45.438854 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ee95c-883f-4fa1-91b2-665a55abff8a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:45.439145 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ee95c-883f-4fa1-91b2-665a55abff8a None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:45.440610 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 522/1033] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:14:45.446264 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93078990-ea1c-4f5d-8e77-eb3c05e84934 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:45.446652 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93078990-ea1c-4f5d-8e77-eb3c05e84934 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:45.446946 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93078990-ea1c-4f5d-8e77-eb3c05e84934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:45.465750 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-93078990-ea1c-4f5d-8e77-eb3c05e84934 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:45.467029 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-93078990-ea1c-4f5d-8e77-eb3c05e84934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:45.486478 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 512/1034] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:14:45.510868 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cc2ed-8b93-488d-a28d-a88a2921b9e4 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:45.566138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 523/1035] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:14:45.608370 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93078990-ea1c-4f5d-8e77-eb3c05e84934 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:45.664484 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cc2ed-8b93-488d-a28d-a88a2921b9e4 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:45.688875 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:45.712763 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:45.723774 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a254c01-0202-49af-9bfa-de0124480f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:45.725015 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a254c01-0202-49af-9bfa-de0124480f08 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:45.725488 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a254c01-0202-49af-9bfa-de0124480f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:45.725948 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a254c01-0202-49af-9bfa-de0124480f08 None admin] PATH_INFO: `/v3/services/image` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:45.726904 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a254c01-0202-49af-9bfa-de0124480f08 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:45.729267 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a254c01-0202-49af-9bfa-de0124480f08 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:45.749610 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-1a254c01-0202-49af-9bfa-de0124480f08 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 01 04:14:45.749610 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:45.749610 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 04:14:45.749610 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 04:14:45.749610 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 04:14:45.749610 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 04:14:45.749610 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 04:14:45.749610 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:45.749610 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 01 04:14:45.749610 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:45.749610 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 04:14:45.749610 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:45.749610 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:45.749610 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:45.749610 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:45.749610 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:45.749610 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:45.751121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:45.751121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:45.751121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:45.751121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:45.751121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:45.751121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:45.751121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 04:14:45.751121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 04:14:45.751121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 04:14:45.751121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 04:14:45.751121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:45.751121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:45.751121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:45.751121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:45.751121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:45.751121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:45.752217 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:45.752217 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:45.752217 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:45.752217 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:45.752217 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:45.752217 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:45.752217 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:45.752217 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:45.752217 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:45.752217 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:45.752217 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 04:14:45.752217 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:14:45.752217 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 01 04:14:45.752217 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:45.754358 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 513/1036] 10.222.0.32 () {56 vars in 1105 bytes} [Wed Jun 1 04:14:45 2022] GET /identity/v3/services/image => generated 86 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:14:45.760570 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a254c01-0202-49af-9bfa-de0124480f08 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:45.770676 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93078990-ea1c-4f5d-8e77-eb3c05e84934 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:45.813215 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8e54d-ae84-4b4f-858c-ee674f12ae2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:45.814234 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8e54d-ae84-4b4f-858c-ee674f12ae2c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:45.814642 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8e54d-ae84-4b4f-858c-ee674f12ae2c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:45.815107 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8e54d-ae84-4b4f-858c-ee674f12ae2c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:45.828099 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e8e54d-ae84-4b4f-858c-ee674f12ae2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:14:45.837177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-79e8e54d-ae84-4b4f-858c-ee674f12ae2c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 01 04:14:45.837177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:45.837177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:45.837177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:45.837177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:45.837177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:45.837177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:45.837177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:45.837177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:45.837177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:45.837177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:45.837177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:45.837177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:14:45.837177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:14:45.837177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:14:45.837177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:14:45.838604 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:14:45.838604 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:14:45.838604 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:14:45.838604 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:14:45.838604 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:45.838604 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:45.838604 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:45.838604 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:45.838604 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:45.838604 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:45.838604 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:45.838604 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:45.838604 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:45.838604 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:45.838604 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:45.838604 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:45.839530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:45.839530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:45.839530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:45.839530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:45.839530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:14:45.839530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:14:45.839530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:14:45.839530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:14:45.839530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:14:45.839530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:14:45.839530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 01 04:14:45.839530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:45.839530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 524/1037] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Jun 1 04:14:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:45.844679 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8e54d-ae84-4b4f-858c-ee674f12ae2c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:45.881090 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a254c01-0202-49af-9bfa-de0124480f08 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:45.925544 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573506b-1ebd-424f-a02f-bdc0d8d43990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:45.926608 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573506b-1ebd-424f-a02f-bdc0d8d43990 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:45.926889 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573506b-1ebd-424f-a02f-bdc0d8d43990 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:45.927168 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573506b-1ebd-424f-a02f-bdc0d8d43990 None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:45.927948 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b573506b-1ebd-424f-a02f-bdc0d8d43990 None admin] RBAC: Adding query filter params (name=image) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:45.928257 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b573506b-1ebd-424f-a02f-bdc0d8d43990 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:45.929641 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b573506b-1ebd-424f-a02f-bdc0d8d43990 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:45.940119 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 514/1038] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:14:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:45.941805 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573506b-1ebd-424f-a02f-bdc0d8d43990 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:45.966740 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8e54d-ae84-4b4f-858c-ee674f12ae2c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:45.982835 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:46.007468 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d6a2b-1fed-4b3c-8a78-4ed3161e47b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:46.008153 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d6a2b-1fed-4b3c-8a78-4ed3161e47b7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:46.008443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d6a2b-1fed-4b3c-8a78-4ed3161e47b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:46.008723 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d6a2b-1fed-4b3c-8a78-4ed3161e47b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:46.009479 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d6a2b-1fed-4b3c-8a78-4ed3161e47b7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:46.009790 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d6a2b-1fed-4b3c-8a78-4ed3161e47b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:46.011230 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d6a2b-1fed-4b3c-8a78-4ed3161e47b7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:46.014610 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:46.026205 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 525/1039] 10.222.0.32 () {56 vars in 1115 bytes} [Wed Jun 1 04:14:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:46.028258 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d6a2b-1fed-4b3c-8a78-4ed3161e47b7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:46.066340 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573506b-1ebd-424f-a02f-bdc0d8d43990 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:46.104527 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a5f30-ecef-48f4-845f-5637836ca599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:46.105207 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a5f30-ecef-48f4-845f-5637836ca599 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:46.105598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a5f30-ecef-48f4-845f-5637836ca599 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:46.105784 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a5f30-ecef-48f4-845f-5637836ca599 None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:46.106514 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a5f30-ecef-48f4-845f-5637836ca599 None admin] RBAC: Adding query filter params (type=image) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:46.107573 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a5f30-ecef-48f4-845f-5637836ca599 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:46.108215 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a5f30-ecef-48f4-845f-5637836ca599 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:46.119187 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 515/1040] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:14:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:46.120680 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a5f30-ecef-48f4-845f-5637836ca599 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:46.149348 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d6a2b-1fed-4b3c-8a78-4ed3161e47b7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:46.193750 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20ea80-011f-4c22-91a3-e5c4f07414bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:46.194553 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20ea80-011f-4c22-91a3-e5c4f07414bb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:46.194841 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20ea80-011f-4c22-91a3-e5c4f07414bb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:46.195122 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20ea80-011f-4c22-91a3-e5c4f07414bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:46.208106 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20ea80-011f-4c22-91a3-e5c4f07414bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:46.209599 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20ea80-011f-4c22-91a3-e5c4f07414bb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:46.227956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-bb20ea80-011f-4c22-91a3-e5c4f07414bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:46.227956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:46.227956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:46.227956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:46.227956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:46.227956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:46.227956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:46.227956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:46.227956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:46.227956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:46.227956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:46.227956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:46.227956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:14:46.227956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:14:46.227956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:14:46.229185 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:14:46.229185 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:46.229185 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:46.229185 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:46.229185 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:46.229185 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:46.229185 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:46.229185 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:46.229185 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:46.229185 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:46.229185 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:46.229185 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:46.229185 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:46.229185 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:46.229185 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:46.229185 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:46.229185 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:46.230121 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:14:46.230121 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:14:46.230121 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:46.230121 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:46.230121 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 526/1041] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:14:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:14:46.234887 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20ea80-011f-4c22-91a3-e5c4f07414bb None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:46.241567 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a5f30-ecef-48f4-845f-5637836ca599 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:46.265210 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:46.265401 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:46.280933 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ec06f-76c9-473b-850b-aa877937b107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:46.281753 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ec06f-76c9-473b-850b-aa877937b107 None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:46.282102 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ec06f-76c9-473b-850b-aa877937b107 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:46.282351 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ec06f-76c9-473b-850b-aa877937b107 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:46.283129 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ec06f-76c9-473b-850b-aa877937b107 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:46.285450 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ec06f-76c9-473b-850b-aa877937b107 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:46.318192 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 516/1042] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Jun 1 04:14:46 2022] POST /identity/v3/endpoints => generated 327 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:14:46.372869 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20ea80-011f-4c22-91a3-e5c4f07414bb None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:46.420141 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b42747-c84a-446a-a842-ef037ebbbaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:46.420839 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b42747-c84a-446a-a842-ef037ebbbaa3 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:46.421125 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b42747-c84a-446a-a842-ef037ebbbaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:46.421406 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b42747-c84a-446a-a842-ef037ebbbaa3 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:46.422258 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b42747-c84a-446a-a842-ef037ebbbaa3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:46.422571 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b42747-c84a-446a-a842-ef037ebbbaa3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:46.423979 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b42747-c84a-446a-a842-ef037ebbbaa3 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:46.437830 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 527/1043] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:46.444315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ec06f-76c9-473b-850b-aa877937b107 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:46.555040 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ec06f-76c9-473b-850b-aa877937b107 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:46.590299 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa080728-2261-497b-9e3e-79eb7b7ef531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:46.591105 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa080728-2261-497b-9e3e-79eb7b7ef531 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:46.591390 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa080728-2261-497b-9e3e-79eb7b7ef531 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:46.591668 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa080728-2261-497b-9e3e-79eb7b7ef531 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:46.599572 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa080728-2261-497b-9e3e-79eb7b7ef531 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:46.601011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa080728-2261-497b-9e3e-79eb7b7ef531 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:46.615065 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-fa080728-2261-497b-9e3e-79eb7b7ef531 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 01 04:14:46.615065 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:46.615065 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:46.615065 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:46.615065 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:46.615065 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:46.615065 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:46.615065 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:46.615065 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:46.615065 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:46.615065 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:46.615065 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:46.615065 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 04:14:46.615065 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 04:14:46.615065 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 04:14:46.615065 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 04:14:46.616057 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:46.616057 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:46.616057 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 04:14:46.616057 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:14:46.616057 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 04:14:46.616057 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:14:46.616057 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:46.616057 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:46.616057 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:46.616057 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:46.616057 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:46.616057 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:46.616057 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:46.616057 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:46.616057 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:46.616057 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:46.616057 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:46.616057 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:46.617083 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:46.617083 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:46.617083 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 04:14:46.617083 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 04:14:46.617083 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 04:14:46.617083 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 04:14:46.617083 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 04:14:46.617083 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 04:14:46.617083 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 01 04:14:46.617083 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:46.617083 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 517/1044] 10.222.0.32 () {56 vars in 1093 bytes} [Wed Jun 1 04:14:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:46.622837 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b42747-c84a-446a-a842-ef037ebbbaa3 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:46.707220 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:46.726478 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b42747-c84a-446a-a842-ef037ebbbaa3 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:46.760438 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d40ea-b7fa-4544-b0bd-bbfecc561399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:46.761114 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d40ea-b7fa-4544-b0bd-bbfecc561399 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:46.761398 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d40ea-b7fa-4544-b0bd-bbfecc561399 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:46.761676 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d40ea-b7fa-4544-b0bd-bbfecc561399 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:46.762547 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d40ea-b7fa-4544-b0bd-bbfecc561399 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:46.762860 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d40ea-b7fa-4544-b0bd-bbfecc561399 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:46.764286 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d40ea-b7fa-4544-b0bd-bbfecc561399 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:46.787127 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 528/1045] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Jun 1 04:14:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:46.788326 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa080728-2261-497b-9e3e-79eb7b7ef531 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:46.829186 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:46.895446 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa080728-2261-497b-9e3e-79eb7b7ef531 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:46.933862 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37461d21-e2c4-4a72-8fea-1283991977e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:46.934575 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37461d21-e2c4-4a72-8fea-1283991977e9 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:46.934867 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37461d21-e2c4-4a72-8fea-1283991977e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:46.935150 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37461d21-e2c4-4a72-8fea-1283991977e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:47.006844 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37461d21-e2c4-4a72-8fea-1283991977e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:47.008469 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37461d21-e2c4-4a72-8fea-1283991977e9 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:47.052155 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:47.121605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 518/1046] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:14:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 01 04:14:47.122865 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d40ea-b7fa-4544-b0bd-bbfecc561399 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:47.232009 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d40ea-b7fa-4544-b0bd-bbfecc561399 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:47.267820 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a363ab-7688-4b61-a5e9-d99ad3a2909c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:47.269410 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a363ab-7688-4b61-a5e9-d99ad3a2909c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:47.269834 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a363ab-7688-4b61-a5e9-d99ad3a2909c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:47.270286 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a363ab-7688-4b61-a5e9-d99ad3a2909c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:47.279282 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:47.282972 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a363ab-7688-4b61-a5e9-d99ad3a2909c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:47.286009 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a363ab-7688-4b61-a5e9-d99ad3a2909c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:47.305685 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-89a363ab-7688-4b61-a5e9-d99ad3a2909c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:47.305685 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:47.305685 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:47.305685 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:47.305685 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:47.305685 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:47.305685 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:47.305685 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:47.305685 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:47.305685 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:47.305685 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:47.305685 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:47.305685 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:14:47.305685 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:14:47.305685 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:14:47.306803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:14:47.306803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:47.306803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:47.306803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:47.306803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:47.306803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:47.306803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:47.306803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:47.306803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:47.306803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:47.306803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:47.306803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:47.306803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:47.306803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:47.306803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:47.306803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:47.306803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:47.307747 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:14:47.307747 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:14:47.307747 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:47.307747 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:47.311700 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 529/1047] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:14:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:47.312822 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37461d21-e2c4-4a72-8fea-1283991977e9 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:47.372861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6b53e-2ce6-415b-bcf7-fd2299484dc3 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:47.373195 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6b53e-2ce6-415b-bcf7-fd2299484dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:47.373426 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6b53e-2ce6-415b-bcf7-fd2299484dc3 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:47.374824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 530/1048] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:14:47.380624 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485db618-6a69-498c-b91e-dd1538417dc6 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:47.381126 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485db618-6a69-498c-b91e-dd1538417dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:47.381563 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485db618-6a69-498c-b91e-dd1538417dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:47.399222 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-485db618-6a69-498c-b91e-dd1538417dc6 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:47.400801 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-485db618-6a69-498c-b91e-dd1538417dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:47.433349 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37461d21-e2c4-4a72-8fea-1283991977e9 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:47.471424 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc001d92-e1dd-4a48-a22b-9a437adf2a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:47.472391 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc001d92-e1dd-4a48-a22b-9a437adf2a69 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:47.472838 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc001d92-e1dd-4a48-a22b-9a437adf2a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:47.473270 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc001d92-e1dd-4a48-a22b-9a437adf2a69 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:47.473375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 531/1049] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 04:14:47.474227 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc001d92-e1dd-4a48-a22b-9a437adf2a69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:47.474675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc001d92-e1dd-4a48-a22b-9a437adf2a69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:47.476172 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc001d92-e1dd-4a48-a22b-9a437adf2a69 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:47.483654 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:47.490910 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 519/1050] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:47.496644 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485db618-6a69-498c-b91e-dd1538417dc6 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:47.496840 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc001d92-e1dd-4a48-a22b-9a437adf2a69 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:47.603876 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc001d92-e1dd-4a48-a22b-9a437adf2a69 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:47.606964 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485db618-6a69-498c-b91e-dd1538417dc6 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:47.631722 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:47.638936 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be9944-7990-4abe-8364-de4719ab90b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:47.639743 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be9944-7990-4abe-8364-de4719ab90b3 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:47.640025 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be9944-7990-4abe-8364-de4719ab90b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:47.640300 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be9944-7990-4abe-8364-de4719ab90b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:47.645821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a42618-8ad7-4d51-b1e0-65c5a314bdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:47.646647 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a42618-8ad7-4d51-b1e0-65c5a314bdaf None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:47.646927 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a42618-8ad7-4d51-b1e0-65c5a314bdaf None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:47.647201 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a42618-8ad7-4d51-b1e0-65c5a314bdaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:47.652123 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be9944-7990-4abe-8364-de4719ab90b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:14:47.654118 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a42618-8ad7-4d51-b1e0-65c5a314bdaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:47.655564 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a42618-8ad7-4d51-b1e0-65c5a314bdaf None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:47.659791 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-62be9944-7990-4abe-8364-de4719ab90b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:14:47.659791 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:47.659791 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:47.659791 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:47.659791 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:47.659791 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:47.659791 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:47.659791 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:47.659791 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:47.659791 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:47.659791 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:47.659791 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:47.659791 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:14:47.659791 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:14:47.659791 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:14:47.659791 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:14:47.660708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:14:47.660708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:14:47.660708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:14:47.660708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:14:47.660708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:47.660708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:47.660708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:47.660708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:47.660708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:47.660708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:47.660708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:47.660708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:47.660708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:47.660708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:47.660708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:47.660708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:47.666402 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:47.666402 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:47.666402 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:47.666402 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:47.666402 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:14:47.666402 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:14:47.666402 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:14:47.666402 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:14:47.666402 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:14:47.666402 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:14:47.666402 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:14:47.666402 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:47.666402 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 520/1051] 10.222.0.32 () {56 vars in 1096 bytes} [Wed Jun 1 04:14:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:14:47.667124 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be9944-7990-4abe-8364-de4719ab90b3 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:47.676183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-b6a42618-8ad7-4d51-b1e0-65c5a314bdaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:14:47.676183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:47.676183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:47.676183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:47.676183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:47.676183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:47.676183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:47.676183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:47.676183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:47.676183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:47.676183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:47.676183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:47.676183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 04:14:47.676183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 04:14:47.676183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 04:14:47.677110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 04:14:47.677110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:47.677110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:47.677110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:47.677110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:47.677110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:47.677110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:47.677110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:47.677110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:47.677110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:47.677110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:47.677110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:47.677110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:47.677110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:47.677110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:47.677110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:47.677110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:47.678123 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 04:14:47.678123 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 04:14:47.678123 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 04:14:47.678123 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 04:14:47.678123 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 04:14:47.678123 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 04:14:47.678123 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:14:47.678123 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:47.678123 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 532/1052] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:14:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:47.683028 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a42618-8ad7-4d51-b1e0-65c5a314bdaf None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:47.732894 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:47.782297 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be9944-7990-4abe-8364-de4719ab90b3 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:47.789726 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a42618-8ad7-4d51-b1e0-65c5a314bdaf None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:47.822088 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591db16-34e7-452d-88f5-60c0c32b25f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:47.822774 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591db16-34e7-452d-88f5-60c0c32b25f8 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:47.823054 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591db16-34e7-452d-88f5-60c0c32b25f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:47.823326 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591db16-34e7-452d-88f5-60c0c32b25f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:47.824112 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b591db16-34e7-452d-88f5-60c0c32b25f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:47.824427 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b591db16-34e7-452d-88f5-60c0c32b25f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:47.825814 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b591db16-34e7-452d-88f5-60c0c32b25f8 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:47.830664 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762da10-d7fa-46fc-910d-1ed09ea466e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:47.831381 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762da10-d7fa-46fc-910d-1ed09ea466e7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:47.832183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762da10-d7fa-46fc-910d-1ed09ea466e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:47.832469 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762da10-d7fa-46fc-910d-1ed09ea466e7 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:47.833571 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d762da10-d7fa-46fc-910d-1ed09ea466e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:47.833886 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d762da10-d7fa-46fc-910d-1ed09ea466e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:47.839869 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 521/1053] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:14:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:47.840005 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d762da10-d7fa-46fc-910d-1ed09ea466e7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:47.840702 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591db16-34e7-452d-88f5-60c0c32b25f8 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:47.851453 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 533/1054] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Jun 1 04:14:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:47.857347 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762da10-d7fa-46fc-910d-1ed09ea466e7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:47.900957 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:47.953748 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591db16-34e7-452d-88f5-60c0c32b25f8 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:47.960348 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762da10-d7fa-46fc-910d-1ed09ea466e7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:47.975111 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:47.992399 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5d2f1-64e8-41c6-92d2-225e29bd7311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:47.993368 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5d2f1-64e8-41c6-92d2-225e29bd7311 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:47.993809 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5d2f1-64e8-41c6-92d2-225e29bd7311 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:47.994266 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5d2f1-64e8-41c6-92d2-225e29bd7311 None admin] PATH_INFO: `/v3/users/87db9008e8ac454aa66dd53f246a71ae` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:47.995247 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866cfc18-917f-4cb4-a200-5dd7aa9a0f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:47.995903 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cfc18-917f-4cb4-a200-5dd7aa9a0f52 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:47.996196 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cfc18-917f-4cb4-a200-5dd7aa9a0f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:47.996466 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cfc18-917f-4cb4-a200-5dd7aa9a0f52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:47.997296 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866cfc18-917f-4cb4-a200-5dd7aa9a0f52 None admin] RBAC: Adding query filter params (role.id=0f6437212f954ee1a3bdb42ffc3458e7, scope.project.id=31d68f64d21647688074554062952074, user.id=79d614f85f5541d3babbb41468cbf55c) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:47.997604 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866cfc18-917f-4cb4-a200-5dd7aa9a0f52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:47.999063 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866cfc18-917f-4cb4-a200-5dd7aa9a0f52 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:48.010010 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 534/1055] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:14:47 2022] GET /identity/v3/role_assignments?user.id=79d614f85f5541d3babbb41468cbf55c&scope.project.id=31d68f64d21647688074554062952074&role.id=0f6437212f954ee1a3bdb42ffc3458e7 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:48.016086 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e5d2f1-64e8-41c6-92d2-225e29bd7311 None admin] RBAC: Authorizing `identity:get_user(user_id=87db9008e8ac454aa66dd53f246a71ae)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:48.017581 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e5d2f1-64e8-41c6-92d2-225e29bd7311 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:48.019478 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 522/1056] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:14:47 2022] GET /identity/v3/users/87db9008e8ac454aa66dd53f246a71ae => generated 285 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:48.025552 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866cfc18-917f-4cb4-a200-5dd7aa9a0f52 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:48.134393 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866cfc18-917f-4cb4-a200-5dd7aa9a0f52 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:48.143146 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:48.181647 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6abaa0-ac6c-493c-a571-a17c880d514e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:48.182533 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6abaa0-ac6c-493c-a571-a17c880d514e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:48.182916 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6abaa0-ac6c-493c-a571-a17c880d514e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:48.183292 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6abaa0-ac6c-493c-a571-a17c880d514e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:48.257912 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6abaa0-ac6c-493c-a571-a17c880d514e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:48.259529 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6abaa0-ac6c-493c-a571-a17c880d514e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:48.371711 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 535/1057] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:14:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 01 04:14:48.373016 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5d2f1-64e8-41c6-92d2-225e29bd7311 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:48.479962 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5d2f1-64e8-41c6-92d2-225e29bd7311 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:48.518259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e7b6a-c257-4825-835a-bdf2041d578d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:48.519676 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e7b6a-c257-4825-835a-bdf2041d578d None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:48.519961 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e7b6a-c257-4825-835a-bdf2041d578d None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:48.520241 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e7b6a-c257-4825-835a-bdf2041d578d None admin] PATH_INFO: `/v3/projects/b9cd6e4044874633821928cacb39628a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:48.521540 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e7b6a-c257-4825-835a-bdf2041d578d None admin] RBAC: Authorizing `identity:get_project(project_id=b9cd6e4044874633821928cacb39628a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:48.523070 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e7b6a-c257-4825-835a-bdf2041d578d None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:48.525127 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 523/1058] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:14:48 2022] GET /identity/v3/projects/b9cd6e4044874633821928cacb39628a => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:48.531235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6abaa0-ac6c-493c-a571-a17c880d514e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:48.540508 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:48.634946 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6abaa0-ac6c-493c-a571-a17c880d514e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:48.661018 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc6dba-ff23-4f05-a58e-6d3dc9f2baf2 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:48.661651 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc6dba-ff23-4f05-a58e-6d3dc9f2baf2 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:48.661651 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc6dba-ff23-4f05-a58e-6d3dc9f2baf2 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:48.662936 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 524/1059] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:14:48.668145 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687dff0-c44f-4174-9f11-ef52d9d68a2e None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:48.668438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687dff0-c44f-4174-9f11-ef52d9d68a2e None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:48.668719 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687dff0-c44f-4174-9f11-ef52d9d68a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:48.670616 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e0ee2-359c-4c5e-86b8-981298b58655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:48.671277 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e0ee2-359c-4c5e-86b8-981298b58655 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:48.671564 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e0ee2-359c-4c5e-86b8-981298b58655 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:48.671844 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e0ee2-359c-4c5e-86b8-981298b58655 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:48.672674 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e0ee2-359c-4c5e-86b8-981298b58655 None admin] RBAC: Adding query filter params (role.id=76fc054ad9544460a7be1e2010c23642, scope.project.id=b9cd6e4044874633821928cacb39628a, user.id=87db9008e8ac454aa66dd53f246a71ae) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:48.672990 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e0ee2-359c-4c5e-86b8-981298b58655 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:48.674473 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e0ee2-359c-4c5e-86b8-981298b58655 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:48.680974 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 536/1060] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:14:48 2022] GET /identity/v3/role_assignments?user.id=87db9008e8ac454aa66dd53f246a71ae&scope.project.id=b9cd6e4044874633821928cacb39628a&role.id=76fc054ad9544460a7be1e2010c23642 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:48.686734 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-d687dff0-c44f-4174-9f11-ef52d9d68a2e None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:48.688056 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d687dff0-c44f-4174-9f11-ef52d9d68a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:48.737662 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:48.767555 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 525/1061] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 04:14:48.790717 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e0ee2-359c-4c5e-86b8-981298b58655 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:48.867620 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:48.902152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e0ee2-359c-4c5e-86b8-981298b58655 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:48.937627 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8e0c2-e4c5-4d26-afb0-72c06caa093a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:48.938312 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8e0c2-e4c5-4d26-afb0-72c06caa093a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:48.938601 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8e0c2-e4c5-4d26-afb0-72c06caa093a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:48.938884 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8e0c2-e4c5-4d26-afb0-72c06caa093a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:49.006528 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8e0c2-e4c5-4d26-afb0-72c06caa093a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:49.007892 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8e0c2-e4c5-4d26-afb0-72c06caa093a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:49.074867 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:49.107901 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 537/1062] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:14:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 01 04:14:49.114304 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687dff0-c44f-4174-9f11-ef52d9d68a2e None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:49.228700 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687dff0-c44f-4174-9f11-ef52d9d68a2e None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:49.263642 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74240ed-97de-41aa-9c25-5331fe1098d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:49.264347 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74240ed-97de-41aa-9c25-5331fe1098d0 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:49.264626 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74240ed-97de-41aa-9c25-5331fe1098d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:49.264897 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74240ed-97de-41aa-9c25-5331fe1098d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:49.276348 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74240ed-97de-41aa-9c25-5331fe1098d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:49.277796 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74240ed-97de-41aa-9c25-5331fe1098d0 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:49.296222 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-f74240ed-97de-41aa-9c25-5331fe1098d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:49.296222 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:49.296222 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:49.296222 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:49.296222 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:49.296222 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:49.296222 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:49.296222 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:49.296222 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:49.296222 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:49.296222 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:49.296222 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:49.296222 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:14:49.296222 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:14:49.296222 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:14:49.297173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:14:49.297173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:49.297173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:49.297173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:49.297173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:49.297173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:49.297173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:49.297173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:49.297173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:49.297173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:49.297173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:49.297173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:49.297173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:49.297173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:49.297173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:49.297173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:49.297173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:49.298117 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:14:49.298117 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:14:49.298117 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:49.298117 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:49.298117 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 526/1063] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:14:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:49.303550 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8e0c2-e4c5-4d26-afb0-72c06caa093a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:49.404329 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8e0c2-e4c5-4d26-afb0-72c06caa093a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:49.438505 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2248e53-1f98-431a-8158-1b28b6670c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:49.439164 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2248e53-1f98-431a-8158-1b28b6670c57 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:49.439445 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2248e53-1f98-431a-8158-1b28b6670c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:49.439718 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2248e53-1f98-431a-8158-1b28b6670c57 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:49.440457 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2248e53-1f98-431a-8158-1b28b6670c57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:49.440760 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2248e53-1f98-431a-8158-1b28b6670c57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:49.442146 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2248e53-1f98-431a-8158-1b28b6670c57 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:49.461999 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 538/1064] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:50.279962 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce4b49-607e-4860-a787-1129e89b87ba None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:50.280485 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce4b49-607e-4860-a787-1129e89b87ba None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:50.280485 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce4b49-607e-4860-a787-1129e89b87ba None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:50.281870 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 527/1065] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:14:50.287715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c972b-c12f-4db9-98a9-a19791b99e5b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:50.288138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c972b-c12f-4db9-98a9-a19791b99e5b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:50.288269 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c972b-c12f-4db9-98a9-a19791b99e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:50.306046 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-892c972b-c12f-4db9-98a9-a19791b99e5b None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:50.307259 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-892c972b-c12f-4db9-98a9-a19791b99e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:50.330123 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:50.372414 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 539/1066] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:14:50.395003 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce4b49-607e-4860-a787-1129e89b87ba None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:50.423830 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:50.503791 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce4b49-607e-4860-a787-1129e89b87ba None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:50.541720 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71a3ba-bdd3-40a1-89d2-00adbb02f4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:50.542556 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71a3ba-bdd3-40a1-89d2-00adbb02f4cc None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:50.542838 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71a3ba-bdd3-40a1-89d2-00adbb02f4cc None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:50.543113 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71a3ba-bdd3-40a1-89d2-00adbb02f4cc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:50.553772 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f71a3ba-bdd3-40a1-89d2-00adbb02f4cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:14:50.561767 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-5f71a3ba-bdd3-40a1-89d2-00adbb02f4cc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 01 04:14:50.561767 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:50.561767 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:50.561767 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:50.561767 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:50.561767 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:50.561767 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:50.561767 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:50.561767 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:50.561767 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:50.561767 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:50.561767 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:50.561767 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:14:50.561767 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:14:50.561767 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:14:50.561767 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:14:50.562900 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:14:50.562900 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:14:50.562900 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:14:50.562900 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:14:50.562900 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:50.562900 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:50.562900 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:50.562900 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:50.562900 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:50.562900 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:50.562900 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:50.562900 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:50.562900 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:50.562900 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:50.562900 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:50.562900 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:50.563757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:50.563757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:50.563757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:50.563757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:50.563757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:14:50.563757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:14:50.563757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:14:50.563757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:14:50.563757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:14:50.563757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:14:50.563757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 01 04:14:50.563757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:50.563757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 528/1067] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Jun 1 04:14:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:50.569146 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c972b-c12f-4db9-98a9-a19791b99e5b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:50.669109 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c972b-c12f-4db9-98a9-a19791b99e5b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:50.702555 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebb989-82ba-4b52-850a-9be561fbf4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:50.703136 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebb989-82ba-4b52-850a-9be561fbf4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:50.703416 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebb989-82ba-4b52-850a-9be561fbf4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:50.703686 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebb989-82ba-4b52-850a-9be561fbf4b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:50.704422 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ebb989-82ba-4b52-850a-9be561fbf4b9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:50.704727 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ebb989-82ba-4b52-850a-9be561fbf4b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:50.706644 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ebb989-82ba-4b52-850a-9be561fbf4b9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:50.714733 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 540/1068] 10.222.0.32 () {56 vars in 1115 bytes} [Wed Jun 1 04:14:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:50.720401 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71a3ba-bdd3-40a1-89d2-00adbb02f4cc None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:50.815282 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:50.829378 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71a3ba-bdd3-40a1-89d2-00adbb02f4cc None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:50.866038 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb1d33-84ae-49c9-bef5-70a5fb127f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:50.866852 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb1d33-84ae-49c9-bef5-70a5fb127f48 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:50.867132 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb1d33-84ae-49c9-bef5-70a5fb127f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:50.867404 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb1d33-84ae-49c9-bef5-70a5fb127f48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:50.879399 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb1d33-84ae-49c9-bef5-70a5fb127f48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:50.880893 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb1d33-84ae-49c9-bef5-70a5fb127f48 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:50.900044 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-70cb1d33-84ae-49c9-bef5-70a5fb127f48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:50.900044 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:50.900044 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:50.900044 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:50.900044 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:50.900044 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:50.900044 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:50.900044 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:50.900044 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:50.900044 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:50.900044 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:50.900044 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:50.900044 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:14:50.900044 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:14:50.900044 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:14:50.901205 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:14:50.901205 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:50.901205 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:50.901205 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:50.901205 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:50.901205 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:50.901205 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:50.901205 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:50.901205 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:50.901205 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:50.901205 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:50.901205 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:50.901205 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:50.901205 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:50.901205 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:50.901205 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:50.901205 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:50.902542 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:14:50.902542 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:14:50.902542 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:50.902542 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:50.902542 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 529/1069] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:14:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:50.907097 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebb989-82ba-4b52-850a-9be561fbf4b9 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:50.933442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:50.987784 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504e794-eb59-4f97-b02e-3ea76cc79733 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:50.988078 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504e794-eb59-4f97-b02e-3ea76cc79733 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:50.988364 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504e794-eb59-4f97-b02e-3ea76cc79733 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:50.989781 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 530/1070] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:14:50.995537 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623d3a9-21e2-4d6e-afed-4f4a32027794 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:50.995822 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623d3a9-21e2-4d6e-afed-4f4a32027794 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:50.996098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623d3a9-21e2-4d6e-afed-4f4a32027794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:51.014237 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-1623d3a9-21e2-4d6e-afed-4f4a32027794 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:51.015489 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-1623d3a9-21e2-4d6e-afed-4f4a32027794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:51.028837 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebb989-82ba-4b52-850a-9be561fbf4b9 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:51.064390 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3dba8-e55e-4a16-80ab-e4945f75b23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:51.065577 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3dba8-e55e-4a16-80ab-e4945f75b23a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:51.065869 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3dba8-e55e-4a16-80ab-e4945f75b23a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:51.066184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3dba8-e55e-4a16-80ab-e4945f75b23a None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:51.066920 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df3dba8-e55e-4a16-80ab-e4945f75b23a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:51.067225 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df3dba8-e55e-4a16-80ab-e4945f75b23a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:51.068891 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df3dba8-e55e-4a16-80ab-e4945f75b23a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:51.087270 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 541/1071] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:51.088700 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3dba8-e55e-4a16-80ab-e4945f75b23a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:51.091218 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 531/1072] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 04:14:51.114131 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623d3a9-21e2-4d6e-afed-4f4a32027794 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:51.172895 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:51.188778 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:51.198959 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3dba8-e55e-4a16-80ab-e4945f75b23a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:51.222343 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623d3a9-21e2-4d6e-afed-4f4a32027794 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:51.238678 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978ed8a-0d43-42c6-95f3-46e4357b97f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:51.239401 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978ed8a-0d43-42c6-95f3-46e4357b97f6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:51.239685 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978ed8a-0d43-42c6-95f3-46e4357b97f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:51.239962 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978ed8a-0d43-42c6-95f3-46e4357b97f6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:51.247185 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978ed8a-0d43-42c6-95f3-46e4357b97f6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:51.248629 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978ed8a-0d43-42c6-95f3-46e4357b97f6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:51.261104 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffa57a-6c9c-4a3d-bccb-b48a609a15c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:51.261906 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffa57a-6c9c-4a3d-bccb-b48a609a15c6 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:51.262219 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffa57a-6c9c-4a3d-bccb-b48a609a15c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:51.262491 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffa57a-6c9c-4a3d-bccb-b48a609a15c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:51.264478 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-1978ed8a-0d43-42c6-95f3-46e4357b97f6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 01 04:14:51.264478 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:51.264478 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:51.264478 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:51.264478 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:51.264478 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:51.264478 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:51.264478 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:51.264478 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:51.264478 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:51.264478 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:51.264478 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:51.264478 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 04:14:51.264478 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 04:14:51.264478 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 04:14:51.264478 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 04:14:51.271663 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:51.271663 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:51.271663 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 04:14:51.271663 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:14:51.271663 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 04:14:51.271663 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:14:51.271663 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:51.271663 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:51.271663 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:51.271663 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:51.271663 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:51.271663 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:51.271663 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:51.271663 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:51.271663 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:51.271663 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:51.271663 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:51.271663 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:51.272648 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:51.272648 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:51.272648 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 04:14:51.272648 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 04:14:51.272648 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 04:14:51.272648 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 04:14:51.272648 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 04:14:51.272648 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 04:14:51.272648 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 01 04:14:51.272648 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:51.272648 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 542/1073] 10.222.0.32 () {56 vars in 1093 bytes} [Wed Jun 1 04:14:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:14:51.272648 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978ed8a-0d43-42c6-95f3-46e4357b97f6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:51.273896 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecffa57a-6c9c-4a3d-bccb-b48a609a15c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:14:51.281553 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-ecffa57a-6c9c-4a3d-bccb-b48a609a15c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:14:51.281553 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:51.281553 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:51.281553 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:51.281553 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:51.281553 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:51.281553 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:51.281553 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:51.281553 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:51.281553 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:51.281553 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:51.281553 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:51.281553 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:14:51.281553 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:14:51.281553 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:14:51.281553 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:14:51.282970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:14:51.282970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:14:51.282970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:14:51.282970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:14:51.282970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:51.282970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:51.282970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:51.282970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:51.282970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:51.282970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:51.282970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:51.282970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:51.282970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:51.282970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:51.282970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:51.282970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:51.284020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:51.284020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:51.284020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:51.284020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:51.284020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:14:51.284020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:14:51.284020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:14:51.284020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:14:51.284020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:14:51.284020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:14:51.284020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:14:51.284020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:51.284020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 532/1074] 10.222.0.32 () {56 vars in 1096 bytes} [Wed Jun 1 04:14:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:14:51.288990 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffa57a-6c9c-4a3d-bccb-b48a609a15c6 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:51.379599 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978ed8a-0d43-42c6-95f3-46e4357b97f6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:51.397150 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffa57a-6c9c-4a3d-bccb-b48a609a15c6 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:51.416188 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1351e-a60a-4ba8-9c74-020634951af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:51.416864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1351e-a60a-4ba8-9c74-020634951af8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:51.417145 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1351e-a60a-4ba8-9c74-020634951af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:51.417419 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1351e-a60a-4ba8-9c74-020634951af8 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:51.418300 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b1351e-a60a-4ba8-9c74-020634951af8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:51.418605 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b1351e-a60a-4ba8-9c74-020634951af8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:51.420030 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b1351e-a60a-4ba8-9c74-020634951af8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:51.432653 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:51.434802 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:51.443192 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ae4a2-66ce-4264-bd2e-acb8767ac49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:51.443869 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ae4a2-66ce-4264-bd2e-acb8767ac49a None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:51.444420 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 543/1075] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Jun 1 04:14:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:51.444537 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ae4a2-66ce-4264-bd2e-acb8767ac49a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:51.444537 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ae4a2-66ce-4264-bd2e-acb8767ac49a None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:51.445142 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1351e-a60a-4ba8-9c74-020634951af8 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:51.445283 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ae4a2-66ce-4264-bd2e-acb8767ac49a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:51.445596 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ae4a2-66ce-4264-bd2e-acb8767ac49a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:51.447188 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ae4a2-66ce-4264-bd2e-acb8767ac49a None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:51.456236 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 533/1076] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:14:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:51.462033 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ae4a2-66ce-4264-bd2e-acb8767ac49a None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:51.553401 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1351e-a60a-4ba8-9c74-020634951af8 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:51.579599 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ae4a2-66ce-4264-bd2e-acb8767ac49a None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:51.590107 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b021e-67a7-4b44-9241-0864ae503a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:51.590913 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b021e-67a7-4b44-9241-0864ae503a40 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:51.591197 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b021e-67a7-4b44-9241-0864ae503a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:51.591479 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b021e-67a7-4b44-9241-0864ae503a40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:51.601826 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b021e-67a7-4b44-9241-0864ae503a40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:51.603344 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b021e-67a7-4b44-9241-0864ae503a40 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:51.618605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc0278-e3fd-4126-a5ce-e7353a5456df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:51.620709 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc0278-e3fd-4126-a5ce-e7353a5456df None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:51.620709 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc0278-e3fd-4126-a5ce-e7353a5456df None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:51.620709 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc0278-e3fd-4126-a5ce-e7353a5456df None admin] PATH_INFO: `/v3/users/87db9008e8ac454aa66dd53f246a71ae` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:51.621709 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc0278-e3fd-4126-a5ce-e7353a5456df None admin] RBAC: Authorizing `identity:get_user(user_id=87db9008e8ac454aa66dd53f246a71ae)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:51.621811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-a89b021e-67a7-4b44-9241-0864ae503a40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:51.621811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:51.621811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:51.621811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:51.621811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:51.621811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:51.621811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:51.621811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:51.621811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:51.621811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:51.621811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:51.621811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:51.621811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:14:51.621811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:14:51.621811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:14:51.622853 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:14:51.622853 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:51.622853 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:51.622853 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:51.622853 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:51.622853 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:51.622853 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:51.622853 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:51.622853 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:51.622853 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:51.622853 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:51.622853 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:51.622853 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:51.622853 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:51.622853 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:51.622853 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:51.622853 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:51.623786 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:14:51.623786 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:14:51.623786 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:51.623786 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:51.624012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc0278-e3fd-4126-a5ce-e7353a5456df None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:51.624082 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 544/1077] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:14:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:14:51.629422 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 534/1078] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:14:51 2022] GET /identity/v3/users/87db9008e8ac454aa66dd53f246a71ae => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:51.630857 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b021e-67a7-4b44-9241-0864ae503a40 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:51.630980 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc0278-e3fd-4126-a5ce-e7353a5456df None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:51.689849 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:51.695038 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:51.736875 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc0278-e3fd-4126-a5ce-e7353a5456df None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:51.743144 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b021e-67a7-4b44-9241-0864ae503a40 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:51.776926 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e7dc4-4f9a-435f-976f-44c3329b95cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:51.777896 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e7dc4-4f9a-435f-976f-44c3329b95cb None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:51.778226 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e7dc4-4f9a-435f-976f-44c3329b95cb None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:51.778502 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e7dc4-4f9a-435f-976f-44c3329b95cb None admin] PATH_INFO: `/v3/projects/b9cd6e4044874633821928cacb39628a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:51.779698 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e7dc4-4f9a-435f-976f-44c3329b95cb None admin] RBAC: Authorizing `identity:get_project(project_id=b9cd6e4044874633821928cacb39628a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:51.781137 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e7dc4-4f9a-435f-976f-44c3329b95cb None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:51.781864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6f8a0-1110-45d1-b645-53fea5c10ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:51.782877 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 535/1079] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:14:51 2022] GET /identity/v3/projects/b9cd6e4044874633821928cacb39628a => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:51.782980 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6f8a0-1110-45d1-b645-53fea5c10ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:51.783263 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6f8a0-1110-45d1-b645-53fea5c10ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:51.783729 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6f8a0-1110-45d1-b645-53fea5c10ac5 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:51.785269 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb6f8a0-1110-45d1-b645-53fea5c10ac5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:51.785582 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb6f8a0-1110-45d1-b645-53fea5c10ac5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:51.786987 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb6f8a0-1110-45d1-b645-53fea5c10ac5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:51.790386 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e7dc4-4f9a-435f-976f-44c3329b95cb None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:51.798869 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 545/1080] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:51.806355 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6f8a0-1110-45d1-b645-53fea5c10ac5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:51.899051 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e7dc4-4f9a-435f-976f-44c3329b95cb None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:51.916539 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6f8a0-1110-45d1-b645-53fea5c10ac5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:51.928838 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:51.930977 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:51.937238 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10532d5-4507-4a12-b5b5-c5882424c46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:51.938163 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10532d5-4507-4a12-b5b5-c5882424c46d None admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:51.938809 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10532d5-4507-4a12-b5b5-c5882424c46d None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:51.938809 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10532d5-4507-4a12-b5b5-c5882424c46d None admin] PATH_INFO: `/v3/projects/b9cd6e4044874633821928cacb39628a/users/87db9008e8ac454aa66dd53f246a71ae/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:51.940718 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10532d5-4507-4a12-b5b5-c5882424c46d None admin] RBAC: Authorizing `identity:create_grant(project_id=b9cd6e4044874633821928cacb39628a, user_id=87db9008e8ac454aa66dd53f246a71ae, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:51.942191 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10532d5-4507-4a12-b5b5-c5882424c46d None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:51.953553 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668dcca-6414-43f6-ab5a-9fb4eb19b457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:51.954366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668dcca-6414-43f6-ab5a-9fb4eb19b457 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:51.954651 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668dcca-6414-43f6-ab5a-9fb4eb19b457 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:51.954926 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668dcca-6414-43f6-ab5a-9fb4eb19b457 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:51.956253 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 536/1081] 10.222.0.32 () {58 vars in 1439 bytes} [Wed Jun 1 04:14:51 2022] PUT /identity/v3/projects/b9cd6e4044874633821928cacb39628a/users/87db9008e8ac454aa66dd53f246a71ae/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:14:51.961787 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668dcca-6414-43f6-ab5a-9fb4eb19b457 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:51.963281 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668dcca-6414-43f6-ab5a-9fb4eb19b457 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:51.979249 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-9668dcca-6414-43f6-ab5a-9fb4eb19b457 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:14:51.979249 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:51.979249 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:51.979249 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:51.979249 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:51.979249 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:51.979249 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:51.979249 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:51.979249 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:51.979249 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:51.979249 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:51.979249 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:51.979249 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 04:14:51.979249 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 04:14:51.979249 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 04:14:51.981113 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 04:14:51.981113 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:51.981113 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:51.981113 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:51.981113 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:51.981113 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:51.981113 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:51.981113 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:51.981113 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:51.981113 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:51.981113 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:51.981113 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:51.981113 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:51.981113 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:51.981113 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:51.981113 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:51.981113 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:51.983068 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 04:14:51.983068 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 04:14:51.983068 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 04:14:51.983068 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 04:14:51.983068 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 04:14:51.983068 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 04:14:51.983068 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:14:51.983068 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:51.986458 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 546/1082] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:14:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:51.988138 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10532d5-4507-4a12-b5b5-c5882424c46d None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:52.107785 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10532d5-4507-4a12-b5b5-c5882424c46d None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:52.142772 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bf2a1-fbd1-4922-bee5-7fbee3d8379f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:52.143443 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bf2a1-fbd1-4922-bee5-7fbee3d8379f None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:52.143725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bf2a1-fbd1-4922-bee5-7fbee3d8379f None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:52.144010 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bf2a1-fbd1-4922-bee5-7fbee3d8379f None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:52.144799 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045bf2a1-fbd1-4922-bee5-7fbee3d8379f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:52.145110 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045bf2a1-fbd1-4922-bee5-7fbee3d8379f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:52.146580 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045bf2a1-fbd1-4922-bee5-7fbee3d8379f None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:52.163756 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 537/1083] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Jun 1 04:14:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:52.169636 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668dcca-6414-43f6-ab5a-9fb4eb19b457 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:52.269680 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668dcca-6414-43f6-ab5a-9fb4eb19b457 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:52.303566 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b86546-7c6d-424b-9b9b-da251d1ee277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:52.304471 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b86546-7c6d-424b-9b9b-da251d1ee277 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:52.304752 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b86546-7c6d-424b-9b9b-da251d1ee277 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:52.305029 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b86546-7c6d-424b-9b9b-da251d1ee277 None admin] PATH_INFO: `/v3/projects/31d68f64d21647688074554062952074/users/79d614f85f5541d3babbb41468cbf55c/roles/0f6437212f954ee1a3bdb42ffc3458e7` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:52.307290 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b86546-7c6d-424b-9b9b-da251d1ee277 None admin] RBAC: Authorizing `identity:create_grant(project_id=31d68f64d21647688074554062952074, user_id=79d614f85f5541d3babbb41468cbf55c, role_id=0f6437212f954ee1a3bdb42ffc3458e7)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:52.308725 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b86546-7c6d-424b-9b9b-da251d1ee277 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:52.322469 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 547/1084] 10.222.0.32 () {58 vars in 1439 bytes} [Wed Jun 1 04:14:52 2022] PUT /identity/v3/projects/31d68f64d21647688074554062952074/users/79d614f85f5541d3babbb41468cbf55c/roles/0f6437212f954ee1a3bdb42ffc3458e7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:14:54.204638 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be2fa3-e725-4220-b7c3-215c247edbb5 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:54.205148 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be2fa3-e725-4220-b7c3-215c247edbb5 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:54.205237 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be2fa3-e725-4220-b7c3-215c247edbb5 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:54.206606 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 538/1085] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:14:54.211931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af3809-e56f-4d4c-bd95-2415b768727d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:54.212379 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af3809-e56f-4d4c-bd95-2415b768727d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:54.212496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af3809-e56f-4d4c-bd95-2415b768727d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:54.231035 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c2af3809-e56f-4d4c-bd95-2415b768727d None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:54.232303 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c2af3809-e56f-4d4c-bd95-2415b768727d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:54.261346 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:54.304450 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 548/1086] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:14:54.328321 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be2fa3-e725-4220-b7c3-215c247edbb5 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:54.382641 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:54.446795 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be2fa3-e725-4220-b7c3-215c247edbb5 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:54.481219 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f196e9b-5e98-4a61-b6c5-dfd6cf98b7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:54.482049 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f196e9b-5e98-4a61-b6c5-dfd6cf98b7fd None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:54.482331 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f196e9b-5e98-4a61-b6c5-dfd6cf98b7fd None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:54.482605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f196e9b-5e98-4a61-b6c5-dfd6cf98b7fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:54.493377 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f196e9b-5e98-4a61-b6c5-dfd6cf98b7fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:14:54.500949 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-8f196e9b-5e98-4a61-b6c5-dfd6cf98b7fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:14:54.500949 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:54.500949 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:54.500949 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:54.500949 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:54.500949 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:54.500949 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:54.500949 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:54.500949 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:54.500949 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:54.500949 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:54.500949 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:54.500949 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:14:54.500949 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:14:54.500949 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:14:54.500949 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:14:54.501928 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:14:54.501928 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:14:54.501928 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:14:54.501928 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:14:54.501928 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:54.501928 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:54.501928 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:54.501928 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:54.501928 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:54.501928 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:54.501928 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:54.501928 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:54.501928 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:54.501928 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:54.501928 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:54.501928 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:54.502822 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:54.502822 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:54.502822 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:54.502822 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:54.502822 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:14:54.502822 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:14:54.502822 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:14:54.502822 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:14:54.502822 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:14:54.502822 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:14:54.502822 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:14:54.502822 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:54.502822 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 539/1087] 10.222.0.32 () {56 vars in 1096 bytes} [Wed Jun 1 04:14:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:54.508172 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af3809-e56f-4d4c-bd95-2415b768727d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:54.564270 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa4940-8544-4bd6-8448-565269b81994 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:54.564559 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa4940-8544-4bd6-8448-565269b81994 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:54.564846 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa4940-8544-4bd6-8448-565269b81994 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:54.566317 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 540/1088] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:14:54.571507 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217971fb-aa1f-4d19-bf89-ad5902127837 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:54.571794 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217971fb-aa1f-4d19-bf89-ad5902127837 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:54.572081 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217971fb-aa1f-4d19-bf89-ad5902127837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:54.589920 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-217971fb-aa1f-4d19-bf89-ad5902127837 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:54.591154 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-217971fb-aa1f-4d19-bf89-ad5902127837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:54.606986 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af3809-e56f-4d4c-bd95-2415b768727d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:54.640274 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb6b90-c765-4170-a468-81bc8a21b598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:54.640928 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb6b90-c765-4170-a468-81bc8a21b598 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:54.641211 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb6b90-c765-4170-a468-81bc8a21b598 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:54.641487 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb6b90-c765-4170-a468-81bc8a21b598 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:54.642261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb6b90-c765-4170-a468-81bc8a21b598 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:54.642571 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb6b90-c765-4170-a468-81bc8a21b598 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:54.644489 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb6b90-c765-4170-a468-81bc8a21b598 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:54.653018 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 549/1089] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:14:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:54.659392 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb6b90-c765-4170-a468-81bc8a21b598 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:54.660768 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 541/1090] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 04:14:54.684043 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:54.684233 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217971fb-aa1f-4d19-bf89-ad5902127837 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:54.724997 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:54.759090 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb6b90-c765-4170-a468-81bc8a21b598 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:54.785875 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217971fb-aa1f-4d19-bf89-ad5902127837 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:54.791916 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32a7e9-0c68-491b-87d7-461c9f8d85b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:54.792793 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32a7e9-0c68-491b-87d7-461c9f8d85b5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:54.793075 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32a7e9-0c68-491b-87d7-461c9f8d85b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:54.793350 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32a7e9-0c68-491b-87d7-461c9f8d85b5 None admin] PATH_INFO: `/v3/users/87db9008e8ac454aa66dd53f246a71ae` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:54.794549 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32a7e9-0c68-491b-87d7-461c9f8d85b5 None admin] RBAC: Authorizing `identity:get_user(user_id=87db9008e8ac454aa66dd53f246a71ae)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:54.795965 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32a7e9-0c68-491b-87d7-461c9f8d85b5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:54.797582 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 550/1091] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:14:54 2022] GET /identity/v3/users/87db9008e8ac454aa66dd53f246a71ae => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:54.803220 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32a7e9-0c68-491b-87d7-461c9f8d85b5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:54.820597 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f5108-8a75-400b-aa9c-b397ae915f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:54.821401 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f5108-8a75-400b-aa9c-b397ae915f26 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:54.821682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f5108-8a75-400b-aa9c-b397ae915f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:54.821954 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f5108-8a75-400b-aa9c-b397ae915f26 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:54.833075 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4f5108-8a75-400b-aa9c-b397ae915f26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:14:54.841108 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-cf4f5108-8a75-400b-aa9c-b397ae915f26 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 01 04:14:54.841108 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:54.841108 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:54.841108 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:54.841108 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:54.841108 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:54.841108 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:54.841108 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:54.841108 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:54.841108 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:54.841108 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:54.841108 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:54.841108 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:14:54.841108 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:14:54.841108 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:14:54.841108 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:14:54.842098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:14:54.842098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:14:54.842098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:14:54.842098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:14:54.842098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:54.842098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:54.842098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:54.842098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:54.842098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:54.842098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:54.842098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:54.842098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:54.842098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:54.842098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:54.842098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:54.842098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:54.842966 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:54.842966 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:54.842966 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:54.842966 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:54.842966 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:14:54.842966 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:14:54.842966 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:14:54.842966 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:14:54.842966 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:14:54.842966 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:14:54.842966 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 01 04:14:54.842966 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:54.842966 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 542/1092] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Jun 1 04:14:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:14:54.848172 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f5108-8a75-400b-aa9c-b397ae915f26 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:54.894967 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:54.904496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32a7e9-0c68-491b-87d7-461c9f8d85b5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:54.939198 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a340b96-8672-438f-be93-6b4ceca4b186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:54.939844 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a340b96-8672-438f-be93-6b4ceca4b186 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:54.940665 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a340b96-8672-438f-be93-6b4ceca4b186 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:54.940939 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a340b96-8672-438f-be93-6b4ceca4b186 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:54.948082 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:54.952234 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f5108-8a75-400b-aa9c-b397ae915f26 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:54.989389 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddace842-57fa-4af3-9738-2f9cbac83ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:54.990211 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddace842-57fa-4af3-9738-2f9cbac83ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:54.990548 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddace842-57fa-4af3-9738-2f9cbac83ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:54.990880 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddace842-57fa-4af3-9738-2f9cbac83ff0 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:54.991688 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddace842-57fa-4af3-9738-2f9cbac83ff0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:54.992059 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddace842-57fa-4af3-9738-2f9cbac83ff0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:54.993698 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddace842-57fa-4af3-9738-2f9cbac83ff0 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:55.002337 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 543/1093] 10.222.0.32 () {56 vars in 1115 bytes} [Wed Jun 1 04:14:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:55.008351 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddace842-57fa-4af3-9738-2f9cbac83ff0 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:55.016821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a340b96-8672-438f-be93-6b4ceca4b186 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:55.018349 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a340b96-8672-438f-be93-6b4ceca4b186 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:55.107319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:55.108886 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddace842-57fa-4af3-9738-2f9cbac83ff0 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:55.123044 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 551/1094] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:14:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 01 04:14:55.124141 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a340b96-8672-438f-be93-6b4ceca4b186 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:55.143694 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac77cb0-6a38-4b65-8100-8b57ae1d7d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:55.144490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac77cb0-6a38-4b65-8100-8b57ae1d7d77 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:55.144774 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac77cb0-6a38-4b65-8100-8b57ae1d7d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:55.145049 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac77cb0-6a38-4b65-8100-8b57ae1d7d77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:55.160812 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac77cb0-6a38-4b65-8100-8b57ae1d7d77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:55.162303 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac77cb0-6a38-4b65-8100-8b57ae1d7d77 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:55.180072 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-9ac77cb0-6a38-4b65-8100-8b57ae1d7d77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:55.180072 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:55.180072 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:55.180072 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:55.180072 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:55.180072 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:55.180072 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:55.180072 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:55.180072 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:55.180072 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:55.180072 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:55.180072 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:55.180072 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:14:55.180072 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:14:55.180072 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:14:55.181212 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:14:55.181212 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:55.181212 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:55.181212 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:55.181212 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:55.181212 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:55.181212 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:55.181212 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:55.181212 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:55.181212 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:55.181212 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:55.181212 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:55.181212 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:55.181212 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:55.181212 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:55.181212 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:55.181212 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:55.182317 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:14:55.182317 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:14:55.182317 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:55.182317 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:55.182317 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 544/1095] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:14:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:14:55.186914 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac77cb0-6a38-4b65-8100-8b57ae1d7d77 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:55.202030 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:55.228273 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a340b96-8672-438f-be93-6b4ceca4b186 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:55.261480 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6cc629-4b3c-4117-b24c-e667203891b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:55.262278 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6cc629-4b3c-4117-b24c-e667203891b6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:55.262563 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6cc629-4b3c-4117-b24c-e667203891b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:55.262837 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6cc629-4b3c-4117-b24c-e667203891b6 None admin] PATH_INFO: `/v3/projects/b9cd6e4044874633821928cacb39628a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:55.264039 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6cc629-4b3c-4117-b24c-e667203891b6 None admin] RBAC: Authorizing `identity:get_project(project_id=b9cd6e4044874633821928cacb39628a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:55.265469 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6cc629-4b3c-4117-b24c-e667203891b6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:55.267221 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 552/1096] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:14:55 2022] GET /identity/v3/projects/b9cd6e4044874633821928cacb39628a => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:55.273812 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6cc629-4b3c-4117-b24c-e667203891b6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:55.294155 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac77cb0-6a38-4b65-8100-8b57ae1d7d77 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:55.327616 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9bbd1-3c2d-49ce-8063-79fd6c33e6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:55.328273 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9bbd1-3c2d-49ce-8063-79fd6c33e6b7 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:55.328554 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9bbd1-3c2d-49ce-8063-79fd6c33e6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:55.328829 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9bbd1-3c2d-49ce-8063-79fd6c33e6b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:55.329542 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9bbd1-3c2d-49ce-8063-79fd6c33e6b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:55.329848 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9bbd1-3c2d-49ce-8063-79fd6c33e6b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:55.331779 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9bbd1-3c2d-49ce-8063-79fd6c33e6b7 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:55.333609 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:55.344137 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 545/1097] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:55.350178 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9bbd1-3c2d-49ce-8063-79fd6c33e6b7 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:55.374277 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6cc629-4b3c-4117-b24c-e667203891b6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:55.408064 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b44c8-605b-464b-8082-6eabbf04a5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:55.408688 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b44c8-605b-464b-8082-6eabbf04a5eb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:55.409534 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b44c8-605b-464b-8082-6eabbf04a5eb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:55.409812 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b44c8-605b-464b-8082-6eabbf04a5eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:55.410667 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b44c8-605b-464b-8082-6eabbf04a5eb None admin] RBAC: Adding query filter params (role.id=76fc054ad9544460a7be1e2010c23642, scope.project.id=b9cd6e4044874633821928cacb39628a, user.id=87db9008e8ac454aa66dd53f246a71ae) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:55.410978 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b44c8-605b-464b-8082-6eabbf04a5eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:55.412416 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b44c8-605b-464b-8082-6eabbf04a5eb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:55.418260 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 553/1098] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:14:55 2022] GET /identity/v3/role_assignments?user.id=87db9008e8ac454aa66dd53f246a71ae&scope.project.id=b9cd6e4044874633821928cacb39628a&role.id=76fc054ad9544460a7be1e2010c23642 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:55.420399 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:55.456172 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9bbd1-3c2d-49ce-8063-79fd6c33e6b7 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:55.495678 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97843b9-b950-4b5e-be5b-0b35786df969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:55.496522 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97843b9-b950-4b5e-be5b-0b35786df969 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:55.496805 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97843b9-b950-4b5e-be5b-0b35786df969 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:55.497084 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97843b9-b950-4b5e-be5b-0b35786df969 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:55.506255 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97843b9-b950-4b5e-be5b-0b35786df969 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:55.507841 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97843b9-b950-4b5e-be5b-0b35786df969 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:55.525306 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-e97843b9-b950-4b5e-be5b-0b35786df969 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 01 04:14:55.525306 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:55.525306 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:55.525306 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:55.525306 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:55.525306 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:55.525306 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:55.525306 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:55.525306 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:55.525306 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:55.525306 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:55.525306 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:55.525306 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 04:14:55.525306 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 04:14:55.525306 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 04:14:55.525306 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 04:14:55.526367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:55.526367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:55.526367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 04:14:55.526367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:14:55.526367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 04:14:55.526367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:14:55.526367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:55.526367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:55.526367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:55.526367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:55.526367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:55.526367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:55.526367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:55.526367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:55.526367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:55.526367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:55.526367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:55.526367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:55.527359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:55.527359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:55.527359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 04:14:55.527359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 04:14:55.527359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 04:14:55.527359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 04:14:55.527359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 04:14:55.527359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 04:14:55.527359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 01 04:14:55.527359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:14:55.527359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 546/1099] 10.222.0.32 () {56 vars in 1093 bytes} [Wed Jun 1 04:14:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:14:55.533110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b44c8-605b-464b-8082-6eabbf04a5eb None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:55.644458 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b44c8-605b-464b-8082-6eabbf04a5eb None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:55.673179 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:55.686079 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c2189-c561-454d-8a32-4ef7f95ac3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:55.686923 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c2189-c561-454d-8a32-4ef7f95ac3a2 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:55.687220 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c2189-c561-454d-8a32-4ef7f95ac3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:55.687530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c2189-c561-454d-8a32-4ef7f95ac3a2 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:55.688670 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c2189-c561-454d-8a32-4ef7f95ac3a2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:55.688985 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c2189-c561-454d-8a32-4ef7f95ac3a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:55.691232 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c2189-c561-454d-8a32-4ef7f95ac3a2 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:55.712749 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 554/1100] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Jun 1 04:14:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:55.718569 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97843b9-b950-4b5e-be5b-0b35786df969 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:55.819099 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97843b9-b950-4b5e-be5b-0b35786df969 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:55.849530 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:55.855397 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062913ed-41ac-4a59-ab98-b5b3b31684a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:55.856044 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062913ed-41ac-4a59-ab98-b5b3b31684a3 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:55.856323 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062913ed-41ac-4a59-ab98-b5b3b31684a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:55.856594 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062913ed-41ac-4a59-ab98-b5b3b31684a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:55.925604 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062913ed-41ac-4a59-ab98-b5b3b31684a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:55.927094 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062913ed-41ac-4a59-ab98-b5b3b31684a3 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:56.073516 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 547/1101] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:14:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 01 04:14:56.079028 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c2189-c561-454d-8a32-4ef7f95ac3a2 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:56.178406 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c2189-c561-454d-8a32-4ef7f95ac3a2 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:56.211921 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4bac0-37ad-43ea-a25b-4ff1febae285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:56.212726 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4bac0-37ad-43ea-a25b-4ff1febae285 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:56.213012 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4bac0-37ad-43ea-a25b-4ff1febae285 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:56.213292 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4bac0-37ad-43ea-a25b-4ff1febae285 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:56.223322 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4bac0-37ad-43ea-a25b-4ff1febae285 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:56.224761 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4bac0-37ad-43ea-a25b-4ff1febae285 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:56.242530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-5ff4bac0-37ad-43ea-a25b-4ff1febae285 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:56.242530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:56.242530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:56.242530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:56.242530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:56.242530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:56.242530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:56.242530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:56.242530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:56.242530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:56.242530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:56.242530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:56.242530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:14:56.242530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:14:56.242530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:14:56.243956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:14:56.243956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:56.243956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:56.243956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:56.243956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:56.243956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:56.243956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:56.243956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:56.243956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:56.243956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:56.243956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:56.243956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:56.243956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:56.243956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:56.243956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:56.243956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:56.243956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:56.245083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:14:56.245083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:14:56.245083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:14:56.245083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:56.245083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 555/1102] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:14:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:56.249336 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062913ed-41ac-4a59-ab98-b5b3b31684a3 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:56.279890 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:56.349708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062913ed-41ac-4a59-ab98-b5b3b31684a3 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:56.383845 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8b050-1e02-456b-bcf9-aae66953fdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:56.384504 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8b050-1e02-456b-bcf9-aae66953fdbf None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:56.384791 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8b050-1e02-456b-bcf9-aae66953fdbf None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:56.385080 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8b050-1e02-456b-bcf9-aae66953fdbf None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:56.385796 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf8b050-1e02-456b-bcf9-aae66953fdbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:56.386138 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf8b050-1e02-456b-bcf9-aae66953fdbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:56.387510 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf8b050-1e02-456b-bcf9-aae66953fdbf None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:56.398743 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 548/1103] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:56.404371 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4bac0-37ad-43ea-a25b-4ff1febae285 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:56.438604 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:56.503931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4bac0-37ad-43ea-a25b-4ff1febae285 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:56.536751 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b06504-63ce-40bb-832e-3e9cb39396ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:56.537537 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b06504-63ce-40bb-832e-3e9cb39396ac None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:56.537815 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b06504-63ce-40bb-832e-3e9cb39396ac None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:56.538121 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b06504-63ce-40bb-832e-3e9cb39396ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:56.544618 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b06504-63ce-40bb-832e-3e9cb39396ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:56.546071 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b06504-63ce-40bb-832e-3e9cb39396ac None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:56.559876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-31b06504-63ce-40bb-832e-3e9cb39396ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:14:56.559876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:14:56.559876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:14:56.559876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:14:56.559876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:14:56.559876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:14:56.559876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:14:56.559876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:14:56.559876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:14:56.559876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:14:56.559876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:14:56.559876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:14:56.559876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 04:14:56.559876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 04:14:56.559876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 04:14:56.560947 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 04:14:56.560947 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:14:56.560947 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:14:56.560947 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:14:56.560947 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:14:56.560947 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:14:56.560947 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:14:56.560947 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:14:56.560947 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:14:56.560947 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:14:56.560947 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:14:56.560947 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:14:56.560947 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:14:56.560947 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:14:56.560947 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:14:56.560947 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:14:56.560947 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:14:56.566729 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 04:14:56.566729 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 04:14:56.566729 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 04:14:56.566729 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 04:14:56.566729 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 04:14:56.566729 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 04:14:56.566729 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:14:56.566729 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:14:56.566729 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 556/1104] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:14:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:14:56.567220 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8b050-1e02-456b-bcf9-aae66953fdbf None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:56.656303 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:56.666658 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8b050-1e02-456b-bcf9-aae66953fdbf None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:56.699929 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a7268-969a-42f4-9644-170460ee793a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:56.700577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a7268-969a-42f4-9644-170460ee793a None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:56.700856 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a7268-969a-42f4-9644-170460ee793a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:56.701127 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a7268-969a-42f4-9644-170460ee793a None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:56.701903 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a7268-969a-42f4-9644-170460ee793a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:56.702236 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a7268-969a-42f4-9644-170460ee793a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:56.703659 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a7268-969a-42f4-9644-170460ee793a None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:56.716373 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 549/1105] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Jun 1 04:14:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:14:56.723024 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b06504-63ce-40bb-832e-3e9cb39396ac None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:56.814303 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:56.821760 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b06504-63ce-40bb-832e-3e9cb39396ac None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:56.856085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5da45a-f573-4d6a-b756-8d5aeb83835d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:56.856739 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5da45a-f573-4d6a-b756-8d5aeb83835d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:56.857022 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5da45a-f573-4d6a-b756-8d5aeb83835d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:56.857299 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5da45a-f573-4d6a-b756-8d5aeb83835d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:56.858171 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5da45a-f573-4d6a-b756-8d5aeb83835d None admin] RBAC: Adding query filter params (role.id=0f6437212f954ee1a3bdb42ffc3458e7, scope.project.id=31d68f64d21647688074554062952074, user.id=79d614f85f5541d3babbb41468cbf55c) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:14:56.858488 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5da45a-f573-4d6a-b756-8d5aeb83835d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:56.859926 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5da45a-f573-4d6a-b756-8d5aeb83835d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:56.865768 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 557/1106] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:14:56 2022] GET /identity/v3/role_assignments?user.id=79d614f85f5541d3babbb41468cbf55c&scope.project.id=31d68f64d21647688074554062952074&role.id=0f6437212f954ee1a3bdb42ffc3458e7 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:57.794938 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d7de1-26f4-451c-be05-b666891c8de1 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:57.795499 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d7de1-26f4-451c-be05-b666891c8de1 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:57.795499 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d7de1-26f4-451c-be05-b666891c8de1 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:57.796861 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 550/1107] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:14:57.802015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11386cb-b831-4c37-80b5-02322fe4f2d9 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:57.802435 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11386cb-b831-4c37-80b5-02322fe4f2d9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:57.802571 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11386cb-b831-4c37-80b5-02322fe4f2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:57.819766 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c11386cb-b831-4c37-80b5-02322fe4f2d9 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:14:57.820926 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c11386cb-b831-4c37-80b5-02322fe4f2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:14:57.885144 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 558/1108] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:14:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:14:57.909993 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d7de1-26f4-451c-be05-b666891c8de1 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:58.008743 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d7de1-26f4-451c-be05-b666891c8de1 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:58.041301 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4704807-d0ad-4383-8fb3-88fc40c9cf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:58.042109 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4704807-d0ad-4383-8fb3-88fc40c9cf29 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:58.042392 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4704807-d0ad-4383-8fb3-88fc40c9cf29 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:58.042665 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4704807-d0ad-4383-8fb3-88fc40c9cf29 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:58.043820 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4704807-d0ad-4383-8fb3-88fc40c9cf29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:58.045287 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4704807-d0ad-4383-8fb3-88fc40c9cf29 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:58.046867 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 551/1109] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:14:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:14:58.052632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11386cb-b831-4c37-80b5-02322fe4f2d9 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:14:58.136060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:14:58.148755 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11386cb-b831-4c37-80b5-02322fe4f2d9 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:14:58.182547 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033f1fe-9c58-471e-87f6-440cb2cbab5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:14:58.183220 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033f1fe-9c58-471e-87f6-440cb2cbab5f None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:14:58.183504 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033f1fe-9c58-471e-87f6-440cb2cbab5f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:14:58.183779 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033f1fe-9c58-471e-87f6-440cb2cbab5f None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:14:58.184473 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033f1fe-9c58-471e-87f6-440cb2cbab5f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:14:58.185909 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033f1fe-9c58-471e-87f6-440cb2cbab5f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:14:58.206074 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 559/1110] 10.222.0.32 () {60 vars in 1132 bytes} [Wed Jun 1 04:14:58 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:15:00.468383 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac44f3a-3871-4103-a769-0e1311e896e4 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:00.468925 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac44f3a-3871-4103-a769-0e1311e896e4 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:00.468925 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac44f3a-3871-4103-a769-0e1311e896e4 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:00.470250 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 552/1111] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:15:00.475904 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7dc48-5e04-4e94-9ce4-8171a369d939 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:00.476275 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7dc48-5e04-4e94-9ce4-8171a369d939 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:00.476460 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7dc48-5e04-4e94-9ce4-8171a369d939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:00.492743 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-8ac7dc48-5e04-4e94-9ce4-8171a369d939 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:15:00.493914 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8ac7dc48-5e04-4e94-9ce4-8171a369d939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:15:00.558448 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 560/1112] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:15:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:15:00.582219 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac44f3a-3871-4103-a769-0e1311e896e4 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:00.604157 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:00.681841 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac44f3a-3871-4103-a769-0e1311e896e4 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:00.714730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262641c-130a-4f8c-94f4-76d826e699f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:00.715570 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262641c-130a-4f8c-94f4-76d826e699f1 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:00.715853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262641c-130a-4f8c-94f4-76d826e699f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:00.716129 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262641c-130a-4f8c-94f4-76d826e699f1 None admin] PATH_INFO: `/v3/roles/71e70e8fe1344699a131764a348d51d6` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:00.717583 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262641c-130a-4f8c-94f4-76d826e699f1 None admin] RBAC: Authorizing `identity:get_role(role_id=71e70e8fe1344699a131764a348d51d6)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:00.719021 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262641c-130a-4f8c-94f4-76d826e699f1 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:00.720323 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 553/1113] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:15:00 2022] GET /identity/v3/roles/71e70e8fe1344699a131764a348d51d6 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:15:00.726726 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7dc48-5e04-4e94-9ce4-8171a369d939 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:00.800322 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:00.826179 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7dc48-5e04-4e94-9ce4-8171a369d939 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:00.859212 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97adeb-ee2f-416b-bc27-1c06c90ad5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:00.860090 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97adeb-ee2f-416b-bc27-1c06c90ad5ef None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:00.860374 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97adeb-ee2f-416b-bc27-1c06c90ad5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:00.860651 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97adeb-ee2f-416b-bc27-1c06c90ad5ef None admin] PATH_INFO: `/v3/users/85c3814cff184590be679650e490c3d4` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:00.873916 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97adeb-ee2f-416b-bc27-1c06c90ad5ef None admin] RBAC: Authorizing `identity:get_user(user_id=85c3814cff184590be679650e490c3d4)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:00.875411 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97adeb-ee2f-416b-bc27-1c06c90ad5ef None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:00.877102 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 561/1114] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:15:00 2022] GET /identity/v3/users/85c3814cff184590be679650e490c3d4 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:15:00.883699 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262641c-130a-4f8c-94f4-76d826e699f1 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:00.972079 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:00.985264 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262641c-130a-4f8c-94f4-76d826e699f1 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:01.022514 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a0263-2056-4207-bdde-3a70157c9095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:01.023161 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a0263-2056-4207-bdde-3a70157c9095 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:01.023446 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a0263-2056-4207-bdde-3a70157c9095 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:01.023725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a0263-2056-4207-bdde-3a70157c9095 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:01.090858 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a0263-2056-4207-bdde-3a70157c9095 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:01.092302 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a0263-2056-4207-bdde-3a70157c9095 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:01.177166 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:01.190464 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 554/1115] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:15:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 01 04:15:01.196701 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97adeb-ee2f-416b-bc27-1c06c90ad5ef None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:01.291222 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97adeb-ee2f-416b-bc27-1c06c90ad5ef None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:01.320081 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:01.325195 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db18c9d-e7d5-419a-acd9-1d1a4bdb1bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:01.326079 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db18c9d-e7d5-419a-acd9-1d1a4bdb1bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:01.326362 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db18c9d-e7d5-419a-acd9-1d1a4bdb1bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:01.326635 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db18c9d-e7d5-419a-acd9-1d1a4bdb1bc8 None admin] PATH_INFO: `/v3/projects/b9cd6e4044874633821928cacb39628a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:01.327790 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db18c9d-e7d5-419a-acd9-1d1a4bdb1bc8 None admin] RBAC: Authorizing `identity:get_project(project_id=b9cd6e4044874633821928cacb39628a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:01.329211 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db18c9d-e7d5-419a-acd9-1d1a4bdb1bc8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:01.330964 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 562/1116] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:15:01 2022] GET /identity/v3/projects/b9cd6e4044874633821928cacb39628a => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:15:01.337124 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a0263-2056-4207-bdde-3a70157c9095 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:01.433992 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a0263-2056-4207-bdde-3a70157c9095 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:01.467437 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3719a1-55a9-45b4-a471-d8f5d0c6a7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:01.468088 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3719a1-55a9-45b4-a471-d8f5d0c6a7e9 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:01.468373 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3719a1-55a9-45b4-a471-d8f5d0c6a7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:01.468653 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3719a1-55a9-45b4-a471-d8f5d0c6a7e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:01.469479 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3719a1-55a9-45b4-a471-d8f5d0c6a7e9 None admin] RBAC: Adding query filter params (role.id=71e70e8fe1344699a131764a348d51d6, scope.project.id=b9cd6e4044874633821928cacb39628a, user.id=85c3814cff184590be679650e490c3d4) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:15:01.470085 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3719a1-55a9-45b4-a471-d8f5d0c6a7e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:01.471571 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3719a1-55a9-45b4-a471-d8f5d0c6a7e9 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:01.477220 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 555/1117] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:15:01 2022] GET /identity/v3/role_assignments?user.id=85c3814cff184590be679650e490c3d4&scope.project.id=b9cd6e4044874633821928cacb39628a&role.id=71e70e8fe1344699a131764a348d51d6 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:15:03.676267 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff139b-9a5a-48bc-9f26-d37349278be5 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:03.676796 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff139b-9a5a-48bc-9f26-d37349278be5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:03.676796 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff139b-9a5a-48bc-9f26-d37349278be5 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:03.678241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 563/1118] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:15:03.683433 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549ef95-f195-49c8-8ffc-a7d0d0515a7d None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:03.683855 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549ef95-f195-49c8-8ffc-a7d0d0515a7d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:03.683987 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549ef95-f195-49c8-8ffc-a7d0d0515a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:03.700443 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-a549ef95-f195-49c8-8ffc-a7d0d0515a7d None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:15:03.701601 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a549ef95-f195-49c8-8ffc-a7d0d0515a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:15:03.746731 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:03.766176 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 556/1119] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:15:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:15:03.789648 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff139b-9a5a-48bc-9f26-d37349278be5 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:03.888870 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff139b-9a5a-48bc-9f26-d37349278be5 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:03.923048 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf4514-498d-4fdb-834c-ffb0933f0364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:03.923928 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf4514-498d-4fdb-834c-ffb0933f0364 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:03.924217 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf4514-498d-4fdb-834c-ffb0933f0364 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:03.924498 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf4514-498d-4fdb-834c-ffb0933f0364 None admin] PATH_INFO: `/v3/roles/71e70e8fe1344699a131764a348d51d6` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:03.925964 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf4514-498d-4fdb-834c-ffb0933f0364 None admin] RBAC: Authorizing `identity:get_role(role_id=71e70e8fe1344699a131764a348d51d6)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:03.927400 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf4514-498d-4fdb-834c-ffb0933f0364 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:03.928728 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 564/1120] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:15:03 2022] GET /identity/v3/roles/71e70e8fe1344699a131764a348d51d6 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:15:03.934682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549ef95-f195-49c8-8ffc-a7d0d0515a7d None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:04.031018 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549ef95-f195-49c8-8ffc-a7d0d0515a7d None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:04.063021 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ffd1b4-60c3-4ee2-b345-4d23ffae4a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:04.063882 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffd1b4-60c3-4ee2-b345-4d23ffae4a7e None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:04.064160 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffd1b4-60c3-4ee2-b345-4d23ffae4a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:04.064431 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffd1b4-60c3-4ee2-b345-4d23ffae4a7e None admin] PATH_INFO: `/v3/users/85c3814cff184590be679650e490c3d4` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:04.066154 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ffd1b4-60c3-4ee2-b345-4d23ffae4a7e None admin] RBAC: Authorizing `identity:get_user(user_id=85c3814cff184590be679650e490c3d4)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:04.067560 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ffd1b4-60c3-4ee2-b345-4d23ffae4a7e None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:04.069420 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 557/1121] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:15:03 2022] GET /identity/v3/users/85c3814cff184590be679650e490c3d4 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:15:04.075220 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf4514-498d-4fdb-834c-ffb0933f0364 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:04.138780 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:04.172569 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf4514-498d-4fdb-834c-ffb0933f0364 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:04.206864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f8a2f-83c2-49be-a160-b31e9ba29ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:04.207658 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f8a2f-83c2-49be-a160-b31e9ba29ffb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:04.207943 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f8a2f-83c2-49be-a160-b31e9ba29ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:04.208218 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f8a2f-83c2-49be-a160-b31e9ba29ffb None admin] PATH_INFO: `/v3/projects/b9cd6e4044874633821928cacb39628a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:04.209391 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f8a2f-83c2-49be-a160-b31e9ba29ffb None admin] RBAC: Authorizing `identity:get_project(project_id=b9cd6e4044874633821928cacb39628a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:04.210850 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f8a2f-83c2-49be-a160-b31e9ba29ffb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:04.212542 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 565/1122] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:15:04 2022] GET /identity/v3/projects/b9cd6e4044874633821928cacb39628a => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:15:04.218529 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ffd1b4-60c3-4ee2-b345-4d23ffae4a7e None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:04.268625 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:04.318427 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ffd1b4-60c3-4ee2-b345-4d23ffae4a7e None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:04.355549 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340e8a0-24f9-4d80-8dba-9eae8f13a910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:04.356439 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340e8a0-24f9-4d80-8dba-9eae8f13a910 None admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:04.356727 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340e8a0-24f9-4d80-8dba-9eae8f13a910 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:04.357006 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340e8a0-24f9-4d80-8dba-9eae8f13a910 None admin] PATH_INFO: `/v3/projects/b9cd6e4044874633821928cacb39628a/users/85c3814cff184590be679650e490c3d4/roles/71e70e8fe1344699a131764a348d51d6` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:04.359240 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340e8a0-24f9-4d80-8dba-9eae8f13a910 None admin] RBAC: Authorizing `identity:create_grant(project_id=b9cd6e4044874633821928cacb39628a, user_id=85c3814cff184590be679650e490c3d4, role_id=71e70e8fe1344699a131764a348d51d6)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:04.360675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340e8a0-24f9-4d80-8dba-9eae8f13a910 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:04.374195 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 558/1123] 10.222.0.32 () {58 vars in 1439 bytes} [Wed Jun 1 04:15:04 2022] PUT /identity/v3/projects/b9cd6e4044874633821928cacb39628a/users/85c3814cff184590be679650e490c3d4/roles/71e70e8fe1344699a131764a348d51d6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:15:06.620163 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a98fa-d369-42d3-8e01-5ef9638775e5 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:06.620712 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a98fa-d369-42d3-8e01-5ef9638775e5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:06.620712 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a98fa-d369-42d3-8e01-5ef9638775e5 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:06.622108 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 566/1124] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:15:06.627879 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51463745-5fb5-49bc-853c-3239819db262 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:06.628371 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51463745-5fb5-49bc-853c-3239819db262 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:06.628516 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51463745-5fb5-49bc-853c-3239819db262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:06.645052 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-51463745-5fb5-49bc-853c-3239819db262 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:15:06.646268 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-51463745-5fb5-49bc-853c-3239819db262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:15:06.712623 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 559/1125] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:15:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:15:06.736836 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a98fa-d369-42d3-8e01-5ef9638775e5 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:06.834379 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a98fa-d369-42d3-8e01-5ef9638775e5 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:06.868045 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d4ea1-d75a-4992-907c-35742448f918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:06.868900 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d4ea1-d75a-4992-907c-35742448f918 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:06.869184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d4ea1-d75a-4992-907c-35742448f918 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:06.869459 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d4ea1-d75a-4992-907c-35742448f918 None admin] PATH_INFO: `/v3/roles/71e70e8fe1344699a131764a348d51d6` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:06.870988 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368d4ea1-d75a-4992-907c-35742448f918 None admin] RBAC: Authorizing `identity:get_role(role_id=71e70e8fe1344699a131764a348d51d6)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:06.872290 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368d4ea1-d75a-4992-907c-35742448f918 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:06.873661 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 567/1126] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:15:06 2022] GET /identity/v3/roles/71e70e8fe1344699a131764a348d51d6 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:15:06.879635 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51463745-5fb5-49bc-853c-3239819db262 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:06.921112 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:06.985644 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51463745-5fb5-49bc-853c-3239819db262 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:07.021165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c45b4-5adc-4bda-8627-6734fbdee4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:07.022059 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c45b4-5adc-4bda-8627-6734fbdee4cb None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:07.022344 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c45b4-5adc-4bda-8627-6734fbdee4cb None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:07.022618 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c45b4-5adc-4bda-8627-6734fbdee4cb None admin] PATH_INFO: `/v3/users/85c3814cff184590be679650e490c3d4` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:07.023798 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c45b4-5adc-4bda-8627-6734fbdee4cb None admin] RBAC: Authorizing `identity:get_user(user_id=85c3814cff184590be679650e490c3d4)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:07.025244 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c45b4-5adc-4bda-8627-6734fbdee4cb None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:07.026892 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 560/1127] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:15:06 2022] GET /identity/v3/users/85c3814cff184590be679650e490c3d4 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:15:07.032636 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d4ea1-d75a-4992-907c-35742448f918 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:07.036892 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:07.129948 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d4ea1-d75a-4992-907c-35742448f918 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:07.162977 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d21009-ed78-48aa-b219-9d44811b1d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:07.163626 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d21009-ed78-48aa-b219-9d44811b1d62 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:07.163911 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d21009-ed78-48aa-b219-9d44811b1d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:07.164180 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d21009-ed78-48aa-b219-9d44811b1d62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:07.229117 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d21009-ed78-48aa-b219-9d44811b1d62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:07.230598 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d21009-ed78-48aa-b219-9d44811b1d62 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:07.233168 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:07.324737 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 568/1128] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:15:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 01 04:15:07.331153 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c45b4-5adc-4bda-8627-6734fbdee4cb None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:07.428223 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c45b4-5adc-4bda-8627-6734fbdee4cb None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:07.442075 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:07.467869 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaef884-5ebf-444f-bd7b-6ca5bbdceb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:07.468721 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaef884-5ebf-444f-bd7b-6ca5bbdceb44 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:07.469003 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaef884-5ebf-444f-bd7b-6ca5bbdceb44 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:07.469280 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaef884-5ebf-444f-bd7b-6ca5bbdceb44 None admin] PATH_INFO: `/v3/projects/b9cd6e4044874633821928cacb39628a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:07.470495 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaef884-5ebf-444f-bd7b-6ca5bbdceb44 None admin] RBAC: Authorizing `identity:get_project(project_id=b9cd6e4044874633821928cacb39628a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:07.472586 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaef884-5ebf-444f-bd7b-6ca5bbdceb44 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:07.474446 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 561/1129] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:15:07 2022] GET /identity/v3/projects/b9cd6e4044874633821928cacb39628a => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:15:07.480960 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d21009-ed78-48aa-b219-9d44811b1d62 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:07.584434 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d21009-ed78-48aa-b219-9d44811b1d62 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:07.586820 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:07.617693 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db624d-febd-4412-a3b5-224a2de90814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:07.618364 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db624d-febd-4412-a3b5-224a2de90814 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:07.618650 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db624d-febd-4412-a3b5-224a2de90814 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:07.618925 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db624d-febd-4412-a3b5-224a2de90814 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:07.619747 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db624d-febd-4412-a3b5-224a2de90814 None admin] RBAC: Adding query filter params (role.id=71e70e8fe1344699a131764a348d51d6, scope.project.id=b9cd6e4044874633821928cacb39628a, user.id=85c3814cff184590be679650e490c3d4) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:15:07.620057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db624d-febd-4412-a3b5-224a2de90814 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:07.621473 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db624d-febd-4412-a3b5-224a2de90814 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:07.627695 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 569/1130] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:15:07 2022] GET /identity/v3/role_assignments?user.id=85c3814cff184590be679650e490c3d4&scope.project.id=b9cd6e4044874633821928cacb39628a&role.id=71e70e8fe1344699a131764a348d51d6 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:15:09.889588 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7ebe2-3242-45ce-9035-832c513b591b None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:09.890142 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7ebe2-3242-45ce-9035-832c513b591b None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:09.890259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7ebe2-3242-45ce-9035-832c513b591b None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:09.891536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 562/1131] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:15:09.897514 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb070b2-39ba-410f-86f1-c6829a29d1d4 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:09.897937 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb070b2-39ba-410f-86f1-c6829a29d1d4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:09.898117 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb070b2-39ba-410f-86f1-c6829a29d1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:09.914357 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-8fb070b2-39ba-410f-86f1-c6829a29d1d4 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:15:09.915538 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8fb070b2-39ba-410f-86f1-c6829a29d1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:15:09.980671 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 570/1132] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:15:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:15:10.004726 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7ebe2-3242-45ce-9035-832c513b591b None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:10.104296 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7ebe2-3242-45ce-9035-832c513b591b None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:10.137329 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d7f63-aa01-4d80-b7ae-0130ab2ac8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:10.138145 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d7f63-aa01-4d80-b7ae-0130ab2ac8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:10.138431 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d7f63-aa01-4d80-b7ae-0130ab2ac8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:10.138710 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d7f63-aa01-4d80-b7ae-0130ab2ac8c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:10.139932 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d7f63-aa01-4d80-b7ae-0130ab2ac8c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:10.141317 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d7f63-aa01-4d80-b7ae-0130ab2ac8c6 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:10.143523 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 563/1133] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:15:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:15:10.149578 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb070b2-39ba-410f-86f1-c6829a29d1d4 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:10.243777 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:10.247893 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb070b2-39ba-410f-86f1-c6829a29d1d4 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:10.281258 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034186af-0887-4bbd-a516-555027b5d4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:10.281919 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034186af-0887-4bbd-a516-555027b5d4ab None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:10.282233 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034186af-0887-4bbd-a516-555027b5d4ab None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:10.282511 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034186af-0887-4bbd-a516-555027b5d4ab None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:10.283243 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034186af-0887-4bbd-a516-555027b5d4ab None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:10.284669 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034186af-0887-4bbd-a516-555027b5d4ab None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:10.310204 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 571/1134] 10.222.0.32 () {60 vars in 1141 bytes} [Wed Jun 1 04:15:10 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:15:12.607547 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba68932-638c-4332-b9fc-a5db0d596222 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:12.608160 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba68932-638c-4332-b9fc-a5db0d596222 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:12.608160 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba68932-638c-4332-b9fc-a5db0d596222 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:12.609462 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 564/1135] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:15:12.615397 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a7fa4-8546-46bb-b8c1-3458b118e877 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:12.615825 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a7fa4-8546-46bb-b8c1-3458b118e877 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:12.615966 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a7fa4-8546-46bb-b8c1-3458b118e877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:12.633098 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c53a7fa4-8546-46bb-b8c1-3458b118e877 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:15:12.634326 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c53a7fa4-8546-46bb-b8c1-3458b118e877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:15:12.700913 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 572/1136] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:15:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:15:12.725940 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba68932-638c-4332-b9fc-a5db0d596222 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:12.774934 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:12.829669 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba68932-638c-4332-b9fc-a5db0d596222 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:12.864581 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c346a6-32b1-4b1f-ab12-e536e68fdffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:12.865319 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c346a6-32b1-4b1f-ab12-e536e68fdffc None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:12.865603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c346a6-32b1-4b1f-ab12-e536e68fdffc None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:12.865880 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c346a6-32b1-4b1f-ab12-e536e68fdffc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:12.867216 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c346a6-32b1-4b1f-ab12-e536e68fdffc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:12.868697 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c346a6-32b1-4b1f-ab12-e536e68fdffc None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:12.870478 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 565/1137] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:15:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:15:12.877230 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a7fa4-8546-46bb-b8c1-3458b118e877 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:12.963440 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:12.982950 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a7fa4-8546-46bb-b8c1-3458b118e877 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:13.016389 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6c343-7d32-45a7-b73b-e812af3af4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:13.017060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6c343-7d32-45a7-b73b-e812af3af4a5 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:13.017404 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6c343-7d32-45a7-b73b-e812af3af4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:13.018333 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6c343-7d32-45a7-b73b-e812af3af4a5 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:13.019038 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c6c343-7d32-45a7-b73b-e812af3af4a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:13.020460 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c6c343-7d32-45a7-b73b-e812af3af4a5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:13.040861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 573/1138] 10.222.0.32 () {60 vars in 1132 bytes} [Wed Jun 1 04:15:12 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:15:15.378946 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80132b58-83ba-4cfc-9ac4-c6969793b24c None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:15.379781 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80132b58-83ba-4cfc-9ac4-c6969793b24c None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:15.379781 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80132b58-83ba-4cfc-9ac4-c6969793b24c None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:15.381053 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 566/1139] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:15:15.387302 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e7689-786f-4d74-802b-66bf472efd79 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:15.388182 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e7689-786f-4d74-802b-66bf472efd79 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:15.388182 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e7689-786f-4d74-802b-66bf472efd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:15.405576 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a87e7689-786f-4d74-802b-66bf472efd79 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:15:15.406801 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a87e7689-786f-4d74-802b-66bf472efd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:15:15.476354 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 574/1140] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:15:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 04:15:15.500606 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80132b58-83ba-4cfc-9ac4-c6969793b24c None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:15.605033 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80132b58-83ba-4cfc-9ac4-c6969793b24c None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:15.620078 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:15.643703 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429cc24c-c5be-4d1d-996d-6f70b4a76e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:15.644543 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cc24c-c5be-4d1d-996d-6f70b4a76e1d None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:15.644863 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cc24c-c5be-4d1d-996d-6f70b4a76e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:15.645178 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cc24c-c5be-4d1d-996d-6f70b4a76e1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:15.655997 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429cc24c-c5be-4d1d-996d-6f70b4a76e1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:15:15.663650 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-429cc24c-c5be-4d1d-996d-6f70b4a76e1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:15:15.663650 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:15:15.663650 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:15:15.663650 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:15:15.663650 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:15:15.663650 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:15:15.663650 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:15:15.663650 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:15:15.663650 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:15:15.663650 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:15:15.663650 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:15:15.663650 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:15:15.663650 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:15:15.663650 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:15:15.663650 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:15:15.663650 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:15:15.664763 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:15:15.664763 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:15:15.664763 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:15:15.664763 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:15:15.664763 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:15:15.664763 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:15:15.664763 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:15:15.664763 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:15:15.664763 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:15:15.664763 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:15:15.664763 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:15:15.664763 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:15:15.664763 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:15:15.664763 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:15:15.664763 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:15:15.664763 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:15:15.666520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:15:15.666520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:15:15.666520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:15:15.666520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:15:15.666520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:15:15.666520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:15:15.666520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:15:15.666520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:15:15.666520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:15:15.666520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:15:15.666520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:15:15.666520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:15:15.666520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 567/1141] 10.222.0.32 () {56 vars in 1096 bytes} [Wed Jun 1 04:15:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:15:15.672197 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e7689-786f-4d74-802b-66bf472efd79 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:15.743089 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:15.779343 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e7689-786f-4d74-802b-66bf472efd79 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:15.814307 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28835c-f566-4b48-8d38-9db9a85739f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:15.815026 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28835c-f566-4b48-8d38-9db9a85739f5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:15.815346 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28835c-f566-4b48-8d38-9db9a85739f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:15.815659 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28835c-f566-4b48-8d38-9db9a85739f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:15.816450 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28835c-f566-4b48-8d38-9db9a85739f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:15:15.816806 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28835c-f566-4b48-8d38-9db9a85739f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:15.818507 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28835c-f566-4b48-8d38-9db9a85739f5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:15.827170 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 575/1142] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:15:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:15:15.833199 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429cc24c-c5be-4d1d-996d-6f70b4a76e1d None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:15.938979 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429cc24c-c5be-4d1d-996d-6f70b4a76e1d None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:15.974727 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5751de9-d0a1-4f3a-9588-bab77d2711f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:15.975667 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5751de9-d0a1-4f3a-9588-bab77d2711f1 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:15.975994 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5751de9-d0a1-4f3a-9588-bab77d2711f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:15.976317 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5751de9-d0a1-4f3a-9588-bab77d2711f1 None admin] PATH_INFO: `/v3/users/40c9ff889fcb4ca08f4d55d0f1e49496` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:15.991627 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5751de9-d0a1-4f3a-9588-bab77d2711f1 None admin] RBAC: Authorizing `identity:get_user(user_id=40c9ff889fcb4ca08f4d55d0f1e49496)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:15.993213 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5751de9-d0a1-4f3a-9588-bab77d2711f1 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:15.994970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 568/1143] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:15:15 2022] GET /identity/v3/users/40c9ff889fcb4ca08f4d55d0f1e49496 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:15:16.000961 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28835c-f566-4b48-8d38-9db9a85739f5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:16.103404 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28835c-f566-4b48-8d38-9db9a85739f5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:16.131654 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:16.140892 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221e7a0-36a8-4973-951e-bd40bca9d9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:16.141619 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221e7a0-36a8-4973-951e-bd40bca9d9eb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:16.141958 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221e7a0-36a8-4973-951e-bd40bca9d9eb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:16.142477 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221e7a0-36a8-4973-951e-bd40bca9d9eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:16.218386 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3221e7a0-36a8-4973-951e-bd40bca9d9eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:16.219837 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3221e7a0-36a8-4973-951e-bd40bca9d9eb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:16.319125 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 576/1144] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:15:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 01 04:15:16.325108 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5751de9-d0a1-4f3a-9588-bab77d2711f1 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:16.356403 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:16.429561 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5751de9-d0a1-4f3a-9588-bab77d2711f1 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:16.466114 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2ac8e-3b37-48ec-8f36-f9e68241d694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:16.467039 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2ac8e-3b37-48ec-8f36-f9e68241d694 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:16.467358 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2ac8e-3b37-48ec-8f36-f9e68241d694 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:16.467669 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2ac8e-3b37-48ec-8f36-f9e68241d694 None admin] PATH_INFO: `/v3/projects/7cece39c4976477e9e63b7101c6ce642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:16.468990 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2ac8e-3b37-48ec-8f36-f9e68241d694 None admin] RBAC: Authorizing `identity:get_project(project_id=7cece39c4976477e9e63b7101c6ce642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:16.471062 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2ac8e-3b37-48ec-8f36-f9e68241d694 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:16.472826 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 569/1145] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:15:16 2022] GET /identity/v3/projects/7cece39c4976477e9e63b7101c6ce642 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:15:16.479180 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221e7a0-36a8-4973-951e-bd40bca9d9eb None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:16.507541 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:16.586594 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221e7a0-36a8-4973-951e-bd40bca9d9eb None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:16.626214 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953dd72-1457-4a2a-a3ce-ee7b9478da94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:16.627462 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953dd72-1457-4a2a-a3ce-ee7b9478da94 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:16.627787 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953dd72-1457-4a2a-a3ce-ee7b9478da94 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:16.628105 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953dd72-1457-4a2a-a3ce-ee7b9478da94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:16.628985 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953dd72-1457-4a2a-a3ce-ee7b9478da94 None admin] RBAC: Adding query filter params (role.id=76fc054ad9544460a7be1e2010c23642, scope.project.id=7cece39c4976477e9e63b7101c6ce642, user.id=40c9ff889fcb4ca08f4d55d0f1e49496) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:15:16.629336 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953dd72-1457-4a2a-a3ce-ee7b9478da94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:16.630842 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953dd72-1457-4a2a-a3ce-ee7b9478da94 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:16.636957 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 577/1146] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:15:16 2022] GET /identity/v3/role_assignments?user.id=40c9ff889fcb4ca08f4d55d0f1e49496&scope.project.id=7cece39c4976477e9e63b7101c6ce642&role.id=76fc054ad9544460a7be1e2010c23642 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:15:19.294682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a09b1-ca3e-42bd-b5de-9c3153ac25dd None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:19.295221 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a09b1-ca3e-42bd-b5de-9c3153ac25dd None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:19.295221 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a09b1-ca3e-42bd-b5de-9c3153ac25dd None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:19.296606 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 570/1147] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:15:19.302270 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063c894-561e-4598-bb06-5b5b1371d538 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:19.303001 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063c894-561e-4598-bb06-5b5b1371d538 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:19.303001 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063c894-561e-4598-bb06-5b5b1371d538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:19.320248 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-0063c894-561e-4598-bb06-5b5b1371d538 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:15:19.321473 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0063c894-561e-4598-bb06-5b5b1371d538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:15:19.392843 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 578/1148] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:15:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:15:19.416962 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a09b1-ca3e-42bd-b5de-9c3153ac25dd None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:19.525367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:19.530393 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a09b1-ca3e-42bd-b5de-9c3153ac25dd None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:19.569727 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5a341-383d-46a0-8b71-6b6dc78ace72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:19.570556 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5a341-383d-46a0-8b71-6b6dc78ace72 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:19.570837 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5a341-383d-46a0-8b71-6b6dc78ace72 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:19.571110 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5a341-383d-46a0-8b71-6b6dc78ace72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:19.582215 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5a341-383d-46a0-8b71-6b6dc78ace72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:15:19.589827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-84c5a341-383d-46a0-8b71-6b6dc78ace72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:15:19.589827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:15:19.589827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:15:19.589827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:15:19.589827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:15:19.589827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:15:19.589827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:15:19.589827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:15:19.589827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:15:19.589827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:15:19.589827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:15:19.589827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:15:19.589827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:15:19.589827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:15:19.589827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:15:19.589827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:15:19.591021 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:15:19.591021 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:15:19.591021 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:15:19.591021 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:15:19.591021 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:15:19.591021 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:15:19.591021 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:15:19.591021 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:15:19.591021 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:15:19.591021 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:15:19.591021 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:15:19.591021 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:15:19.591021 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:15:19.591021 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:15:19.591021 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:15:19.591021 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:15:19.591914 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:15:19.591914 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:15:19.591914 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:15:19.591914 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:15:19.591914 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:15:19.591914 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:15:19.591914 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:15:19.591914 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:15:19.591914 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:15:19.591914 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:15:19.591914 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:15:19.591914 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:15:19.591914 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 571/1149] 10.222.0.32 () {56 vars in 1096 bytes} [Wed Jun 1 04:15:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:15:19.597500 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0063c894-561e-4598-bb06-5b5b1371d538 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:19.625798 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:19.715021 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0063c894-561e-4598-bb06-5b5b1371d538 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:19.752535 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e941543-ed3f-4051-b1f8-757b5b8a51ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:19.753206 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e941543-ed3f-4051-b1f8-757b5b8a51ff None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:19.753489 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e941543-ed3f-4051-b1f8-757b5b8a51ff None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:19.753766 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e941543-ed3f-4051-b1f8-757b5b8a51ff None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:19.754534 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e941543-ed3f-4051-b1f8-757b5b8a51ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:15:19.754843 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e941543-ed3f-4051-b1f8-757b5b8a51ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:19.756211 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e941543-ed3f-4051-b1f8-757b5b8a51ff None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:19.764732 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 579/1150] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:15:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:15:19.771353 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5a341-383d-46a0-8b71-6b6dc78ace72 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:19.871534 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5a341-383d-46a0-8b71-6b6dc78ace72 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:19.910389 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd135a-a58a-4c48-b165-f87930164b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:19.911257 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd135a-a58a-4c48-b165-f87930164b72 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:19.911537 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd135a-a58a-4c48-b165-f87930164b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:19.911809 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd135a-a58a-4c48-b165-f87930164b72 None admin] PATH_INFO: `/v3/users/40c9ff889fcb4ca08f4d55d0f1e49496` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:19.913032 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd135a-a58a-4c48-b165-f87930164b72 None admin] RBAC: Authorizing `identity:get_user(user_id=40c9ff889fcb4ca08f4d55d0f1e49496)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:19.914495 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd135a-a58a-4c48-b165-f87930164b72 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:19.916132 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 572/1151] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:15:19 2022] GET /identity/v3/users/40c9ff889fcb4ca08f4d55d0f1e49496 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:15:19.922096 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e941543-ed3f-4051-b1f8-757b5b8a51ff None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:20.008667 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:20.027368 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e941543-ed3f-4051-b1f8-757b5b8a51ff None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:20.068665 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71359d0-c1b4-4048-ab85-da505626e7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:20.069539 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71359d0-c1b4-4048-ab85-da505626e7eb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:20.069824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71359d0-c1b4-4048-ab85-da505626e7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:20.070129 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71359d0-c1b4-4048-ab85-da505626e7eb None admin] PATH_INFO: `/v3/projects/7cece39c4976477e9e63b7101c6ce642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:20.071325 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71359d0-c1b4-4048-ab85-da505626e7eb None admin] RBAC: Authorizing `identity:get_project(project_id=7cece39c4976477e9e63b7101c6ce642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:20.072766 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71359d0-c1b4-4048-ab85-da505626e7eb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:20.074512 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 580/1152] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:15:19 2022] GET /identity/v3/projects/7cece39c4976477e9e63b7101c6ce642 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:15:20.080530 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd135a-a58a-4c48-b165-f87930164b72 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:20.109083 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:20.183805 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd135a-a58a-4c48-b165-f87930164b72 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:20.217200 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba7ba7-806a-4597-9cd1-bf3eb8ac882c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:20.218102 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba7ba7-806a-4597-9cd1-bf3eb8ac882c None admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:20.218381 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba7ba7-806a-4597-9cd1-bf3eb8ac882c None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:20.218652 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba7ba7-806a-4597-9cd1-bf3eb8ac882c None admin] PATH_INFO: `/v3/projects/7cece39c4976477e9e63b7101c6ce642/users/40c9ff889fcb4ca08f4d55d0f1e49496/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:20.220600 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba7ba7-806a-4597-9cd1-bf3eb8ac882c None admin] RBAC: Authorizing `identity:create_grant(project_id=7cece39c4976477e9e63b7101c6ce642, user_id=40c9ff889fcb4ca08f4d55d0f1e49496, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:20.222038 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba7ba7-806a-4597-9cd1-bf3eb8ac882c None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:20.235084 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 573/1153] 10.222.0.32 () {58 vars in 1439 bytes} [Wed Jun 1 04:15:20 2022] PUT /identity/v3/projects/7cece39c4976477e9e63b7101c6ce642/users/40c9ff889fcb4ca08f4d55d0f1e49496/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:15:22.489082 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db11ed-e9c7-4504-b4c5-6f226bc6b933 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:22.489589 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db11ed-e9c7-4504-b4c5-6f226bc6b933 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:22.489683 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db11ed-e9c7-4504-b4c5-6f226bc6b933 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:22.491140 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 581/1154] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:15:22.496472 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2222680-e8b4-4c04-9708-fb855247292d None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:22.496907 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2222680-e8b4-4c04-9708-fb855247292d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:22.497038 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2222680-e8b4-4c04-9708-fb855247292d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:22.514201 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-f2222680-e8b4-4c04-9708-fb855247292d None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:15:22.515402 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f2222680-e8b4-4c04-9708-fb855247292d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:15:22.581923 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 574/1155] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:15:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:15:22.605675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db11ed-e9c7-4504-b4c5-6f226bc6b933 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:22.705447 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db11ed-e9c7-4504-b4c5-6f226bc6b933 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:22.738114 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb8260-a969-4022-8917-c2b1753aee20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:22.738899 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb8260-a969-4022-8917-c2b1753aee20 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:22.739229 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb8260-a969-4022-8917-c2b1753aee20 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:22.739456 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb8260-a969-4022-8917-c2b1753aee20 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:22.749599 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb8260-a969-4022-8917-c2b1753aee20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:15:22.757094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-41eb8260-a969-4022-8917-c2b1753aee20 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:15:22.757094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:15:22.757094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:15:22.757094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:15:22.757094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:15:22.757094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:15:22.757094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:15:22.757094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:15:22.757094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:15:22.757094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:15:22.757094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:15:22.757094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:15:22.757094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:15:22.757094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:15:22.757094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:15:22.757094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:15:22.758222 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:15:22.758222 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:15:22.758222 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:15:22.758222 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:15:22.758222 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:15:22.758222 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:15:22.758222 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:15:22.758222 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:15:22.758222 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:15:22.758222 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:15:22.758222 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:15:22.758222 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:15:22.758222 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:15:22.758222 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:15:22.758222 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:15:22.758222 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:15:22.759079 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:15:22.759079 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:15:22.759079 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:15:22.759079 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:15:22.759079 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:15:22.759079 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:15:22.759079 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:15:22.759079 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:15:22.759079 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:15:22.759079 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:15:22.759079 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:15:22.759079 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:15:22.759079 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 582/1156] 10.222.0.32 () {56 vars in 1096 bytes} [Wed Jun 1 04:15:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:15:22.764352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2222680-e8b4-4c04-9708-fb855247292d None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:22.781591 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:22.863931 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2222680-e8b4-4c04-9708-fb855247292d None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:22.897134 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ce789-d653-480b-8744-0231c7841276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:22.897800 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ce789-d653-480b-8744-0231c7841276 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:22.898113 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ce789-d653-480b-8744-0231c7841276 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:22.898393 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ce789-d653-480b-8744-0231c7841276 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:22.899139 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ce789-d653-480b-8744-0231c7841276 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:15:22.899447 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ce789-d653-480b-8744-0231c7841276 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:22.900806 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ce789-d653-480b-8744-0231c7841276 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:22.909398 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 575/1157] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:15:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:15:22.915172 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb8260-a969-4022-8917-c2b1753aee20 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:22.931463 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:23.013933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb8260-a969-4022-8917-c2b1753aee20 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:23.047416 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef17375-1326-413a-9908-bb88534b9a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:23.048293 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef17375-1326-413a-9908-bb88534b9a5a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:23.048573 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef17375-1326-413a-9908-bb88534b9a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:23.048846 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef17375-1326-413a-9908-bb88534b9a5a None admin] PATH_INFO: `/v3/users/40c9ff889fcb4ca08f4d55d0f1e49496` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:23.050010 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef17375-1326-413a-9908-bb88534b9a5a None admin] RBAC: Authorizing `identity:get_user(user_id=40c9ff889fcb4ca08f4d55d0f1e49496)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:23.051417 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef17375-1326-413a-9908-bb88534b9a5a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:23.053110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 583/1158] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:15:22 2022] GET /identity/v3/users/40c9ff889fcb4ca08f4d55d0f1e49496 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:15:23.059065 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ce789-d653-480b-8744-0231c7841276 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:23.134814 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:23.158582 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ce789-d653-480b-8744-0231c7841276 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:23.191192 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8098d-e0db-4731-a44a-9666c54842a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:23.191834 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8098d-e0db-4731-a44a-9666c54842a0 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:23.192119 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8098d-e0db-4731-a44a-9666c54842a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:23.192400 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8098d-e0db-4731-a44a-9666c54842a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:23.261307 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8098d-e0db-4731-a44a-9666c54842a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:23.264156 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8098d-e0db-4731-a44a-9666c54842a0 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:23.350760 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:23.373197 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 576/1159] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:15:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 01 04:15:23.379143 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef17375-1326-413a-9908-bb88534b9a5a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:23.456141 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:23.475365 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef17375-1326-413a-9908-bb88534b9a5a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:23.507797 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6f474-051d-4646-86b1-4f7b26171cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:23.508651 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6f474-051d-4646-86b1-4f7b26171cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:23.508933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6f474-051d-4646-86b1-4f7b26171cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:23.509207 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6f474-051d-4646-86b1-4f7b26171cb5 None admin] PATH_INFO: `/v3/projects/7cece39c4976477e9e63b7101c6ce642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:23.510395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d6f474-051d-4646-86b1-4f7b26171cb5 None admin] RBAC: Authorizing `identity:get_project(project_id=7cece39c4976477e9e63b7101c6ce642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:23.511812 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d6f474-051d-4646-86b1-4f7b26171cb5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:23.513478 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 584/1160] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:15:23 2022] GET /identity/v3/projects/7cece39c4976477e9e63b7101c6ce642 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:15:23.519623 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8098d-e0db-4731-a44a-9666c54842a0 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:23.616397 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8098d-e0db-4731-a44a-9666c54842a0 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:23.649047 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe6820-9620-47d5-b038-7d313c5ed364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:23.649688 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe6820-9620-47d5-b038-7d313c5ed364 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:23.649995 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe6820-9620-47d5-b038-7d313c5ed364 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:23.650282 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe6820-9620-47d5-b038-7d313c5ed364 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:23.651097 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe6820-9620-47d5-b038-7d313c5ed364 None admin] RBAC: Adding query filter params (role.id=76fc054ad9544460a7be1e2010c23642, scope.project.id=7cece39c4976477e9e63b7101c6ce642, user.id=40c9ff889fcb4ca08f4d55d0f1e49496) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:15:23.651407 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe6820-9620-47d5-b038-7d313c5ed364 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:23.652835 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe6820-9620-47d5-b038-7d313c5ed364 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:23.659099 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 577/1161] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:15:23 2022] GET /identity/v3/role_assignments?user.id=40c9ff889fcb4ca08f4d55d0f1e49496&scope.project.id=7cece39c4976477e9e63b7101c6ce642&role.id=76fc054ad9544460a7be1e2010c23642 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:15:25.935043 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e1c0a-28fd-4a90-bed4-045382c055fb None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:25.935822 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e1c0a-28fd-4a90-bed4-045382c055fb None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:25.935822 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e1c0a-28fd-4a90-bed4-045382c055fb None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:25.936949 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 585/1162] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:15:25.943612 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8eb30-2f1f-486a-b24e-a3575bbbd23f None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:25.944216 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8eb30-2f1f-486a-b24e-a3575bbbd23f None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:25.944426 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8eb30-2f1f-486a-b24e-a3575bbbd23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:25.962189 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-2ca8eb30-2f1f-486a-b24e-a3575bbbd23f None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:15:25.963397 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-2ca8eb30-2f1f-486a-b24e-a3575bbbd23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:15:26.001864 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:26.035120 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 578/1163] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:15:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 04:15:26.058405 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e1c0a-28fd-4a90-bed4-045382c055fb None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:26.173449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e1c0a-28fd-4a90-bed4-045382c055fb None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:26.209016 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c37e53-8dd0-4b0e-9d8f-89d0d51334ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:26.209600 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c37e53-8dd0-4b0e-9d8f-89d0d51334ad None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:26.209886 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c37e53-8dd0-4b0e-9d8f-89d0d51334ad None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:26.210194 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c37e53-8dd0-4b0e-9d8f-89d0d51334ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:26.228728 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:26.281376 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c37e53-8dd0-4b0e-9d8f-89d0d51334ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:26.283380 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c37e53-8dd0-4b0e-9d8f-89d0d51334ad None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:26.388323 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 586/1164] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:15:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 01 04:15:26.394682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8eb30-2f1f-486a-b24e-a3575bbbd23f None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:26.497239 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8eb30-2f1f-486a-b24e-a3575bbbd23f None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:26.534407 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648affa-9ad6-4850-9662-d3779522689e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:26.535209 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648affa-9ad6-4850-9662-d3779522689e None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:26.535489 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648affa-9ad6-4850-9662-d3779522689e None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:26.535763 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648affa-9ad6-4850-9662-d3779522689e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:26.542725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648affa-9ad6-4850-9662-d3779522689e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:26.544168 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648affa-9ad6-4850-9662-d3779522689e None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:26.558973 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-0648affa-9ad6-4850-9662-d3779522689e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 01 04:15:26.558973 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:15:26.558973 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 01 04:15:26.558973 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 01 04:15:26.558973 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 04:15:26.558973 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 04:15:26.558973 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 04:15:26.558973 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 04:15:26.558973 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 01 04:15:26.558973 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:15:26.558973 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 04:15:26.558973 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:15:26.558973 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:15:26.558973 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:15:26.558973 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:15:26.558973 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:15:26.558973 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:15:26.560103 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:15:26.560103 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:15:26.560103 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:15:26.560103 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:15:26.560103 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:15:26.560103 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:15:26.560103 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:15:26.560103 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:15:26.560103 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:15:26.560103 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:15:26.560103 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:15:26.560103 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:15:26.560103 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:15:26.560103 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:15:26.560103 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:15:26.560103 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:15:26.561392 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:15:26.561392 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:15:26.561392 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:15:26.561392 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:15:26.561392 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:15:26.561392 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:15:26.561392 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:15:26.561392 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:15:26.561392 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:15:26.561392 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:15:26.561392 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 01 04:15:26.561392 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:15:26.561392 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 01 04:15:26.561392 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:15:26.561392 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 579/1165] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Jun 1 04:15:26 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:15:26.566522 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c37e53-8dd0-4b0e-9d8f-89d0d51334ad None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:26.617445 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:26.668257 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c37e53-8dd0-4b0e-9d8f-89d0d51334ad None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:26.705039 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e1cc3-cc9f-4658-8bcb-8987108d6fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:26.705708 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e1cc3-cc9f-4658-8bcb-8987108d6fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:26.706024 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e1cc3-cc9f-4658-8bcb-8987108d6fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:26.706297 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e1cc3-cc9f-4658-8bcb-8987108d6fb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:26.707026 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09e1cc3-cc9f-4658-8bcb-8987108d6fb1 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:15:26.707333 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09e1cc3-cc9f-4658-8bcb-8987108d6fb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:26.708706 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09e1cc3-cc9f-4658-8bcb-8987108d6fb1 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:26.716424 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 587/1166] 10.222.0.32 () {56 vars in 1115 bytes} [Wed Jun 1 04:15:26 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:15:28.995675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a10f37-fe5f-4c61-901b-1b3bd8cb6b8d None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:28.996254 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a10f37-fe5f-4c61-901b-1b3bd8cb6b8d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:28.996254 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a10f37-fe5f-4c61-901b-1b3bd8cb6b8d None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:28.997594 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 580/1167] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:15:29.003584 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6006ce-9afb-4eb3-bfa9-8e7e41c949ba None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:29.004053 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6006ce-9afb-4eb3-bfa9-8e7e41c949ba None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:29.004170 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6006ce-9afb-4eb3-bfa9-8e7e41c949ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:29.020914 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-0d6006ce-9afb-4eb3-bfa9-8e7e41c949ba None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:15:29.022111 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0d6006ce-9afb-4eb3-bfa9-8e7e41c949ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:15:29.089904 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 588/1168] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:15:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 04:15:29.113128 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a10f37-fe5f-4c61-901b-1b3bd8cb6b8d None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:29.146312 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:29.223377 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a10f37-fe5f-4c61-901b-1b3bd8cb6b8d None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:29.260221 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd803b-b655-4136-a2ec-ff7d8253da26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:29.260812 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd803b-b655-4136-a2ec-ff7d8253da26 None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:29.261099 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd803b-b655-4136-a2ec-ff7d8253da26 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:29.261379 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd803b-b655-4136-a2ec-ff7d8253da26 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:29.262224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd803b-b655-4136-a2ec-ff7d8253da26 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:29.263595 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd803b-b655-4136-a2ec-ff7d8253da26 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:29.278829 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 581/1169] 10.222.0.32 () {60 vars in 1138 bytes} [Wed Jun 1 04:15:29 2022] POST /identity/v3/domains => generated 267 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:15:31.608200 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff7e8d-f394-4c35-8cd4-fa1495eee857 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:31.608795 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff7e8d-f394-4c35-8cd4-fa1495eee857 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:31.608795 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff7e8d-f394-4c35-8cd4-fa1495eee857 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:31.610228 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 589/1170] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:15:31.617014 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f17e5a-c756-44eb-ba92-f03fa3b2e5cc None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:31.617574 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f17e5a-c756-44eb-ba92-f03fa3b2e5cc None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:31.617574 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f17e5a-c756-44eb-ba92-f03fa3b2e5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:31.637146 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-a0f17e5a-c756-44eb-ba92-f03fa3b2e5cc None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:15:31.638568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a0f17e5a-c756-44eb-ba92-f03fa3b2e5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:15:31.714992 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 582/1171] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:15:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 04:15:31.739982 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff7e8d-f394-4c35-8cd4-fa1495eee857 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:31.789296 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:31.855159 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff7e8d-f394-4c35-8cd4-fa1495eee857 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:31.899330 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c161ef-2510-4ba7-a91a-3174ba0f6c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:31.900237 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c161ef-2510-4ba7-a91a-3174ba0f6c49 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:31.900630 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c161ef-2510-4ba7-a91a-3174ba0f6c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:31.900995 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c161ef-2510-4ba7-a91a-3174ba0f6c49 None admin] PATH_INFO: `/v3/domains/0c3b4415ad384dda87d41bf00c451e92` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:31.913253 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c161ef-2510-4ba7-a91a-3174ba0f6c49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0c3b4415ad384dda87d41bf00c451e92)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:31.914754 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c161ef-2510-4ba7-a91a-3174ba0f6c49 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:31.916490 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 590/1172] 10.222.0.32 () {56 vars in 1183 bytes} [Wed Jun 1 04:15:31 2022] GET /identity/v3/domains/0c3b4415ad384dda87d41bf00c451e92 => generated 267 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:15:31.922599 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f17e5a-c756-44eb-ba92-f03fa3b2e5cc None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:31.949906 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:32.032040 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f17e5a-c756-44eb-ba92-f03fa3b2e5cc None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:32.069103 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec035d-30f7-4466-80f7-7c9fd2325552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:32.069772 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec035d-30f7-4466-80f7-7c9fd2325552 None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:32.070090 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec035d-30f7-4466-80f7-7c9fd2325552 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:32.070369 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec035d-30f7-4466-80f7-7c9fd2325552 None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:32.071106 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec035d-30f7-4466-80f7-7c9fd2325552 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:32.072545 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec035d-30f7-4466-80f7-7c9fd2325552 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:32.100433 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 583/1173] 10.222.0.32 () {60 vars in 1141 bytes} [Wed Jun 1 04:15:31 2022] POST /identity/v3/projects => generated 361 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:15:34.429673 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09db9e1-bb9a-43e7-84bf-78ac1804fc45 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:34.430241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09db9e1-bb9a-43e7-84bf-78ac1804fc45 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:34.430241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09db9e1-bb9a-43e7-84bf-78ac1804fc45 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:34.431567 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 591/1174] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:15:34.437545 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00057ed3-95f6-42db-89d4-5385167337bd None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:34.438081 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00057ed3-95f6-42db-89d4-5385167337bd None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:34.438232 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00057ed3-95f6-42db-89d4-5385167337bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:34.456286 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-00057ed3-95f6-42db-89d4-5385167337bd None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:15:34.457597 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-00057ed3-95f6-42db-89d4-5385167337bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:15:34.527584 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 584/1175] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:15:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 04:15:34.553174 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09db9e1-bb9a-43e7-84bf-78ac1804fc45 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:34.667132 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09db9e1-bb9a-43e7-84bf-78ac1804fc45 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:34.669835 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:34.712286 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986cafc5-6287-4abf-9490-fcc72beb948e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:34.713063 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cafc5-6287-4abf-9490-fcc72beb948e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:34.713342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cafc5-6287-4abf-9490-fcc72beb948e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:34.713618 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cafc5-6287-4abf-9490-fcc72beb948e None admin] PATH_INFO: `/v3/domains/0c3b4415ad384dda87d41bf00c451e92` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:34.714852 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986cafc5-6287-4abf-9490-fcc72beb948e None admin] RBAC: Authorizing `identity:get_domain(domain_id=0c3b4415ad384dda87d41bf00c451e92)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:34.716295 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986cafc5-6287-4abf-9490-fcc72beb948e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:34.718004 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 592/1176] 10.222.0.32 () {56 vars in 1183 bytes} [Wed Jun 1 04:15:34 2022] GET /identity/v3/domains/0c3b4415ad384dda87d41bf00c451e92 => generated 267 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:15:34.723945 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00057ed3-95f6-42db-89d4-5385167337bd None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:34.727155 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:34.828440 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00057ed3-95f6-42db-89d4-5385167337bd None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:34.864828 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa5caf-a496-4c3a-9692-8b473a05b250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:34.865498 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa5caf-a496-4c3a-9692-8b473a05b250 None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:34.865777 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa5caf-a496-4c3a-9692-8b473a05b250 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:34.866078 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa5caf-a496-4c3a-9692-8b473a05b250 None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:34.866790 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa5caf-a496-4c3a-9692-8b473a05b250 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:34.868219 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa5caf-a496-4c3a-9692-8b473a05b250 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:34.891017 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 585/1177] 10.222.0.32 () {60 vars in 1132 bytes} [Wed Jun 1 04:15:34 2022] POST /identity/v3/users => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:15:37.270125 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990397d2-438b-4dc1-b931-fbd91c69a82a None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:37.270740 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990397d2-438b-4dc1-b931-fbd91c69a82a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:37.270740 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990397d2-438b-4dc1-b931-fbd91c69a82a None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:37.272117 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 593/1178] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:15:37.278426 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04714edf-eaf8-463a-ad76-b240a00e09d5 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:37.278963 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04714edf-eaf8-463a-ad76-b240a00e09d5 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:37.279124 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04714edf-eaf8-463a-ad76-b240a00e09d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:37.298200 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-04714edf-eaf8-463a-ad76-b240a00e09d5 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:15:37.299489 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-04714edf-eaf8-463a-ad76-b240a00e09d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:15:37.364344 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:37.383310 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 586/1179] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:15:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:15:37.409076 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990397d2-438b-4dc1-b931-fbd91c69a82a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:37.566242 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990397d2-438b-4dc1-b931-fbd91c69a82a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:37.625176 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329e4a9-fa86-4587-9936-f58f64529a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:37.627456 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329e4a9-fa86-4587-9936-f58f64529a33 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:37.627939 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329e4a9-fa86-4587-9936-f58f64529a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:37.628432 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329e4a9-fa86-4587-9936-f58f64529a33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:37.649137 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329e4a9-fa86-4587-9936-f58f64529a33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:15:37.664260 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-3329e4a9-fa86-4587-9936-f58f64529a33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:15:37.664260 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:15:37.664260 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:15:37.664260 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:15:37.664260 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:15:37.664260 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:15:37.664260 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:15:37.664260 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:15:37.664260 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:15:37.664260 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:15:37.664260 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:15:37.664260 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:15:37.664260 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:15:37.664260 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:15:37.664260 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:15:37.664260 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:15:37.666060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:15:37.666060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:15:37.666060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:15:37.666060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:15:37.666060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:15:37.666060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:15:37.666060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:15:37.666060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:15:37.666060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:15:37.666060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:15:37.666060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:15:37.666060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:15:37.666060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:15:37.666060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:15:37.666060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:15:37.666060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:15:37.667672 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:15:37.667672 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:15:37.667672 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:15:37.667672 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:15:37.667672 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:15:37.667672 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:15:37.667672 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:15:37.667672 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:15:37.667672 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:15:37.667672 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:15:37.667672 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:15:37.667672 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:15:37.667672 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 594/1180] 10.222.0.32 () {56 vars in 1096 bytes} [Wed Jun 1 04:15:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:15:37.673611 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04714edf-eaf8-463a-ad76-b240a00e09d5 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:37.781572 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04714edf-eaf8-463a-ad76-b240a00e09d5 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:37.821148 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa77c2b-e61c-4a2f-9888-e89f5f958e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:37.821836 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa77c2b-e61c-4a2f-9888-e89f5f958e65 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:37.822151 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa77c2b-e61c-4a2f-9888-e89f5f958e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:37.822429 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa77c2b-e61c-4a2f-9888-e89f5f958e65 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:37.823185 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa77c2b-e61c-4a2f-9888-e89f5f958e65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:15:37.823490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa77c2b-e61c-4a2f-9888-e89f5f958e65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:37.824868 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa77c2b-e61c-4a2f-9888-e89f5f958e65 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:37.835437 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 587/1181] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:15:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:15:37.844446 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329e4a9-fa86-4587-9936-f58f64529a33 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:37.878628 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:37.957130 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329e4a9-fa86-4587-9936-f58f64529a33 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:37.995454 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75400acf-9730-4a0a-b2c0-eef5c8877549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:37.996410 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75400acf-9730-4a0a-b2c0-eef5c8877549 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:37.996730 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75400acf-9730-4a0a-b2c0-eef5c8877549 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:37.997043 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75400acf-9730-4a0a-b2c0-eef5c8877549 None admin] PATH_INFO: `/v3/users/7fa589a52af146d2b94330d7a5acfe21` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:38.013807 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75400acf-9730-4a0a-b2c0-eef5c8877549 None admin] RBAC: Authorizing `identity:get_user(user_id=7fa589a52af146d2b94330d7a5acfe21)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:38.015366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75400acf-9730-4a0a-b2c0-eef5c8877549 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:38.017178 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 595/1182] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:15:37 2022] GET /identity/v3/users/7fa589a52af146d2b94330d7a5acfe21 => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:15:38.023322 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa77c2b-e61c-4a2f-9888-e89f5f958e65 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:38.081606 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:38.169100 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa77c2b-e61c-4a2f-9888-e89f5f958e65 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:38.225730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc4cb5-21b0-4edb-8144-8286837c281b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:38.226763 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc4cb5-21b0-4edb-8144-8286837c281b None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:38.227257 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc4cb5-21b0-4edb-8144-8286837c281b None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:38.227751 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc4cb5-21b0-4edb-8144-8286837c281b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:38.346778 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc4cb5-21b0-4edb-8144-8286837c281b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:38.349564 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc4cb5-21b0-4edb-8144-8286837c281b None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:38.441739 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:38.526314 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 588/1183] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:15:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 01 04:15:38.533023 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75400acf-9730-4a0a-b2c0-eef5c8877549 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:38.628531 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:38.642340 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75400acf-9730-4a0a-b2c0-eef5c8877549 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:38.680238 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc643b-059d-4b5a-818a-50fb4d2964dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:38.681166 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc643b-059d-4b5a-818a-50fb4d2964dd None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:38.681490 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc643b-059d-4b5a-818a-50fb4d2964dd None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:38.681807 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc643b-059d-4b5a-818a-50fb4d2964dd None admin] PATH_INFO: `/v3/projects/ce22797e97434819b850958f57e646d6` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:38.683112 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cc643b-059d-4b5a-818a-50fb4d2964dd None admin] RBAC: Authorizing `identity:get_project(project_id=ce22797e97434819b850958f57e646d6)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:38.684631 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cc643b-059d-4b5a-818a-50fb4d2964dd None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:38.686454 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 596/1184] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:15:38 2022] GET /identity/v3/projects/ce22797e97434819b850958f57e646d6 => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:15:38.693267 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc4cb5-21b0-4edb-8144-8286837c281b None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:38.797935 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc4cb5-21b0-4edb-8144-8286837c281b None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:38.833257 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d036b7e-2198-4962-829f-a41bb4b585b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:38.833925 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d036b7e-2198-4962-829f-a41bb4b585b5 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:38.834239 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d036b7e-2198-4962-829f-a41bb4b585b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:38.834520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d036b7e-2198-4962-829f-a41bb4b585b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:38.835354 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d036b7e-2198-4962-829f-a41bb4b585b5 None admin] RBAC: Adding query filter params (role.id=76fc054ad9544460a7be1e2010c23642, scope.project.id=ce22797e97434819b850958f57e646d6, user.id=7fa589a52af146d2b94330d7a5acfe21) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:15:38.835668 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d036b7e-2198-4962-829f-a41bb4b585b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:38.837101 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d036b7e-2198-4962-829f-a41bb4b585b5 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:38.843140 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 589/1185] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:15:38 2022] GET /identity/v3/role_assignments?user.id=7fa589a52af146d2b94330d7a5acfe21&scope.project.id=ce22797e97434819b850958f57e646d6&role.id=76fc054ad9544460a7be1e2010c23642 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:15:41.193397 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79363d-c84b-4b5a-aa40-5ac1090b544c None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:41.194061 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79363d-c84b-4b5a-aa40-5ac1090b544c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:41.194061 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79363d-c84b-4b5a-aa40-5ac1090b544c None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:41.195613 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 597/1186] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:15:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:15:41.201920 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c3c8c-ca69-49ac-9951-8aa310a1308b None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:41.202637 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c3c8c-ca69-49ac-9951-8aa310a1308b None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:41.202637 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c3c8c-ca69-49ac-9951-8aa310a1308b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:41.221775 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-6e3c3c8c-ca69-49ac-9951-8aa310a1308b None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:15:41.223090 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6e3c3c8c-ca69-49ac-9951-8aa310a1308b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:15:41.236541 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:41.303385 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 590/1187] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:15:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 04:15:41.327334 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79363d-c84b-4b5a-aa40-5ac1090b544c None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:41.437783 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79363d-c84b-4b5a-aa40-5ac1090b544c None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:41.474882 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e06e77-30a8-4e38-be22-9a46f5fb6043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:41.475703 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e06e77-30a8-4e38-be22-9a46f5fb6043 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:41.475993 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e06e77-30a8-4e38-be22-9a46f5fb6043 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:41.476276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e06e77-30a8-4e38-be22-9a46f5fb6043 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:41.488069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e06e77-30a8-4e38-be22-9a46f5fb6043 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:15:41.496152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-12e06e77-30a8-4e38-be22-9a46f5fb6043 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:15:41.496152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:15:41.496152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:15:41.496152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:15:41.496152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:15:41.496152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:15:41.496152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:15:41.496152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:15:41.496152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:15:41.496152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:15:41.496152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:15:41.496152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:15:41.496152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:15:41.496152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:15:41.496152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:15:41.496152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:15:41.498555 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:15:41.498555 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:15:41.498555 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:15:41.498555 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:15:41.498555 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:15:41.498555 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:15:41.498555 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:15:41.498555 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:15:41.498555 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:15:41.498555 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:15:41.498555 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:15:41.498555 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:15:41.498555 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:15:41.498555 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:15:41.498555 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:15:41.498555 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:15:41.501177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:15:41.501177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:15:41.501177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:15:41.501177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:15:41.501177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:15:41.501177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:15:41.501177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:15:41.501177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:15:41.501177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:15:41.501177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:15:41.501177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:15:41.501177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:15:41.501177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 598/1188] 10.222.0.32 () {56 vars in 1096 bytes} [Wed Jun 1 04:15:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:15:41.504504 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c3c8c-ca69-49ac-9951-8aa310a1308b None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:41.612805 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c3c8c-ca69-49ac-9951-8aa310a1308b None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:41.650811 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b17f2-52e5-46fa-9e32-1385c31ae154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:41.651547 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b17f2-52e5-46fa-9e32-1385c31ae154 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:41.651867 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b17f2-52e5-46fa-9e32-1385c31ae154 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:41.652180 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b17f2-52e5-46fa-9e32-1385c31ae154 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:41.652973 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b17f2-52e5-46fa-9e32-1385c31ae154 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:15:41.653317 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b17f2-52e5-46fa-9e32-1385c31ae154 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:41.654787 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b17f2-52e5-46fa-9e32-1385c31ae154 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:41.664034 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 591/1189] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:15:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:15:41.670243 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e06e77-30a8-4e38-be22-9a46f5fb6043 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:41.691907 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:41.777745 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e06e77-30a8-4e38-be22-9a46f5fb6043 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:41.814686 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54651de9-7099-4ed1-bc7c-5375c23d67d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:41.815569 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54651de9-7099-4ed1-bc7c-5375c23d67d8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:41.815848 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54651de9-7099-4ed1-bc7c-5375c23d67d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:41.816120 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54651de9-7099-4ed1-bc7c-5375c23d67d8 None admin] PATH_INFO: `/v3/users/7fa589a52af146d2b94330d7a5acfe21` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:41.817336 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54651de9-7099-4ed1-bc7c-5375c23d67d8 None admin] RBAC: Authorizing `identity:get_user(user_id=7fa589a52af146d2b94330d7a5acfe21)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:41.819073 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54651de9-7099-4ed1-bc7c-5375c23d67d8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:41.820737 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 599/1190] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:15:41 2022] GET /identity/v3/users/7fa589a52af146d2b94330d7a5acfe21 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:15:41.826878 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b17f2-52e5-46fa-9e32-1385c31ae154 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:41.839289 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:41.976579 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b17f2-52e5-46fa-9e32-1385c31ae154 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:42.034121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ae3af-04ee-463d-a422-19786367c049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:42.035398 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ae3af-04ee-463d-a422-19786367c049 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:42.035878 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ae3af-04ee-463d-a422-19786367c049 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:42.036349 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ae3af-04ee-463d-a422-19786367c049 None admin] PATH_INFO: `/v3/projects/ce22797e97434819b850958f57e646d6` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:42.038460 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ae3af-04ee-463d-a422-19786367c049 None admin] RBAC: Authorizing `identity:get_project(project_id=ce22797e97434819b850958f57e646d6)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:42.041178 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ae3af-04ee-463d-a422-19786367c049 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:42.044401 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 592/1191] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:15:41 2022] GET /identity/v3/projects/ce22797e97434819b850958f57e646d6 => generated 361 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:15:42.051257 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54651de9-7099-4ed1-bc7c-5375c23d67d8 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:42.140442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:42.163571 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54651de9-7099-4ed1-bc7c-5375c23d67d8 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:42.199777 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4afce-e4ef-4366-8aa7-847e4479dceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:42.200721 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4afce-e4ef-4366-8aa7-847e4479dceb None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:42.201046 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4afce-e4ef-4366-8aa7-847e4479dceb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:42.201365 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4afce-e4ef-4366-8aa7-847e4479dceb None admin] PATH_INFO: `/v3/projects/ce22797e97434819b850958f57e646d6/users/7fa589a52af146d2b94330d7a5acfe21/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:42.203479 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4afce-e4ef-4366-8aa7-847e4479dceb None admin] RBAC: Authorizing `identity:create_grant(project_id=ce22797e97434819b850958f57e646d6, user_id=7fa589a52af146d2b94330d7a5acfe21, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:42.205005 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4afce-e4ef-4366-8aa7-847e4479dceb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:42.220725 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 600/1192] 10.222.0.32 () {58 vars in 1439 bytes} [Wed Jun 1 04:15:42 2022] PUT /identity/v3/projects/ce22797e97434819b850958f57e646d6/users/7fa589a52af146d2b94330d7a5acfe21/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:15:44.547937 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae392e-0111-4e6f-aacb-7247dbe73ef7 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:44.548556 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae392e-0111-4e6f-aacb-7247dbe73ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:44.548556 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae392e-0111-4e6f-aacb-7247dbe73ef7 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:44.549891 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 593/1193] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:15:44.555898 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4d113-bcf1-4954-9455-656d164cfde7 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:44.556441 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4d113-bcf1-4954-9455-656d164cfde7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:44.556441 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4d113-bcf1-4954-9455-656d164cfde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:44.574873 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d7e4d113-bcf1-4954-9455-656d164cfde7 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:15:44.576095 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d7e4d113-bcf1-4954-9455-656d164cfde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:15:44.649307 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 601/1194] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:15:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 04:15:44.673827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae392e-0111-4e6f-aacb-7247dbe73ef7 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:44.758105 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:44.783846 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae392e-0111-4e6f-aacb-7247dbe73ef7 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:44.819535 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5026683d-5f15-4dcc-825c-f0e178719758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:44.820249 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026683d-5f15-4dcc-825c-f0e178719758 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:44.820529 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026683d-5f15-4dcc-825c-f0e178719758 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:44.820812 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026683d-5f15-4dcc-825c-f0e178719758 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:44.831891 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5026683d-5f15-4dcc-825c-f0e178719758 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:15:44.839469 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-5026683d-5f15-4dcc-825c-f0e178719758 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:15:44.839469 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:15:44.839469 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:15:44.839469 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:15:44.839469 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:15:44.839469 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:15:44.839469 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:15:44.839469 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:15:44.839469 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:15:44.839469 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:15:44.839469 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:15:44.839469 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:15:44.839469 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:15:44.839469 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:15:44.839469 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:15:44.839469 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:15:44.840562 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:15:44.840562 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:15:44.840562 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:15:44.840562 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:15:44.840562 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:15:44.840562 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:15:44.840562 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:15:44.840562 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:15:44.840562 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:15:44.840562 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:15:44.840562 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:15:44.840562 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:15:44.840562 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:15:44.840562 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:15:44.840562 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:15:44.840562 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:15:44.841723 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:15:44.841723 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:15:44.841723 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:15:44.841723 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:15:44.841723 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:15:44.841723 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:15:44.841723 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:15:44.841723 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:15:44.841723 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:15:44.841723 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:15:44.841723 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:15:44.841723 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:15:44.841723 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 594/1195] 10.222.0.32 () {56 vars in 1096 bytes} [Wed Jun 1 04:15:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:15:44.847028 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4d113-bcf1-4954-9455-656d164cfde7 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:44.923384 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:44.953384 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4d113-bcf1-4954-9455-656d164cfde7 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:44.988924 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5abc8a2-d323-49a9-a4b6-9dd4e1dce9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:44.989601 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abc8a2-d323-49a9-a4b6-9dd4e1dce9af None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:44.989887 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abc8a2-d323-49a9-a4b6-9dd4e1dce9af None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:44.990195 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abc8a2-d323-49a9-a4b6-9dd4e1dce9af None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:44.990945 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5abc8a2-d323-49a9-a4b6-9dd4e1dce9af None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:15:44.991253 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5abc8a2-d323-49a9-a4b6-9dd4e1dce9af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:44.992628 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5abc8a2-d323-49a9-a4b6-9dd4e1dce9af None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:45.001961 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 602/1196] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:15:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:15:45.007861 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5026683d-5f15-4dcc-825c-f0e178719758 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:45.109362 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5026683d-5f15-4dcc-825c-f0e178719758 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:45.143938 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadb1d2-cb36-4d8c-a75f-48d2cafa56d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:45.144817 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadb1d2-cb36-4d8c-a75f-48d2cafa56d4 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:45.145094 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadb1d2-cb36-4d8c-a75f-48d2cafa56d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:45.145368 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadb1d2-cb36-4d8c-a75f-48d2cafa56d4 None admin] PATH_INFO: `/v3/users/7fa589a52af146d2b94330d7a5acfe21` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:45.146602 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eadb1d2-cb36-4d8c-a75f-48d2cafa56d4 None admin] RBAC: Authorizing `identity:get_user(user_id=7fa589a52af146d2b94330d7a5acfe21)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:45.148058 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eadb1d2-cb36-4d8c-a75f-48d2cafa56d4 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:45.149713 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 595/1197] 10.222.0.32 () {56 vars in 1177 bytes} [Wed Jun 1 04:15:45 2022] GET /identity/v3/users/7fa589a52af146d2b94330d7a5acfe21 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:15:45.155518 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5abc8a2-d323-49a9-a4b6-9dd4e1dce9af None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:45.267172 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5abc8a2-d323-49a9-a4b6-9dd4e1dce9af None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:45.306999 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746f437-cc06-466d-8d91-32d3f3ebc24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:45.307669 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746f437-cc06-466d-8d91-32d3f3ebc24a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:45.307950 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746f437-cc06-466d-8d91-32d3f3ebc24a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:45.308223 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746f437-cc06-466d-8d91-32d3f3ebc24a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:45.312627 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:45.390432 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2746f437-cc06-466d-8d91-32d3f3ebc24a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:45.391850 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2746f437-cc06-466d-8d91-32d3f3ebc24a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:45.495965 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 603/1198] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:15:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 01 04:15:45.502765 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadb1d2-cb36-4d8c-a75f-48d2cafa56d4 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:45.508731 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:45.617020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadb1d2-cb36-4d8c-a75f-48d2cafa56d4 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:45.654595 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc6367-4166-4f46-bdcf-513418fdb2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:45.655379 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc6367-4166-4f46-bdcf-513418fdb2ca None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:45.655665 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc6367-4166-4f46-bdcf-513418fdb2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:45.655943 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc6367-4166-4f46-bdcf-513418fdb2ca None admin] PATH_INFO: `/v3/projects/ce22797e97434819b850958f57e646d6` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:45.657756 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fc6367-4166-4f46-bdcf-513418fdb2ca None admin] RBAC: Authorizing `identity:get_project(project_id=ce22797e97434819b850958f57e646d6)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:45.659253 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fc6367-4166-4f46-bdcf-513418fdb2ca None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:45.661031 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 596/1199] 10.222.0.32 () {56 vars in 1186 bytes} [Wed Jun 1 04:15:45 2022] GET /identity/v3/projects/ce22797e97434819b850958f57e646d6 => generated 361 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:15:45.667267 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746f437-cc06-466d-8d91-32d3f3ebc24a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:15:45.704836 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:45.774473 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746f437-cc06-466d-8d91-32d3f3ebc24a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:15:45.811951 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb22a6-e037-441d-906d-92974ae27f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:15:45.812640 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb22a6-e037-441d-906d-92974ae27f62 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:15:45.813465 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb22a6-e037-441d-906d-92974ae27f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:15:45.813745 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb22a6-e037-441d-906d-92974ae27f62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:15:45.814671 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb22a6-e037-441d-906d-92974ae27f62 None admin] RBAC: Adding query filter params (role.id=76fc054ad9544460a7be1e2010c23642, scope.project.id=ce22797e97434819b850958f57e646d6, user.id=7fa589a52af146d2b94330d7a5acfe21) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:15:45.814987 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb22a6-e037-441d-906d-92974ae27f62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:15:45.816484 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb22a6-e037-441d-906d-92974ae27f62 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:15:45.824046 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 604/1200] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:15:45 2022] GET /identity/v3/role_assignments?user.id=7fa589a52af146d2b94330d7a5acfe21&scope.project.id=ce22797e97434819b850958f57e646d6&role.id=76fc054ad9544460a7be1e2010c23642 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:15:55.650438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=64 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:15:55.821337 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=50 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:16:50.877602 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55f83b-e1b7-42f5-b897-63a656836022 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:16:50.877602 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55f83b-e1b7-42f5-b897-63a656836022 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:16:50.877602 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55f83b-e1b7-42f5-b897-63a656836022 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:16:50.877602 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 597/1201] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:16:50.885134 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f977b-c445-4193-a528-455a575209f2 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:16:50.885732 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f977b-c445-4193-a528-455a575209f2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:16:50.885899 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f977b-c445-4193-a528-455a575209f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:16:50.913697 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-237f977b-c445-4193-a528-455a575209f2 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:16:50.915420 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-237f977b-c445-4193-a528-455a575209f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:16:51.033074 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 605/1202] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:16:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:16:51.059788 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55f83b-e1b7-42f5-b897-63a656836022 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:16:51.261019 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55f83b-e1b7-42f5-b897-63a656836022 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:16:51.321314 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd68b66-e234-4387-9f68-6798738dfaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:16:51.322194 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd68b66-e234-4387-9f68-6798738dfaf3 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:16:51.322451 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd68b66-e234-4387-9f68-6798738dfaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:16:51.322859 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd68b66-e234-4387-9f68-6798738dfaf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:16:51.336414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd68b66-e234-4387-9f68-6798738dfaf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:16:51.338373 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd68b66-e234-4387-9f68-6798738dfaf3 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:16:51.363015 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-bdd68b66-e234-4387-9f68-6798738dfaf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:16:51.363015 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:16:51.363015 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:16:51.363015 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:16:51.363015 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:16:51.363015 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:16:51.363015 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:16:51.363015 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:16:51.363015 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:16:51.363015 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:16:51.363015 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:16:51.363015 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:16:51.363015 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:16:51.363015 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:16:51.363015 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:16:51.365261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:16:51.365261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:16:51.365261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:16:51.365261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:16:51.365261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:16:51.365261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:16:51.365261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:16:51.365261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:16:51.365261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:16:51.365261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:16:51.365261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:16:51.365261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:16:51.365261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:16:51.365261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:16:51.365261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:16:51.365261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:16:51.365261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:16:51.367450 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:16:51.367450 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:16:51.367450 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:16:51.367450 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:16:51.367450 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 598/1203] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:16:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:16:51.370732 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f977b-c445-4193-a528-455a575209f2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:16:51.541911 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f977b-c445-4193-a528-455a575209f2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:16:51.602859 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:16:51.611753 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ff0c1-4946-4788-b5f8-3d6537a5034e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:16:51.612470 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ff0c1-4946-4788-b5f8-3d6537a5034e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:16:51.612754 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ff0c1-4946-4788-b5f8-3d6537a5034e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:16:51.613034 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ff0c1-4946-4788-b5f8-3d6537a5034e None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:16:51.613790 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ff0c1-4946-4788-b5f8-3d6537a5034e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:16:51.614108 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ff0c1-4946-4788-b5f8-3d6537a5034e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:16:51.615541 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ff0c1-4946-4788-b5f8-3d6537a5034e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:16:51.644230 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 606/1204] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:16:51.650129 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd68b66-e234-4387-9f68-6798738dfaf3 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:16:51.768745 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:16:51.879317 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd68b66-e234-4387-9f68-6798738dfaf3 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:16:51.955096 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8a7ba-531a-4a84-b432-b67e7cf97f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:16:51.956184 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8a7ba-531a-4a84-b432-b67e7cf97f55 None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:16:51.956667 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8a7ba-531a-4a84-b432-b67e7cf97f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:16:51.957168 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8a7ba-531a-4a84-b432-b67e7cf97f55 None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:16:51.958321 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8a7ba-531a-4a84-b432-b67e7cf97f55 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:16:51.961014 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8a7ba-531a-4a84-b432-b67e7cf97f55 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:16:51.994906 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 599/1205] 10.222.0.32 () {60 vars in 1132 bytes} [Wed Jun 1 04:16:51 2022] POST /identity/v3/users => generated 251 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:16:54.787612 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e28c79-b855-4e0a-9dce-e21fdb12b0dd None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:16:54.788305 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e28c79-b855-4e0a-9dce-e21fdb12b0dd None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:16:54.788711 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e28c79-b855-4e0a-9dce-e21fdb12b0dd None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:16:54.791552 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 607/1206] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:16:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:16:54.800085 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9168ea-a0fa-4211-ad87-190631e6cb57 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:16:54.800085 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9168ea-a0fa-4211-ad87-190631e6cb57 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:16:54.800085 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9168ea-a0fa-4211-ad87-190631e6cb57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:16:54.819862 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-cf9168ea-a0fa-4211-ad87-190631e6cb57 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:16:54.821208 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-cf9168ea-a0fa-4211-ad87-190631e6cb57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:16:54.913616 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 600/1207] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:16:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:16:54.943810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e28c79-b855-4e0a-9dce-e21fdb12b0dd None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:16:55.123055 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e28c79-b855-4e0a-9dce-e21fdb12b0dd None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:16:55.181267 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7f09c-c638-4859-865a-6ed4259a1bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:16:55.182447 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7f09c-c638-4859-865a-6ed4259a1bee None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:16:55.182884 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7f09c-c638-4859-865a-6ed4259a1bee None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:16:55.183303 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7f09c-c638-4859-865a-6ed4259a1bee None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:16:55.203843 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7f09c-c638-4859-865a-6ed4259a1bee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:16:55.211891 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-9dd7f09c-c638-4859-865a-6ed4259a1bee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:16:55.211891 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:16:55.211891 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:16:55.211891 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:16:55.211891 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:16:55.211891 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:16:55.211891 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:16:55.211891 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:16:55.211891 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:16:55.211891 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:16:55.211891 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:16:55.211891 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:16:55.211891 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:16:55.211891 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:16:55.211891 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:16:55.211891 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:16:55.219151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:16:55.219151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:16:55.219151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:16:55.219151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:16:55.219151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:16:55.219151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:16:55.219151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:16:55.219151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:16:55.219151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:16:55.219151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:16:55.219151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:16:55.219151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:16:55.219151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:16:55.219151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:16:55.219151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:16:55.219151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:16:55.221001 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:16:55.221001 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:16:55.221001 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:16:55.221001 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:16:55.221001 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:16:55.221001 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:16:55.221001 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:16:55.221001 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:16:55.221001 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:16:55.221001 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:16:55.221001 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:16:55.221001 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:16:55.221001 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 608/1208] 10.222.0.32 () {56 vars in 1102 bytes} [Wed Jun 1 04:16:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:16:55.223019 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9168ea-a0fa-4211-ad87-190631e6cb57 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:16:55.288105 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:16:55.406546 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9168ea-a0fa-4211-ad87-190631e6cb57 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:16:55.462767 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30aa056-6cd4-48be-acd2-d2d6f92341de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:16:55.463718 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30aa056-6cd4-48be-acd2-d2d6f92341de None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:16:55.464073 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30aa056-6cd4-48be-acd2-d2d6f92341de None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:16:55.464425 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30aa056-6cd4-48be-acd2-d2d6f92341de None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:16:55.465307 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30aa056-6cd4-48be-acd2-d2d6f92341de None admin] RBAC: Adding query filter params (name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:16:55.465699 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30aa056-6cd4-48be-acd2-d2d6f92341de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:16:55.467327 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30aa056-6cd4-48be-acd2-d2d6f92341de None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:16:55.484198 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 601/1209] 10.222.0.32 () {56 vars in 1103 bytes} [Wed Jun 1 04:16:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:16:55.489217 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7f09c-c638-4859-865a-6ed4259a1bee None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:16:55.595943 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:16:55.681713 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7f09c-c638-4859-865a-6ed4259a1bee None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:16:55.726720 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f04512-3db7-420c-86bc-5b38fbc7fce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:16:55.727876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f04512-3db7-420c-86bc-5b38fbc7fce0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:16:55.728371 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f04512-3db7-420c-86bc-5b38fbc7fce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:16:55.728725 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f04512-3db7-420c-86bc-5b38fbc7fce0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:16:55.743156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f04512-3db7-420c-86bc-5b38fbc7fce0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:16:55.744714 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f04512-3db7-420c-86bc-5b38fbc7fce0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:16:55.765083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-c1f04512-3db7-420c-86bc-5b38fbc7fce0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:16:55.765083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:16:55.765083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:16:55.765083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:16:55.765083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:16:55.765083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:16:55.765083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:16:55.765083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:16:55.765083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:16:55.765083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:16:55.765083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:16:55.765083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:16:55.765083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:16:55.765083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:16:55.765083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:16:55.767197 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:16:55.767197 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:16:55.767197 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:16:55.767197 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:16:55.767197 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:16:55.767197 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:16:55.767197 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:16:55.767197 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:16:55.767197 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:16:55.767197 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:16:55.767197 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:16:55.767197 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:16:55.767197 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:16:55.767197 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:16:55.767197 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:16:55.767197 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:16:55.767197 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:16:55.769017 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:16:55.769017 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:16:55.769017 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:16:55.769017 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:16:55.769017 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 609/1210] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:16:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:16:55.772840 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30aa056-6cd4-48be-acd2-d2d6f92341de None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:16:55.921630 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:16:55.929012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30aa056-6cd4-48be-acd2-d2d6f92341de None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:16:55.986951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af984b2b-10b5-47cf-9920-689da3be8547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:16:55.987869 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af984b2b-10b5-47cf-9920-689da3be8547 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:16:55.988322 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af984b2b-10b5-47cf-9920-689da3be8547 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:16:55.988609 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af984b2b-10b5-47cf-9920-689da3be8547 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:16:55.989347 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af984b2b-10b5-47cf-9920-689da3be8547 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:16:55.989656 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af984b2b-10b5-47cf-9920-689da3be8547 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:16:55.991082 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af984b2b-10b5-47cf-9920-689da3be8547 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:16:56.005509 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 602/1211] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:16:56.011499 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f04512-3db7-420c-86bc-5b38fbc7fce0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:16:56.150794 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f04512-3db7-420c-86bc-5b38fbc7fce0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:16:56.159641 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:16:56.206396 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171393e-2bb1-498b-a35d-0057d3c4bbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:16:56.207424 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171393e-2bb1-498b-a35d-0057d3c4bbb3 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:16:56.207876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171393e-2bb1-498b-a35d-0057d3c4bbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:16:56.208449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171393e-2bb1-498b-a35d-0057d3c4bbb3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:16:56.217171 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171393e-2bb1-498b-a35d-0057d3c4bbb3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:16:56.218683 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171393e-2bb1-498b-a35d-0057d3c4bbb3 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:16:56.234854 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-0171393e-2bb1-498b-a35d-0057d3c4bbb3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 01 04:16:56.234854 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:16:56.234854 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:16:56.234854 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:16:56.234854 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:16:56.234854 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:16:56.234854 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:16:56.234854 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:16:56.234854 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:16:56.234854 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:16:56.234854 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:16:56.234854 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:16:56.234854 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 04:16:56.234854 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 04:16:56.234854 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 04:16:56.234854 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 04:16:56.236186 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:16:56.236186 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:16:56.236186 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 04:16:56.236186 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:16:56.236186 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 04:16:56.236186 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:16:56.236186 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:16:56.236186 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:16:56.236186 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:16:56.236186 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:16:56.236186 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:16:56.236186 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:16:56.236186 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:16:56.236186 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:16:56.236186 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:16:56.236186 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:16:56.236186 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:16:56.236186 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:16:56.238191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:16:56.238191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:16:56.238191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 04:16:56.238191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 04:16:56.238191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 04:16:56.238191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 04:16:56.238191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 04:16:56.238191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 04:16:56.238191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 01 04:16:56.238191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:16:56.238191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 610/1212] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:16:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:16:56.242657 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af984b2b-10b5-47cf-9920-689da3be8547 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:16:56.393587 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af984b2b-10b5-47cf-9920-689da3be8547 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:16:56.445432 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300a326-00a5-43d2-b990-074106948a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:16:56.446349 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300a326-00a5-43d2-b990-074106948a64 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:16:56.447116 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300a326-00a5-43d2-b990-074106948a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:16:56.447391 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300a326-00a5-43d2-b990-074106948a64 None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:16:56.448517 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4300a326-00a5-43d2-b990-074106948a64 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:16:56.448991 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4300a326-00a5-43d2-b990-074106948a64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:16:56.451003 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4300a326-00a5-43d2-b990-074106948a64 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:16:56.475568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 603/1213] 10.222.0.32 () {56 vars in 1143 bytes} [Wed Jun 1 04:16:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:16:56.483790 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171393e-2bb1-498b-a35d-0057d3c4bbb3 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:16:56.624672 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171393e-2bb1-498b-a35d-0057d3c4bbb3 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:16:56.679852 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d86d1b-5a0e-41b4-b362-f912a7357243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:16:56.680602 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d86d1b-5a0e-41b4-b362-f912a7357243 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:16:56.680892 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d86d1b-5a0e-41b4-b362-f912a7357243 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:16:56.681170 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d86d1b-5a0e-41b4-b362-f912a7357243 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:16:56.732332 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:16:56.801135 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d86d1b-5a0e-41b4-b362-f912a7357243 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:16:56.803216 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d86d1b-5a0e-41b4-b362-f912a7357243 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:16:56.952696 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 611/1214] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:16:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 01 04:16:56.959238 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300a326-00a5-43d2-b990-074106948a64 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:16:56.984896 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:16:57.088377 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300a326-00a5-43d2-b990-074106948a64 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:16:57.154937 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc479fad-ff71-4bfd-8ec3-b9b5b60f8ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:16:57.156360 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc479fad-ff71-4bfd-8ec3-b9b5b60f8ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:16:57.156861 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc479fad-ff71-4bfd-8ec3-b9b5b60f8ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:16:57.157360 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc479fad-ff71-4bfd-8ec3-b9b5b60f8ae2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:16:57.184221 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc479fad-ff71-4bfd-8ec3-b9b5b60f8ae2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:16:57.188853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc479fad-ff71-4bfd-8ec3-b9b5b60f8ae2 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:16:57.221215 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-bc479fad-ff71-4bfd-8ec3-b9b5b60f8ae2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:16:57.221215 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:16:57.221215 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:16:57.221215 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:16:57.221215 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:16:57.221215 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:16:57.221215 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:16:57.221215 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:16:57.221215 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:16:57.221215 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:16:57.221215 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:16:57.221215 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:16:57.221215 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:16:57.221215 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:16:57.221215 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:16:57.231175 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:16:57.231175 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:16:57.231175 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:16:57.231175 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:16:57.231175 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:16:57.231175 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:16:57.231175 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:16:57.231175 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:16:57.231175 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:16:57.231175 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:16:57.231175 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:16:57.231175 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:16:57.231175 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:16:57.231175 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:16:57.231175 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:16:57.231175 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:16:57.231175 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:16:57.233377 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:16:57.233377 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:16:57.233377 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:16:57.233377 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:16:57.233377 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 604/1215] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:16:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:16:57.236124 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d86d1b-5a0e-41b4-b362-f912a7357243 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:16:57.322121 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:16:57.368139 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d86d1b-5a0e-41b4-b362-f912a7357243 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:16:57.418612 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed907fe-ee27-4beb-8316-d25d0be72fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:16:57.420439 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed907fe-ee27-4beb-8316-d25d0be72fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:16:57.420936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed907fe-ee27-4beb-8316-d25d0be72fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:16:57.421449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed907fe-ee27-4beb-8316-d25d0be72fa3 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:16:57.424111 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed907fe-ee27-4beb-8316-d25d0be72fa3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:16:57.424111 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed907fe-ee27-4beb-8316-d25d0be72fa3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:16:57.425124 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed907fe-ee27-4beb-8316-d25d0be72fa3 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:16:57.441222 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 612/1216] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:16:57.447008 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc479fad-ff71-4bfd-8ec3-b9b5b60f8ae2 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:16:57.543865 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:16:57.581021 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc479fad-ff71-4bfd-8ec3-b9b5b60f8ae2 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:16:57.622811 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ef890-f7c2-451b-8989-d574b49e1879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:16:57.623648 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ef890-f7c2-451b-8989-d574b49e1879 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:16:57.623936 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ef890-f7c2-451b-8989-d574b49e1879 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:16:57.624217 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ef890-f7c2-451b-8989-d574b49e1879 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:16:57.632208 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ef890-f7c2-451b-8989-d574b49e1879 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:16:57.633682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ef890-f7c2-451b-8989-d574b49e1879 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:16:57.648520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-be7ef890-f7c2-451b-8989-d574b49e1879 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:16:57.648520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:16:57.648520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:16:57.648520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:16:57.648520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:16:57.648520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:16:57.648520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:16:57.648520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:16:57.648520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:16:57.648520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:16:57.648520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:16:57.648520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:16:57.648520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 04:16:57.648520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 04:16:57.648520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 04:16:57.649577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 04:16:57.649577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:16:57.649577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:16:57.649577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:16:57.649577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:16:57.649577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:16:57.649577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:16:57.649577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:16:57.649577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:16:57.649577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:16:57.649577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:16:57.649577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:16:57.649577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:16:57.649577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:16:57.649577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:16:57.649577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:16:57.649577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:16:57.651190 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 04:16:57.651190 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 04:16:57.651190 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 04:16:57.651190 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 04:16:57.651190 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 04:16:57.651190 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 04:16:57.651190 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:16:57.651190 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:16:57.651190 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 605/1217] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:16:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:16:57.662527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed907fe-ee27-4beb-8316-d25d0be72fa3 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:16:57.834930 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed907fe-ee27-4beb-8316-d25d0be72fa3 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:16:57.871234 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:16:57.890806 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b1bf2-0378-48a1-81ee-c39981d4fd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:16:57.891526 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b1bf2-0378-48a1-81ee-c39981d4fd38 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:16:57.891808 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b1bf2-0378-48a1-81ee-c39981d4fd38 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:16:57.892087 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b1bf2-0378-48a1-81ee-c39981d4fd38 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:16:57.892890 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b1bf2-0378-48a1-81ee-c39981d4fd38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:16:57.893196 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b1bf2-0378-48a1-81ee-c39981d4fd38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:16:57.894679 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b1bf2-0378-48a1-81ee-c39981d4fd38 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:16:57.916871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 613/1218] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Jun 1 04:16:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:16:57.923972 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ef890-f7c2-451b-8989-d574b49e1879 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:16:58.086380 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ef890-f7c2-451b-8989-d574b49e1879 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:16:58.121836 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:16:58.131298 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a218066-0db8-446e-b122-1e0085896767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:16:58.132232 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a218066-0db8-446e-b122-1e0085896767 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:16:58.132744 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a218066-0db8-446e-b122-1e0085896767 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:16:58.133210 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a218066-0db8-446e-b122-1e0085896767 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:16:58.134624 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a218066-0db8-446e-b122-1e0085896767 None admin] RBAC: Adding query filter params (role.id=5e94b8f2c0b1418e8d2a18e4fe08d4f9, scope.project.id=31d68f64d21647688074554062952074, user.id=0433f6219478476286ea27c5c82d41a9) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:16:58.135154 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a218066-0db8-446e-b122-1e0085896767 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:16:58.137307 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a218066-0db8-446e-b122-1e0085896767 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:16:58.147033 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 606/1219] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:16:57 2022] GET /identity/v3/role_assignments?user.id=0433f6219478476286ea27c5c82d41a9&scope.project.id=31d68f64d21647688074554062952074&role.id=5e94b8f2c0b1418e8d2a18e4fe08d4f9 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:17:00.705747 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763de7a-4140-4cab-98fe-e66fc9171288 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:00.706672 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763de7a-4140-4cab-98fe-e66fc9171288 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:00.706672 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763de7a-4140-4cab-98fe-e66fc9171288 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:00.708626 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 614/1220] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:17:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:17:00.715287 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10a986-e92d-4de7-9e04-d06c6a4337f5 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:00.715979 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10a986-e92d-4de7-9e04-d06c6a4337f5 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:00.715979 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10a986-e92d-4de7-9e04-d06c6a4337f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:00.735005 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-8e10a986-e92d-4de7-9e04-d06c6a4337f5 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:17:00.736425 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-8e10a986-e92d-4de7-9e04-d06c6a4337f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:17:00.822053 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 607/1221] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:17:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 04:17:00.846898 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763de7a-4140-4cab-98fe-e66fc9171288 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:00.985333 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763de7a-4140-4cab-98fe-e66fc9171288 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:01.032086 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4062a5-611f-4509-8ae7-876c8d88e57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:01.032902 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4062a5-611f-4509-8ae7-876c8d88e57b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:01.033190 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4062a5-611f-4509-8ae7-876c8d88e57b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:01.033456 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4062a5-611f-4509-8ae7-876c8d88e57b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:01.049824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4062a5-611f-4509-8ae7-876c8d88e57b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:17:01.059861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-bf4062a5-611f-4509-8ae7-876c8d88e57b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:17:01.059861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:17:01.059861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:17:01.059861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:17:01.059861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:17:01.059861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:17:01.059861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:17:01.059861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:17:01.059861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:17:01.059861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:17:01.059861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:17:01.059861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:17:01.059861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:17:01.059861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:17:01.059861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:17:01.059861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:17:01.061745 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:17:01.061745 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:17:01.061745 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:17:01.061745 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:17:01.061745 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:17:01.061745 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:17:01.061745 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:17:01.061745 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:17:01.061745 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:17:01.061745 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:17:01.061745 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:17:01.061745 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:17:01.061745 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:17:01.061745 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:17:01.061745 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:17:01.061745 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:17:01.063378 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:17:01.063378 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:17:01.063378 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:17:01.063378 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:17:01.063378 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:17:01.063378 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:17:01.063378 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:17:01.063378 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:17:01.063378 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:17:01.063378 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:17:01.063378 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:17:01.063378 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:17:01.063378 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 615/1222] 10.222.0.32 () {56 vars in 1102 bytes} [Wed Jun 1 04:17:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:17:01.068761 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10a986-e92d-4de7-9e04-d06c6a4337f5 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:01.236698 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10a986-e92d-4de7-9e04-d06c6a4337f5 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:01.274205 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:01.295621 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f21502-7508-42d9-a038-fcb8d8e985ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:01.296446 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f21502-7508-42d9-a038-fcb8d8e985ea None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:01.296830 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f21502-7508-42d9-a038-fcb8d8e985ea None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:01.297172 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f21502-7508-42d9-a038-fcb8d8e985ea None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:01.298144 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f21502-7508-42d9-a038-fcb8d8e985ea None admin] RBAC: Adding query filter params (name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:17:01.298572 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f21502-7508-42d9-a038-fcb8d8e985ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:01.300136 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f21502-7508-42d9-a038-fcb8d8e985ea None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:01.311537 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 608/1223] 10.222.0.32 () {56 vars in 1103 bytes} [Wed Jun 1 04:17:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:17:01.318669 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4062a5-611f-4509-8ae7-876c8d88e57b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:01.377465 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:01.464711 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4062a5-611f-4509-8ae7-876c8d88e57b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:01.515534 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583b048-d301-4127-ad09-7f2e0f54f085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:01.516630 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583b048-d301-4127-ad09-7f2e0f54f085 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:01.517081 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583b048-d301-4127-ad09-7f2e0f54f085 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:01.517562 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583b048-d301-4127-ad09-7f2e0f54f085 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:01.532804 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583b048-d301-4127-ad09-7f2e0f54f085 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:01.534482 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583b048-d301-4127-ad09-7f2e0f54f085 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:01.553580 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-7583b048-d301-4127-ad09-7f2e0f54f085 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:17:01.553580 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:17:01.553580 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:17:01.553580 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:17:01.553580 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:17:01.553580 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:17:01.553580 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:17:01.553580 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:17:01.553580 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:17:01.553580 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:17:01.553580 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:17:01.553580 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:17:01.553580 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:17:01.553580 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:17:01.553580 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:17:01.554861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:17:01.554861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:17:01.554861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:17:01.554861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:17:01.554861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:17:01.554861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:17:01.554861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:17:01.554861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:17:01.554861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:17:01.554861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:17:01.554861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:17:01.554861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:17:01.554861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:17:01.554861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:17:01.554861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:17:01.554861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:17:01.554861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:17:01.556527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:17:01.556527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:17:01.556527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:17:01.556527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:17:01.556527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 616/1224] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:17:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:17:01.561894 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f21502-7508-42d9-a038-fcb8d8e985ea None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:01.708792 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f21502-7508-42d9-a038-fcb8d8e985ea None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:01.757769 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4447b-9f80-47f9-a331-130b42ff4cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:01.758877 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4447b-9f80-47f9-a331-130b42ff4cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:01.759081 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4447b-9f80-47f9-a331-130b42ff4cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:01.759310 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4447b-9f80-47f9-a331-130b42ff4cd8 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:01.760306 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da4447b-9f80-47f9-a331-130b42ff4cd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:17:01.760823 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da4447b-9f80-47f9-a331-130b42ff4cd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:01.762686 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da4447b-9f80-47f9-a331-130b42ff4cd8 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:01.781499 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 609/1225] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:17:01.788880 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583b048-d301-4127-ad09-7f2e0f54f085 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:01.956988 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:01.973511 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583b048-d301-4127-ad09-7f2e0f54f085 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:02.028972 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd61972-3c7e-457a-bf1b-3b38d2680843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:02.030595 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd61972-3c7e-457a-bf1b-3b38d2680843 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:02.031184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd61972-3c7e-457a-bf1b-3b38d2680843 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:02.031649 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd61972-3c7e-457a-bf1b-3b38d2680843 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:02.043869 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd61972-3c7e-457a-bf1b-3b38d2680843 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:02.046548 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd61972-3c7e-457a-bf1b-3b38d2680843 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:02.064261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-8fd61972-3c7e-457a-bf1b-3b38d2680843 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 01 04:17:02.064261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:17:02.064261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:17:02.064261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:17:02.064261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:17:02.064261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:17:02.064261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:17:02.064261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:17:02.064261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:17:02.064261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:17:02.064261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:17:02.064261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:17:02.064261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 04:17:02.064261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 04:17:02.064261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 04:17:02.064261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 04:17:02.066577 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:17:02.066577 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:17:02.066577 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 04:17:02.066577 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:17:02.066577 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 04:17:02.066577 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:17:02.066577 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:17:02.066577 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:17:02.066577 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:17:02.066577 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:17:02.066577 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:17:02.066577 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:17:02.066577 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:17:02.066577 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:17:02.066577 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:17:02.066577 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:17:02.066577 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:17:02.066577 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:17:02.068225 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:17:02.068225 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:17:02.068225 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 04:17:02.068225 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 04:17:02.068225 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 04:17:02.068225 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 04:17:02.068225 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 04:17:02.068225 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 04:17:02.068225 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 01 04:17:02.068225 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:17:02.068225 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 617/1226] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:17:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:17:02.072799 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4447b-9f80-47f9-a331-130b42ff4cd8 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:02.134685 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:02.227430 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4447b-9f80-47f9-a331-130b42ff4cd8 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:02.278851 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed86c9-3937-4991-a602-20446e71f6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:02.280004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed86c9-3937-4991-a602-20446e71f6e3 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:02.280500 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed86c9-3937-4991-a602-20446e71f6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:02.280993 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed86c9-3937-4991-a602-20446e71f6e3 None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:02.282677 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed86c9-3937-4991-a602-20446e71f6e3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:17:02.283181 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed86c9-3937-4991-a602-20446e71f6e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:02.285995 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed86c9-3937-4991-a602-20446e71f6e3 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:02.319305 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 610/1227] 10.222.0.32 () {56 vars in 1143 bytes} [Wed Jun 1 04:17:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:17:02.329034 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd61972-3c7e-457a-bf1b-3b38d2680843 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:02.473868 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd61972-3c7e-457a-bf1b-3b38d2680843 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:02.532090 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99631a33-5f50-4676-b9b3-f4f41aec135c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:02.533467 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99631a33-5f50-4676-b9b3-f4f41aec135c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:02.533883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99631a33-5f50-4676-b9b3-f4f41aec135c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:02.534515 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99631a33-5f50-4676-b9b3-f4f41aec135c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:02.550425 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99631a33-5f50-4676-b9b3-f4f41aec135c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:02.553132 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99631a33-5f50-4676-b9b3-f4f41aec135c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:02.582448 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-99631a33-5f50-4676-b9b3-f4f41aec135c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:17:02.582448 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:17:02.582448 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:17:02.582448 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:17:02.582448 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:17:02.582448 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:17:02.582448 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:17:02.582448 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:17:02.582448 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:17:02.582448 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:17:02.582448 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:17:02.582448 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:17:02.582448 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:17:02.582448 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:17:02.582448 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:17:02.583572 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:17:02.583572 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:17:02.583572 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:17:02.583572 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:17:02.583572 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:17:02.583572 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:17:02.583572 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:17:02.583572 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:17:02.583572 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:17:02.583572 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:17:02.583572 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:17:02.583572 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:17:02.583572 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:17:02.583572 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:17:02.583572 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:17:02.583572 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:17:02.583572 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:17:02.585810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:17:02.585810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:17:02.585810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:17:02.585810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:17:02.585810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 618/1228] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:17:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:17:02.592761 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed86c9-3937-4991-a602-20446e71f6e3 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:02.751578 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed86c9-3937-4991-a602-20446e71f6e3 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:02.755944 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:02.801909 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc1760-09e7-49f4-b8d8-51e3fd387385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:02.803094 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc1760-09e7-49f4-b8d8-51e3fd387385 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:02.803579 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc1760-09e7-49f4-b8d8-51e3fd387385 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:02.804040 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc1760-09e7-49f4-b8d8-51e3fd387385 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:02.805082 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc1760-09e7-49f4-b8d8-51e3fd387385 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:17:02.805449 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc1760-09e7-49f4-b8d8-51e3fd387385 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:02.807856 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc1760-09e7-49f4-b8d8-51e3fd387385 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:02.838216 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 611/1229] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:17:02.839847 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99631a33-5f50-4676-b9b3-f4f41aec135c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:02.859242 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:03.015178 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99631a33-5f50-4676-b9b3-f4f41aec135c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:03.070528 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34307252-d94b-4ae6-a939-f8ddbabc718e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:03.071260 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34307252-d94b-4ae6-a939-f8ddbabc718e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:03.071544 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34307252-d94b-4ae6-a939-f8ddbabc718e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:03.071821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34307252-d94b-4ae6-a939-f8ddbabc718e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:03.080720 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34307252-d94b-4ae6-a939-f8ddbabc718e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:03.082215 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34307252-d94b-4ae6-a939-f8ddbabc718e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:03.107797 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-34307252-d94b-4ae6-a939-f8ddbabc718e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:17:03.107797 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:17:03.107797 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:17:03.107797 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:17:03.107797 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:17:03.107797 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:17:03.107797 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:17:03.107797 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:17:03.107797 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:17:03.107797 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:17:03.107797 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:17:03.107797 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:17:03.107797 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 04:17:03.107797 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 04:17:03.107797 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 04:17:03.109873 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 04:17:03.109873 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:17:03.109873 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:17:03.109873 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:17:03.109873 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:17:03.109873 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:17:03.109873 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:17:03.109873 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:17:03.109873 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:17:03.109873 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:17:03.109873 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:17:03.109873 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:17:03.109873 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:17:03.109873 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:17:03.109873 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:17:03.109873 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:17:03.109873 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:17:03.111547 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 04:17:03.111547 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 04:17:03.111547 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 04:17:03.111547 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 04:17:03.111547 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 04:17:03.111547 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 04:17:03.111547 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:17:03.111547 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:17:03.111547 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 619/1230] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:17:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:17:03.120051 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc1760-09e7-49f4-b8d8-51e3fd387385 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:03.280817 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc1760-09e7-49f4-b8d8-51e3fd387385 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:03.329430 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da827c61-5143-4db3-8594-ab02e4b48d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:03.330521 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da827c61-5143-4db3-8594-ab02e4b48d42 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:03.330968 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da827c61-5143-4db3-8594-ab02e4b48d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:03.331428 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da827c61-5143-4db3-8594-ab02e4b48d42 None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:03.332603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da827c61-5143-4db3-8594-ab02e4b48d42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:17:03.333026 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da827c61-5143-4db3-8594-ab02e4b48d42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:03.335492 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da827c61-5143-4db3-8594-ab02e4b48d42 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:03.353736 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 612/1231] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Jun 1 04:17:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:17:03.360974 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34307252-d94b-4ae6-a939-f8ddbabc718e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:03.445293 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:03.509623 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34307252-d94b-4ae6-a939-f8ddbabc718e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:03.558495 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef3c5f-6bfd-4e48-9435-606ee2410266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:03.559810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef3c5f-6bfd-4e48-9435-606ee2410266 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:03.560286 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef3c5f-6bfd-4e48-9435-606ee2410266 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:03.560805 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef3c5f-6bfd-4e48-9435-606ee2410266 None admin] PATH_INFO: `/v3/projects/31d68f64d21647688074554062952074/users/0433f6219478476286ea27c5c82d41a9/roles/5e94b8f2c0b1418e8d2a18e4fe08d4f9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:03.580333 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef3c5f-6bfd-4e48-9435-606ee2410266 None admin] RBAC: Authorizing `identity:create_grant(project_id=31d68f64d21647688074554062952074, user_id=0433f6219478476286ea27c5c82d41a9, role_id=5e94b8f2c0b1418e8d2a18e4fe08d4f9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:03.581961 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef3c5f-6bfd-4e48-9435-606ee2410266 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:03.597028 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 620/1232] 10.222.0.32 () {58 vars in 1439 bytes} [Wed Jun 1 04:17:03 2022] PUT /identity/v3/projects/31d68f64d21647688074554062952074/users/0433f6219478476286ea27c5c82d41a9/roles/5e94b8f2c0b1418e8d2a18e4fe08d4f9 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:17:06.077331 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fae23-ac07-4707-af46-bac54d21c3ff None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:06.077956 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fae23-ac07-4707-af46-bac54d21c3ff None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:06.078321 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fae23-ac07-4707-af46-bac54d21c3ff None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:06.080274 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 613/1233] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:17:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:17:06.087362 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6a767-364a-4d59-97e4-ded8ac8f2ba0 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:06.088161 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6a767-364a-4d59-97e4-ded8ac8f2ba0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:06.088161 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6a767-364a-4d59-97e4-ded8ac8f2ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:06.115359 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b7a6a767-364a-4d59-97e4-ded8ac8f2ba0 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:17:06.117460 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b7a6a767-364a-4d59-97e4-ded8ac8f2ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:17:06.224641 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 621/1234] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:17:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:17:06.254929 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805fae23-ac07-4707-af46-bac54d21c3ff None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:06.289048 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:06.402481 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805fae23-ac07-4707-af46-bac54d21c3ff None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:06.458215 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8990f-88e2-4d7e-8654-c1695a4283e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:06.459617 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8990f-88e2-4d7e-8654-c1695a4283e1 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:06.460115 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8990f-88e2-4d7e-8654-c1695a4283e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:06.460593 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8990f-88e2-4d7e-8654-c1695a4283e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:06.482754 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f8990f-88e2-4d7e-8654-c1695a4283e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:17:06.494970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-25f8990f-88e2-4d7e-8654-c1695a4283e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:17:06.494970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:17:06.494970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:17:06.494970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:17:06.494970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:17:06.494970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:17:06.494970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:17:06.494970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:17:06.494970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:17:06.494970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:17:06.494970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:17:06.494970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:17:06.494970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:17:06.494970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:17:06.494970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:17:06.494970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:17:06.497204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:17:06.497204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:17:06.497204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:17:06.497204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:17:06.497204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:17:06.497204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:17:06.497204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:17:06.497204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:17:06.497204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:17:06.497204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:17:06.497204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:17:06.497204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:17:06.497204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:17:06.497204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:17:06.497204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:17:06.497204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:17:06.498951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:17:06.498951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:17:06.498951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:17:06.498951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:17:06.498951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:17:06.498951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:17:06.498951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:17:06.498951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:17:06.498951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:17:06.498951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:17:06.498951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 04:17:06.498951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:17:06.498951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 614/1235] 10.222.0.32 () {56 vars in 1102 bytes} [Wed Jun 1 04:17:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:17:06.505927 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6a767-364a-4d59-97e4-ded8ac8f2ba0 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:06.575985 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:06.656337 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6a767-364a-4d59-97e4-ded8ac8f2ba0 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:06.701218 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a915f73-be44-42bf-bb3d-9a3400a95486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:06.702023 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a915f73-be44-42bf-bb3d-9a3400a95486 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:06.702290 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a915f73-be44-42bf-bb3d-9a3400a95486 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:06.702584 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a915f73-be44-42bf-bb3d-9a3400a95486 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:06.703331 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a915f73-be44-42bf-bb3d-9a3400a95486 None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:17:06.703638 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a915f73-be44-42bf-bb3d-9a3400a95486 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:06.705052 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a915f73-be44-42bf-bb3d-9a3400a95486 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:06.717241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 622/1236] 10.222.0.32 () {56 vars in 1103 bytes} [Wed Jun 1 04:17:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:17:06.723555 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8990f-88e2-4d7e-8654-c1695a4283e1 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:06.843414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:06.865363 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8990f-88e2-4d7e-8654-c1695a4283e1 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:06.924878 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962bcd81-7cb4-4efa-adce-191da4bf1c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:06.926168 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bcd81-7cb4-4efa-adce-191da4bf1c31 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:06.926602 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bcd81-7cb4-4efa-adce-191da4bf1c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:06.927325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bcd81-7cb4-4efa-adce-191da4bf1c31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:06.949213 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962bcd81-7cb4-4efa-adce-191da4bf1c31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:06.952807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962bcd81-7cb4-4efa-adce-191da4bf1c31 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:06.987765 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-962bcd81-7cb4-4efa-adce-191da4bf1c31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:17:06.987765 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:17:06.987765 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:17:06.987765 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:17:06.987765 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:17:06.987765 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:17:06.987765 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:17:06.987765 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:17:06.987765 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:17:06.987765 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:17:06.987765 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:17:06.987765 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:17:06.987765 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:17:06.987765 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:17:06.987765 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:17:06.990040 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:17:06.990040 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:17:06.990040 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:17:06.990040 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:17:06.990040 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:17:06.990040 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:17:06.990040 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:17:06.990040 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:17:06.990040 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:17:06.990040 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:17:06.990040 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:17:06.990040 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:17:06.990040 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:17:06.990040 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:17:06.990040 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:17:06.990040 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:17:06.990040 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:17:06.992258 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:17:06.992258 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:17:06.992258 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:17:06.992258 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:17:06.992258 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 615/1237] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:17:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:17:06.997613 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a915f73-be44-42bf-bb3d-9a3400a95486 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:07.127527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a915f73-be44-42bf-bb3d-9a3400a95486 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:07.140703 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:07.178319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6850a-4184-4d50-9419-0728ffe97eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:07.179221 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6850a-4184-4d50-9419-0728ffe97eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:07.179641 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6850a-4184-4d50-9419-0728ffe97eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:07.180151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6850a-4184-4d50-9419-0728ffe97eb8 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:07.181097 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef6850a-4184-4d50-9419-0728ffe97eb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:17:07.181516 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef6850a-4184-4d50-9419-0728ffe97eb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:07.183369 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef6850a-4184-4d50-9419-0728ffe97eb8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:07.198570 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 623/1238] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:17:07.204782 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962bcd81-7cb4-4efa-adce-191da4bf1c31 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:07.387003 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962bcd81-7cb4-4efa-adce-191da4bf1c31 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:07.434095 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d874e-958e-4056-b6f7-879ea8052604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:07.435455 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d874e-958e-4056-b6f7-879ea8052604 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:07.435764 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d874e-958e-4056-b6f7-879ea8052604 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:07.436053 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d874e-958e-4056-b6f7-879ea8052604 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:07.439742 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:07.446168 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d874e-958e-4056-b6f7-879ea8052604 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:07.447891 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d874e-958e-4056-b6f7-879ea8052604 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:07.464755 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-c44d874e-958e-4056-b6f7-879ea8052604 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 01 04:17:07.464755 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:17:07.464755 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:17:07.464755 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:17:07.464755 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:17:07.464755 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:17:07.464755 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:17:07.464755 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:17:07.464755 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:17:07.464755 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:17:07.464755 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:17:07.464755 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:17:07.464755 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 04:17:07.464755 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 04:17:07.464755 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 04:17:07.464755 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 04:17:07.466259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:17:07.466259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:17:07.466259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 04:17:07.466259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:17:07.466259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 04:17:07.466259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:17:07.466259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:17:07.466259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:17:07.466259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:17:07.466259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:17:07.466259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:17:07.466259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:17:07.466259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:17:07.466259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:17:07.466259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:17:07.466259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:17:07.466259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:17:07.466259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:17:07.467396 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:17:07.467396 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:17:07.467396 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 04:17:07.467396 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 04:17:07.467396 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 04:17:07.467396 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 04:17:07.467396 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 04:17:07.467396 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 04:17:07.467396 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 01 04:17:07.467396 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:17:07.467396 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 616/1239] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:17:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:17:07.473127 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6850a-4184-4d50-9419-0728ffe97eb8 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:07.614355 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6850a-4184-4d50-9419-0728ffe97eb8 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:07.677323 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab92ae-b12e-424f-9410-26e235c24bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:07.678315 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab92ae-b12e-424f-9410-26e235c24bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:07.678672 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab92ae-b12e-424f-9410-26e235c24bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:07.679042 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab92ae-b12e-424f-9410-26e235c24bd5 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:07.680049 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab92ae-b12e-424f-9410-26e235c24bd5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:17:07.680450 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab92ae-b12e-424f-9410-26e235c24bd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:07.682087 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab92ae-b12e-424f-9410-26e235c24bd5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:07.702506 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 624/1240] 10.222.0.32 () {56 vars in 1143 bytes} [Wed Jun 1 04:17:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:17:07.710470 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d874e-958e-4056-b6f7-879ea8052604 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:07.857548 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d874e-958e-4056-b6f7-879ea8052604 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:07.900897 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ecd932-b24d-4601-bc77-ecad8a3bbbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:07.902098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecd932-b24d-4601-bc77-ecad8a3bbbc4 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:07.902526 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecd932-b24d-4601-bc77-ecad8a3bbbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:07.903676 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecd932-b24d-4601-bc77-ecad8a3bbbc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:08.010672 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:08.022817 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ecd932-b24d-4601-bc77-ecad8a3bbbc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:08.025517 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ecd932-b24d-4601-bc77-ecad8a3bbbc4 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:08.195204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 617/1241] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:17:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 01 04:17:08.197186 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab92ae-b12e-424f-9410-26e235c24bd5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:08.241953 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:08.342653 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab92ae-b12e-424f-9410-26e235c24bd5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:08.389133 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a8da5-28ba-4dc9-a519-44a0bb3bf6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:08.390022 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a8da5-28ba-4dc9-a519-44a0bb3bf6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:08.390316 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a8da5-28ba-4dc9-a519-44a0bb3bf6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:08.390591 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a8da5-28ba-4dc9-a519-44a0bb3bf6c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:08.404051 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4a8da5-28ba-4dc9-a519-44a0bb3bf6c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:08.405686 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4a8da5-28ba-4dc9-a519-44a0bb3bf6c7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:08.424814 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-5f4a8da5-28ba-4dc9-a519-44a0bb3bf6c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:17:08.424814 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:17:08.424814 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:17:08.424814 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:17:08.424814 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:17:08.424814 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:17:08.424814 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:17:08.424814 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:17:08.424814 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:17:08.424814 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:17:08.424814 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:17:08.424814 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:17:08.424814 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:17:08.424814 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:17:08.424814 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:17:08.428848 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:17:08.428848 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:17:08.428848 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:17:08.428848 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:17:08.428848 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:17:08.428848 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:17:08.428848 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:17:08.428848 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:17:08.428848 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:17:08.428848 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:17:08.428848 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:17:08.428848 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:17:08.428848 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:17:08.428848 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:17:08.428848 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:17:08.428848 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:17:08.428848 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:17:08.437834 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:17:08.437834 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:17:08.437834 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:17:08.437834 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:17:08.437834 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 625/1242] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:17:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:17:08.438287 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ecd932-b24d-4601-bc77-ecad8a3bbbc4 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:08.587752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:08.599197 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ecd932-b24d-4601-bc77-ecad8a3bbbc4 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:08.660598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb7f14-bd33-4da7-b4fa-66e675258d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:08.661272 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb7f14-bd33-4da7-b4fa-66e675258d6a None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:08.661570 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb7f14-bd33-4da7-b4fa-66e675258d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:08.661838 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb7f14-bd33-4da7-b4fa-66e675258d6a None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:08.662628 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb7f14-bd33-4da7-b4fa-66e675258d6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:17:08.662918 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb7f14-bd33-4da7-b4fa-66e675258d6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:08.664309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb7f14-bd33-4da7-b4fa-66e675258d6a None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:08.678202 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 618/1243] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:17:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:17:08.684485 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a8da5-28ba-4dc9-a519-44a0bb3bf6c7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:08.815114 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:08.843109 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a8da5-28ba-4dc9-a519-44a0bb3bf6c7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:08.890058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c3997-5d3f-49cd-9bf1-0f0f84369ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:08.890817 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c3997-5d3f-49cd-9bf1-0f0f84369ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:08.891099 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c3997-5d3f-49cd-9bf1-0f0f84369ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:08.891376 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c3997-5d3f-49cd-9bf1-0f0f84369ef4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:08.900533 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c3997-5d3f-49cd-9bf1-0f0f84369ef4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:08.902405 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c3997-5d3f-49cd-9bf1-0f0f84369ef4 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:08.919871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-4b3c3997-5d3f-49cd-9bf1-0f0f84369ef4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:17:08.919871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:17:08.919871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:17:08.919871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:17:08.919871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:17:08.919871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:17:08.919871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:17:08.919871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:17:08.919871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:17:08.919871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:17:08.919871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:17:08.919871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:17:08.919871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 04:17:08.919871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 04:17:08.919871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 04:17:08.921274 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 04:17:08.921274 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:17:08.921274 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:17:08.921274 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:17:08.921274 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:17:08.921274 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:17:08.921274 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:17:08.921274 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:17:08.921274 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:17:08.921274 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:17:08.921274 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:17:08.921274 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:17:08.921274 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:17:08.921274 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:17:08.921274 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:17:08.921274 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:17:08.921274 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:17:08.923024 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 04:17:08.923024 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 04:17:08.923024 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 04:17:08.923024 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 04:17:08.923024 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 04:17:08.923024 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 04:17:08.923024 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:17:08.923024 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:17:08.928140 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 626/1244] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:17:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:17:08.929721 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb7f14-bd33-4da7-b4fa-66e675258d6a None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:09.086963 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb7f14-bd33-4da7-b4fa-66e675258d6a None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:09.133669 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e50d5-0475-47d0-b2bd-6aacf2f0ea96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:09.134754 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e50d5-0475-47d0-b2bd-6aacf2f0ea96 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:09.135091 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e50d5-0475-47d0-b2bd-6aacf2f0ea96 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:09.135414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e50d5-0475-47d0-b2bd-6aacf2f0ea96 None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:09.136298 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e50d5-0475-47d0-b2bd-6aacf2f0ea96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:17:09.136694 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e50d5-0475-47d0-b2bd-6aacf2f0ea96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:09.139341 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e50d5-0475-47d0-b2bd-6aacf2f0ea96 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:09.162722 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 619/1245] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Jun 1 04:17:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:17:09.173615 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c3997-5d3f-49cd-9bf1-0f0f84369ef4 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:09.351527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c3997-5d3f-49cd-9bf1-0f0f84369ef4 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:09.412801 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db734c-1233-4e9e-8f2c-df49fe2c344f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:09.413378 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db734c-1233-4e9e-8f2c-df49fe2c344f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:09.413668 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db734c-1233-4e9e-8f2c-df49fe2c344f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:09.413951 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db734c-1233-4e9e-8f2c-df49fe2c344f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:09.414890 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db734c-1233-4e9e-8f2c-df49fe2c344f None admin] RBAC: Adding query filter params (role.id=5e94b8f2c0b1418e8d2a18e4fe08d4f9, scope.project.id=31d68f64d21647688074554062952074, user.id=0433f6219478476286ea27c5c82d41a9) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:17:09.415211 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db734c-1233-4e9e-8f2c-df49fe2c344f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:09.416779 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db734c-1233-4e9e-8f2c-df49fe2c344f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:09.424948 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 627/1246] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:17:09 2022] GET /identity/v3/role_assignments?user.id=0433f6219478476286ea27c5c82d41a9&scope.project.id=31d68f64d21647688074554062952074&role.id=5e94b8f2c0b1418e8d2a18e4fe08d4f9 => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:17:12.137052 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d65557-2e31-469c-bdd6-46de00f92ce5 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:12.137757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d65557-2e31-469c-bdd6-46de00f92ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:12.137937 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d65557-2e31-469c-bdd6-46de00f92ce5 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:12.140308 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 620/1247] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:17:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:17:12.149044 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba4f70-2773-4e1f-a86a-dc15a50bef75 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:12.149811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba4f70-2773-4e1f-a86a-dc15a50bef75 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:12.150257 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba4f70-2773-4e1f-a86a-dc15a50bef75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:12.159311 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:12.175079 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7fba4f70-2773-4e1f-a86a-dc15a50bef75 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:17:12.176418 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7fba4f70-2773-4e1f-a86a-dc15a50bef75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:17:12.268476 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 628/1248] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:17:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:17:12.294873 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d65557-2e31-469c-bdd6-46de00f92ce5 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:12.331995 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:12.451083 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d65557-2e31-469c-bdd6-46de00f92ce5 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:12.500608 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650d979-d829-44e7-98da-6f1ea8cbcce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:12.501768 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650d979-d829-44e7-98da-6f1ea8cbcce6 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:12.502268 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650d979-d829-44e7-98da-6f1ea8cbcce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:12.502670 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650d979-d829-44e7-98da-6f1ea8cbcce6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:12.520027 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650d979-d829-44e7-98da-6f1ea8cbcce6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:17:12.532757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-4650d979-d829-44e7-98da-6f1ea8cbcce6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:17:12.532757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:17:12.532757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:17:12.532757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:17:12.532757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:17:12.532757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:17:12.532757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:17:12.532757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:17:12.532757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:17:12.532757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:17:12.532757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:17:12.532757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:17:12.532757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:17:12.532757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:17:12.532757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:17:12.532757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:17:12.533890 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:17:12.533890 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:17:12.533890 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:17:12.533890 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:17:12.533890 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:17:12.533890 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:17:12.533890 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:17:12.533890 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:17:12.533890 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:17:12.533890 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:17:12.533890 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:17:12.533890 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:17:12.533890 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:17:12.533890 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:17:12.533890 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:17:12.533890 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:17:12.535352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:17:12.535352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:17:12.535352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:17:12.535352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:17:12.535352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:17:12.535352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:17:12.535352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:17:12.535352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:17:12.535352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:17:12.535352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:17:12.535352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:17:12.535352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:17:12.535352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 621/1249] 10.222.0.32 () {56 vars in 1096 bytes} [Wed Jun 1 04:17:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:17:12.541909 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba4f70-2773-4e1f-a86a-dc15a50bef75 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:12.691186 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba4f70-2773-4e1f-a86a-dc15a50bef75 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:12.735202 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:12.740733 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3887d1-5866-4c8f-bcd0-47343cbd529c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:12.741542 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3887d1-5866-4c8f-bcd0-47343cbd529c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:12.742273 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3887d1-5866-4c8f-bcd0-47343cbd529c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:12.742650 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3887d1-5866-4c8f-bcd0-47343cbd529c None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:12.743450 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3887d1-5866-4c8f-bcd0-47343cbd529c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:17:12.743778 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3887d1-5866-4c8f-bcd0-47343cbd529c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:12.745712 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3887d1-5866-4c8f-bcd0-47343cbd529c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:12.759143 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 629/1250] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:17:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:17:12.766662 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650d979-d829-44e7-98da-6f1ea8cbcce6 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:12.890126 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:12.924205 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650d979-d829-44e7-98da-6f1ea8cbcce6 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:12.980098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0720f1-3ac1-470f-91bc-16b8937539dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:12.982081 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0720f1-3ac1-470f-91bc-16b8937539dd None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:12.982475 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0720f1-3ac1-470f-91bc-16b8937539dd None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:12.982922 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0720f1-3ac1-470f-91bc-16b8937539dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:13.000621 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0720f1-3ac1-470f-91bc-16b8937539dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:13.003242 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0720f1-3ac1-470f-91bc-16b8937539dd None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:13.030595 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-0e0720f1-3ac1-470f-91bc-16b8937539dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:17:13.030595 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:17:13.030595 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:17:13.030595 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:17:13.030595 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:17:13.030595 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:17:13.030595 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:17:13.030595 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:17:13.030595 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:17:13.030595 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:17:13.030595 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:17:13.030595 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:17:13.030595 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:17:13.030595 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:17:13.030595 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:17:13.032374 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:17:13.032374 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:17:13.032374 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:17:13.032374 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:17:13.032374 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:17:13.032374 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:17:13.032374 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:17:13.032374 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:17:13.032374 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:17:13.032374 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:17:13.032374 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:17:13.032374 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:17:13.032374 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:17:13.032374 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:17:13.032374 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:17:13.032374 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:17:13.032374 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:17:13.034161 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:17:13.034161 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:17:13.034161 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:17:13.034161 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:17:13.034161 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 622/1251] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:17:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:17:13.039562 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3887d1-5866-4c8f-bcd0-47343cbd529c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:13.182960 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3887d1-5866-4c8f-bcd0-47343cbd529c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:13.237592 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705876bb-c0cd-41b8-b075-778e74ec681a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:13.238504 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705876bb-c0cd-41b8-b075-778e74ec681a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:13.238983 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705876bb-c0cd-41b8-b075-778e74ec681a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:13.239260 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705876bb-c0cd-41b8-b075-778e74ec681a None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:13.240190 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705876bb-c0cd-41b8-b075-778e74ec681a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:17:13.240720 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705876bb-c0cd-41b8-b075-778e74ec681a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:13.242384 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705876bb-c0cd-41b8-b075-778e74ec681a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:13.261839 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 630/1252] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:17:13.270513 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0720f1-3ac1-470f-91bc-16b8937539dd None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:13.423864 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0720f1-3ac1-470f-91bc-16b8937539dd None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:13.463460 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:13.473700 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a61596-aabb-4eb7-ad7b-9fb0703d530e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:13.474556 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a61596-aabb-4eb7-ad7b-9fb0703d530e None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:13.474960 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a61596-aabb-4eb7-ad7b-9fb0703d530e None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:13.475253 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a61596-aabb-4eb7-ad7b-9fb0703d530e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:13.487859 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a61596-aabb-4eb7-ad7b-9fb0703d530e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:13.490108 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a61596-aabb-4eb7-ad7b-9fb0703d530e None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:13.506298 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-d7a61596-aabb-4eb7-ad7b-9fb0703d530e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 01 04:17:13.506298 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:17:13.506298 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:17:13.506298 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:17:13.506298 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:17:13.506298 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:17:13.506298 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:17:13.506298 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:17:13.506298 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:17:13.506298 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:17:13.506298 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:17:13.506298 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:17:13.506298 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 04:17:13.506298 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 04:17:13.506298 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 04:17:13.506298 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 04:17:13.508568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:17:13.508568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:17:13.508568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 04:17:13.508568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:17:13.508568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 04:17:13.508568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:17:13.508568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:17:13.508568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:17:13.508568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:17:13.508568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:17:13.508568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:17:13.508568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:17:13.508568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:17:13.508568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:17:13.508568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:17:13.508568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:17:13.508568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:17:13.508568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:17:13.510791 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:17:13.510791 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:17:13.510791 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 04:17:13.510791 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 04:17:13.510791 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 04:17:13.510791 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 04:17:13.510791 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 04:17:13.510791 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 04:17:13.510791 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 01 04:17:13.510791 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:17:13.510791 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 623/1253] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:17:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:17:13.515790 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705876bb-c0cd-41b8-b075-778e74ec681a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:13.611357 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:13.682987 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705876bb-c0cd-41b8-b075-778e74ec681a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:13.736135 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c70a4e3-22bf-4e15-9589-6b669803113f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:13.737298 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70a4e3-22bf-4e15-9589-6b669803113f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:13.737824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70a4e3-22bf-4e15-9589-6b669803113f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:13.738349 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70a4e3-22bf-4e15-9589-6b669803113f None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:13.739909 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c70a4e3-22bf-4e15-9589-6b669803113f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:17:13.740388 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c70a4e3-22bf-4e15-9589-6b669803113f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:13.742675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c70a4e3-22bf-4e15-9589-6b669803113f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:13.771886 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 631/1254] 10.222.0.32 () {56 vars in 1143 bytes} [Wed Jun 1 04:17:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:17:13.780888 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a61596-aabb-4eb7-ad7b-9fb0703d530e None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:13.944124 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a61596-aabb-4eb7-ad7b-9fb0703d530e None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:14.012608 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d2d89-d8f2-441b-8a24-7e5c14c26b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:14.013482 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d2d89-d8f2-441b-8a24-7e5c14c26b95 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:14.013889 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d2d89-d8f2-441b-8a24-7e5c14c26b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:14.014290 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d2d89-d8f2-441b-8a24-7e5c14c26b95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:14.088287 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:14.113502 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d2d89-d8f2-441b-8a24-7e5c14c26b95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:14.116230 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d2d89-d8f2-441b-8a24-7e5c14c26b95 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:14.288807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 624/1255] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:17:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 01 04:17:14.298485 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c70a4e3-22bf-4e15-9589-6b669803113f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:14.446988 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c70a4e3-22bf-4e15-9589-6b669803113f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:14.470066 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:14.502788 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6349f-5d32-41ac-84c3-73a758b6e642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:14.503901 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6349f-5d32-41ac-84c3-73a758b6e642 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:14.504321 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6349f-5d32-41ac-84c3-73a758b6e642 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:14.504650 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6349f-5d32-41ac-84c3-73a758b6e642 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:14.519127 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec6349f-5d32-41ac-84c3-73a758b6e642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:14.520720 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec6349f-5d32-41ac-84c3-73a758b6e642 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:14.546218 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-dec6349f-5d32-41ac-84c3-73a758b6e642 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:17:14.546218 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:17:14.546218 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:17:14.546218 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:17:14.546218 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:17:14.546218 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:17:14.546218 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:17:14.546218 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:17:14.546218 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:17:14.546218 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:17:14.546218 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:17:14.546218 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:17:14.546218 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:17:14.546218 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:17:14.546218 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:17:14.547402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:17:14.547402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:17:14.547402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:17:14.547402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:17:14.547402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:17:14.547402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:17:14.547402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:17:14.547402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:17:14.547402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:17:14.547402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:17:14.547402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:17:14.547402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:17:14.547402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:17:14.547402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:17:14.547402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:17:14.547402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:17:14.547402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:17:14.548324 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:17:14.548324 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:17:14.548324 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:17:14.548324 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:17:14.552561 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 632/1256] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:17:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:17:14.553789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d2d89-d8f2-441b-8a24-7e5c14c26b95 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:14.675330 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:14.688690 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d2d89-d8f2-441b-8a24-7e5c14c26b95 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:14.745783 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44bc6a-3613-4cb8-9440-b1760cbf8f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:14.746743 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44bc6a-3613-4cb8-9440-b1760cbf8f73 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:14.747121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44bc6a-3613-4cb8-9440-b1760cbf8f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:14.747493 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44bc6a-3613-4cb8-9440-b1760cbf8f73 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:14.748358 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44bc6a-3613-4cb8-9440-b1760cbf8f73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:17:14.748784 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44bc6a-3613-4cb8-9440-b1760cbf8f73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:14.750638 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44bc6a-3613-4cb8-9440-b1760cbf8f73 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:14.771288 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 625/1257] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:17:14.777743 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6349f-5d32-41ac-84c3-73a758b6e642 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:14.921893 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6349f-5d32-41ac-84c3-73a758b6e642 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:14.981485 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99844999-5cfd-4fda-8d63-ee676d7f95c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:14.983038 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99844999-5cfd-4fda-8d63-ee676d7f95c6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:14.983606 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99844999-5cfd-4fda-8d63-ee676d7f95c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:14.984182 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99844999-5cfd-4fda-8d63-ee676d7f95c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:14.995253 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99844999-5cfd-4fda-8d63-ee676d7f95c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:14.996898 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99844999-5cfd-4fda-8d63-ee676d7f95c6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:15.012749 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-99844999-5cfd-4fda-8d63-ee676d7f95c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:17:15.012749 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:17:15.012749 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:17:15.012749 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:17:15.012749 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:17:15.012749 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:17:15.012749 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:17:15.012749 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:17:15.012749 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:17:15.012749 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:17:15.012749 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:17:15.012749 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:17:15.012749 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 04:17:15.012749 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 04:17:15.012749 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 04:17:15.013883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 04:17:15.013883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:17:15.013883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:17:15.013883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:17:15.013883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:17:15.013883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:17:15.013883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:17:15.013883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:17:15.013883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:17:15.013883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:17:15.013883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:17:15.013883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:17:15.013883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:17:15.013883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:17:15.013883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:17:15.013883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:17:15.013883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:17:15.015070 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 04:17:15.015070 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 04:17:15.015070 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 04:17:15.015070 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 04:17:15.015070 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 04:17:15.015070 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 04:17:15.015070 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:17:15.015070 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:17:15.019080 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 633/1258] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:17:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:17:15.020157 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44bc6a-3613-4cb8-9440-b1760cbf8f73 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:15.185139 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44bc6a-3613-4cb8-9440-b1760cbf8f73 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:15.232970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4afde-3640-43a4-accb-df9f088fd427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:15.233744 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4afde-3640-43a4-accb-df9f088fd427 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:15.234170 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4afde-3640-43a4-accb-df9f088fd427 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:15.234635 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4afde-3640-43a4-accb-df9f088fd427 None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:15.235817 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4afde-3640-43a4-accb-df9f088fd427 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:17:15.236296 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4afde-3640-43a4-accb-df9f088fd427 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:15.238139 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4afde-3640-43a4-accb-df9f088fd427 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:15.255975 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 626/1259] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Jun 1 04:17:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:17:15.263433 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99844999-5cfd-4fda-8d63-ee676d7f95c6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:15.319073 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:15.455426 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99844999-5cfd-4fda-8d63-ee676d7f95c6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:15.517703 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3a2c1-06f2-4b8e-963e-16b3983b0c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:15.518478 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3a2c1-06f2-4b8e-963e-16b3983b0c16 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:15.518851 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3a2c1-06f2-4b8e-963e-16b3983b0c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:15.519211 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3a2c1-06f2-4b8e-963e-16b3983b0c16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:15.520561 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3a2c1-06f2-4b8e-963e-16b3983b0c16 None admin] RBAC: Adding query filter params (role.id=76fc054ad9544460a7be1e2010c23642, scope.project.id=31d68f64d21647688074554062952074, user.id=0433f6219478476286ea27c5c82d41a9) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:17:15.521098 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3a2c1-06f2-4b8e-963e-16b3983b0c16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:15.523588 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3a2c1-06f2-4b8e-963e-16b3983b0c16 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:15.533265 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 634/1260] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:17:15 2022] GET /identity/v3/role_assignments?user.id=0433f6219478476286ea27c5c82d41a9&scope.project.id=31d68f64d21647688074554062952074&role.id=76fc054ad9544460a7be1e2010c23642 => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:17:17.895615 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308474db-0d2d-4d90-ac01-591f43d2dfa6 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:17.896244 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308474db-0d2d-4d90-ac01-591f43d2dfa6 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:17.896244 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308474db-0d2d-4d90-ac01-591f43d2dfa6 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:17.897795 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 627/1261] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:17:17.903917 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155c195-eaa8-4278-9dc1-264c8177fd10 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:17.904466 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155c195-eaa8-4278-9dc1-264c8177fd10 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:17.904587 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155c195-eaa8-4278-9dc1-264c8177fd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:17.923346 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-8155c195-eaa8-4278-9dc1-264c8177fd10 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:17:17.924613 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8155c195-eaa8-4278-9dc1-264c8177fd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:17:18.026422 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 635/1262] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:17:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 04:17:18.050925 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308474db-0d2d-4d90-ac01-591f43d2dfa6 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:18.062656 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:18.162136 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308474db-0d2d-4d90-ac01-591f43d2dfa6 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:18.197939 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247605d3-fd95-4011-bfeb-6149dc7c2701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:18.198808 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247605d3-fd95-4011-bfeb-6149dc7c2701 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:18.199092 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247605d3-fd95-4011-bfeb-6149dc7c2701 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:18.199368 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247605d3-fd95-4011-bfeb-6149dc7c2701 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:18.212251 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247605d3-fd95-4011-bfeb-6149dc7c2701 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:17:18.220789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-247605d3-fd95-4011-bfeb-6149dc7c2701 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:17:18.220789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:17:18.220789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:17:18.220789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:17:18.220789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:17:18.220789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:17:18.220789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:17:18.220789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:17:18.220789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:17:18.220789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:17:18.220789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:17:18.220789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:17:18.220789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:17:18.220789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:17:18.220789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:17:18.220789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:17:18.223259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:17:18.223259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:17:18.223259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:17:18.223259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:17:18.223259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:17:18.223259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:17:18.223259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:17:18.223259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:17:18.223259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:17:18.223259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:17:18.223259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:17:18.223259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:17:18.223259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:17:18.223259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:17:18.223259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:17:18.223259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:17:18.225488 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:17:18.225488 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:17:18.225488 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:17:18.225488 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:17:18.225488 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:17:18.225488 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:17:18.225488 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:17:18.225488 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:17:18.225488 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:17:18.225488 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:17:18.225488 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:17:18.225488 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:17:18.225488 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 628/1263] 10.222.0.32 () {56 vars in 1096 bytes} [Wed Jun 1 04:17:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:17:18.230616 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155c195-eaa8-4278-9dc1-264c8177fd10 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:18.250036 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:18.333214 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155c195-eaa8-4278-9dc1-264c8177fd10 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:18.368859 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9dd537-0e0e-4827-ad0b-24c6f85471ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:18.369536 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9dd537-0e0e-4827-ad0b-24c6f85471ce None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:18.369821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9dd537-0e0e-4827-ad0b-24c6f85471ce None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:18.370132 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9dd537-0e0e-4827-ad0b-24c6f85471ce None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:18.370888 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9dd537-0e0e-4827-ad0b-24c6f85471ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:17:18.371197 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9dd537-0e0e-4827-ad0b-24c6f85471ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:18.372634 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9dd537-0e0e-4827-ad0b-24c6f85471ce None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:18.381595 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 636/1264] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:17:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:17:18.392583 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247605d3-fd95-4011-bfeb-6149dc7c2701 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:18.471027 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:18.505884 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247605d3-fd95-4011-bfeb-6149dc7c2701 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:18.541622 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18407754-2509-4630-b61d-bc0201fda134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:18.542454 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18407754-2509-4630-b61d-bc0201fda134 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:18.542738 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18407754-2509-4630-b61d-bc0201fda134 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:18.543015 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18407754-2509-4630-b61d-bc0201fda134 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:18.555058 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18407754-2509-4630-b61d-bc0201fda134 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:18.556553 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18407754-2509-4630-b61d-bc0201fda134 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:18.575762 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-18407754-2509-4630-b61d-bc0201fda134 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:17:18.575762 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:17:18.575762 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:17:18.575762 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:17:18.575762 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:17:18.575762 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:17:18.575762 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:17:18.575762 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:17:18.575762 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:17:18.575762 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:17:18.575762 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:17:18.575762 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:17:18.575762 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:17:18.575762 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:17:18.575762 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:17:18.580598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:17:18.580598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:17:18.580598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:17:18.580598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:17:18.580598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:17:18.580598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:17:18.580598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:17:18.580598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:17:18.580598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:17:18.580598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:17:18.580598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:17:18.580598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:17:18.580598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:17:18.580598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:17:18.580598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:17:18.580598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:17:18.580598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:17:18.582632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:17:18.582632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:17:18.582632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:17:18.582632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:17:18.582632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 629/1265] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:17:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:17:18.583626 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9dd537-0e0e-4827-ad0b-24c6f85471ce None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:18.671785 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:18.693118 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9dd537-0e0e-4827-ad0b-24c6f85471ce None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:18.733294 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487796a-6394-4caa-9f0e-aa41aa719cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:18.733857 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487796a-6394-4caa-9f0e-aa41aa719cca None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:18.734298 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487796a-6394-4caa-9f0e-aa41aa719cca None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:18.734576 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487796a-6394-4caa-9f0e-aa41aa719cca None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:18.735313 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487796a-6394-4caa-9f0e-aa41aa719cca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:17:18.735621 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487796a-6394-4caa-9f0e-aa41aa719cca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:18.737020 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487796a-6394-4caa-9f0e-aa41aa719cca None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:18.750898 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 637/1266] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:17:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:17:18.759709 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18407754-2509-4630-b61d-bc0201fda134 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:18.870693 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18407754-2509-4630-b61d-bc0201fda134 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:18.891944 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:18.914134 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78cbda-4574-43ff-9009-bcec3451c802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:18.915522 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78cbda-4574-43ff-9009-bcec3451c802 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:18.916026 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78cbda-4574-43ff-9009-bcec3451c802 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:18.916524 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78cbda-4574-43ff-9009-bcec3451c802 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:18.930260 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78cbda-4574-43ff-9009-bcec3451c802 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:18.932901 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78cbda-4574-43ff-9009-bcec3451c802 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:18.964592 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-bb78cbda-4574-43ff-9009-bcec3451c802 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 01 04:17:18.964592 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:17:18.964592 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:17:18.964592 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:17:18.964592 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:17:18.964592 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:17:18.964592 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:17:18.964592 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:17:18.964592 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:17:18.964592 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:17:18.964592 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:17:18.964592 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:17:18.964592 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 04:17:18.964592 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 04:17:18.964592 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 04:17:18.964592 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 04:17:18.967037 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:17:18.967037 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:17:18.967037 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 04:17:18.967037 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:17:18.967037 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 04:17:18.967037 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:17:18.967037 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:17:18.967037 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:17:18.967037 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:17:18.967037 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:17:18.967037 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:17:18.967037 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:17:18.967037 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:17:18.967037 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:17:18.967037 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:17:18.967037 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:17:18.967037 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:17:18.967037 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:17:18.968036 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:17:18.968036 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:17:18.968036 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 04:17:18.968036 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 04:17:18.968036 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 04:17:18.968036 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 04:17:18.968036 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 04:17:18.968036 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 04:17:18.968036 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 01 04:17:18.968036 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:17:18.968036 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 630/1267] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:17:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:17:18.973181 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487796a-6394-4caa-9f0e-aa41aa719cca None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:19.106409 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487796a-6394-4caa-9f0e-aa41aa719cca None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:19.145912 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a35197-b3c2-4ed3-a159-2c2512c5cffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:19.147092 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a35197-b3c2-4ed3-a159-2c2512c5cffe None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:19.147595 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a35197-b3c2-4ed3-a159-2c2512c5cffe None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:19.148093 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a35197-b3c2-4ed3-a159-2c2512c5cffe None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:19.149707 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a35197-b3c2-4ed3-a159-2c2512c5cffe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:17:19.150293 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a35197-b3c2-4ed3-a159-2c2512c5cffe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:19.153586 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a35197-b3c2-4ed3-a159-2c2512c5cffe None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:19.170333 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:19.185315 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 638/1268] 10.222.0.32 () {56 vars in 1143 bytes} [Wed Jun 1 04:17:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:17:19.191175 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78cbda-4574-43ff-9009-bcec3451c802 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:19.301262 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78cbda-4574-43ff-9009-bcec3451c802 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:19.338473 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a635a-fdfa-4885-b7d5-c186ac825fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:19.339279 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a635a-fdfa-4885-b7d5-c186ac825fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:19.339567 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a635a-fdfa-4885-b7d5-c186ac825fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:19.339854 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a635a-fdfa-4885-b7d5-c186ac825fb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:19.351974 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a635a-fdfa-4885-b7d5-c186ac825fb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:19.353435 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a635a-fdfa-4885-b7d5-c186ac825fb5 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:19.372811 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-072a635a-fdfa-4885-b7d5-c186ac825fb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:17:19.372811 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:17:19.372811 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:17:19.372811 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:17:19.372811 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:17:19.372811 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:17:19.372811 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:17:19.372811 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:17:19.372811 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:17:19.372811 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:17:19.372811 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:17:19.372811 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:17:19.372811 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:17:19.372811 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:17:19.372811 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:17:19.374578 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:17:19.374578 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:17:19.374578 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:17:19.374578 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:17:19.374578 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:17:19.374578 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:17:19.374578 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:17:19.374578 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:17:19.374578 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:17:19.374578 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:17:19.374578 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:17:19.374578 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:17:19.374578 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:17:19.374578 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:17:19.374578 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:17:19.374578 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:17:19.374578 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:17:19.376576 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:17:19.376576 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:17:19.376576 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:17:19.376576 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:17:19.376576 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 631/1269] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:17:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:17:19.381079 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a35197-b3c2-4ed3-a159-2c2512c5cffe None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:19.492688 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a35197-b3c2-4ed3-a159-2c2512c5cffe None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:19.535380 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29795138-c685-431f-8097-5bde561feafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:19.536090 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29795138-c685-431f-8097-5bde561feafe None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:19.536381 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29795138-c685-431f-8097-5bde561feafe None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:19.536664 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29795138-c685-431f-8097-5bde561feafe None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:19.537448 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29795138-c685-431f-8097-5bde561feafe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:17:19.537762 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29795138-c685-431f-8097-5bde561feafe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:19.539302 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29795138-c685-431f-8097-5bde561feafe None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:19.553930 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 639/1270] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:17:19.560390 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a635a-fdfa-4885-b7d5-c186ac825fb5 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:19.598289 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:19.683240 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a635a-fdfa-4885-b7d5-c186ac825fb5 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:19.720506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504db3f-16e9-49df-9326-fede37ea1c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:19.721307 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504db3f-16e9-49df-9326-fede37ea1c82 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:19.721589 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504db3f-16e9-49df-9326-fede37ea1c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:19.721860 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504db3f-16e9-49df-9326-fede37ea1c82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:19.729467 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9504db3f-16e9-49df-9326-fede37ea1c82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:19.731557 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9504db3f-16e9-49df-9326-fede37ea1c82 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:19.746776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-9504db3f-16e9-49df-9326-fede37ea1c82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:17:19.746776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:17:19.746776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:17:19.746776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:17:19.746776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:17:19.746776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:17:19.746776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:17:19.746776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:17:19.746776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:17:19.746776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:17:19.746776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:17:19.746776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:17:19.746776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 04:17:19.746776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 04:17:19.746776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 04:17:19.747938 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 04:17:19.747938 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:17:19.747938 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:17:19.747938 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:17:19.747938 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:17:19.747938 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:17:19.747938 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:17:19.747938 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:17:19.747938 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:17:19.747938 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:17:19.747938 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:17:19.747938 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:17:19.747938 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:17:19.747938 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:17:19.747938 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:17:19.747938 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:17:19.747938 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:17:19.749148 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 04:17:19.749148 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 04:17:19.749148 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 04:17:19.749148 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 04:17:19.749148 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 04:17:19.749148 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 04:17:19.749148 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:17:19.749148 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:17:19.749148 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 632/1271] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:17:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:17:19.757274 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29795138-c685-431f-8097-5bde561feafe None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:19.818501 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:19.867668 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29795138-c685-431f-8097-5bde561feafe None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:19.909056 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d77eb-4b94-4793-9781-269cc2e87dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:19.909731 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d77eb-4b94-4793-9781-269cc2e87dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:19.910043 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d77eb-4b94-4793-9781-269cc2e87dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:19.910327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d77eb-4b94-4793-9781-269cc2e87dd9 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:19.911119 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d77eb-4b94-4793-9781-269cc2e87dd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:17:19.911432 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d77eb-4b94-4793-9781-269cc2e87dd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:19.912872 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d77eb-4b94-4793-9781-269cc2e87dd9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:19.927067 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 640/1272] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Jun 1 04:17:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:17:19.937368 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504db3f-16e9-49df-9326-fede37ea1c82 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:20.050043 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:20.059393 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504db3f-16e9-49df-9326-fede37ea1c82 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:20.097700 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9af3bf-7a63-4ff0-8b0d-47b64c9c0425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:20.098637 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9af3bf-7a63-4ff0-8b0d-47b64c9c0425 None admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:20.098922 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9af3bf-7a63-4ff0-8b0d-47b64c9c0425 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:20.099201 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9af3bf-7a63-4ff0-8b0d-47b64c9c0425 None admin] PATH_INFO: `/v3/projects/31d68f64d21647688074554062952074/users/0433f6219478476286ea27c5c82d41a9/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:20.101259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9af3bf-7a63-4ff0-8b0d-47b64c9c0425 None admin] RBAC: Authorizing `identity:create_grant(project_id=31d68f64d21647688074554062952074, user_id=0433f6219478476286ea27c5c82d41a9, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:20.102748 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9af3bf-7a63-4ff0-8b0d-47b64c9c0425 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:20.117868 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 633/1273] 10.222.0.32 () {58 vars in 1439 bytes} [Wed Jun 1 04:17:19 2022] PUT /identity/v3/projects/31d68f64d21647688074554062952074/users/0433f6219478476286ea27c5c82d41a9/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:17:22.545903 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8984e89-08f4-4d38-b4e4-73ae8477018a None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:22.546525 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8984e89-08f4-4d38-b4e4-73ae8477018a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:22.546666 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8984e89-08f4-4d38-b4e4-73ae8477018a None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:22.548060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 641/1274] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:17:22.553739 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b367f-460f-4241-82db-e776fc1532e4 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:22.554319 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b367f-460f-4241-82db-e776fc1532e4 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:22.554443 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b367f-460f-4241-82db-e776fc1532e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:22.572688 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-120b367f-460f-4241-82db-e776fc1532e4 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:17:22.574074 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-120b367f-460f-4241-82db-e776fc1532e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:17:22.644045 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 634/1275] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:17:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:17:22.669383 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8984e89-08f4-4d38-b4e4-73ae8477018a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:22.780740 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8984e89-08f4-4d38-b4e4-73ae8477018a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:22.800333 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:22.817885 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e31e0-9d61-48cd-abaa-10514c346e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:22.818720 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e31e0-9d61-48cd-abaa-10514c346e68 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:22.819003 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e31e0-9d61-48cd-abaa-10514c346e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:22.819276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e31e0-9d61-48cd-abaa-10514c346e68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:22.829946 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e31e0-9d61-48cd-abaa-10514c346e68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 04:17:22.837693 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-305e31e0-9d61-48cd-abaa-10514c346e68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:17:22.837693 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:17:22.837693 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:17:22.837693 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:17:22.837693 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:17:22.837693 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:17:22.837693 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:17:22.837693 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:17:22.837693 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:17:22.837693 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:17:22.837693 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:17:22.837693 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:17:22.837693 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 04:17:22.837693 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 04:17:22.837693 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 04:17:22.837693 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 04:17:22.839449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 04:17:22.839449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 04:17:22.839449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 04:17:22.839449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 04:17:22.839449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:17:22.839449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:17:22.839449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:17:22.839449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:17:22.839449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:17:22.839449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:17:22.839449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:17:22.839449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:17:22.839449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:17:22.839449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:17:22.839449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:17:22.839449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:17:22.840860 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:17:22.840860 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:17:22.840860 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:17:22.840860 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:17:22.840860 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 04:17:22.840860 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 04:17:22.840860 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 04:17:22.840860 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 04:17:22.840860 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 04:17:22.840860 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 04:17:22.840860 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 04:17:22.840860 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:17:22.840860 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 642/1276] 10.222.0.32 () {56 vars in 1096 bytes} [Wed Jun 1 04:17:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:17:22.846457 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b367f-460f-4241-82db-e776fc1532e4 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:22.937635 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:22.966274 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b367f-460f-4241-82db-e776fc1532e4 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:23.017688 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc2ca3-0dfb-40a0-b3ee-41fc7890cfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:23.018524 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc2ca3-0dfb-40a0-b3ee-41fc7890cfed None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:23.018844 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc2ca3-0dfb-40a0-b3ee-41fc7890cfed None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:23.019339 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc2ca3-0dfb-40a0-b3ee-41fc7890cfed None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:23.020309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc2ca3-0dfb-40a0-b3ee-41fc7890cfed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:17:23.020712 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc2ca3-0dfb-40a0-b3ee-41fc7890cfed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:23.022537 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc2ca3-0dfb-40a0-b3ee-41fc7890cfed None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:23.035368 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 635/1277] 10.222.0.32 () {56 vars in 1099 bytes} [Wed Jun 1 04:17:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:17:23.042657 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e31e0-9d61-48cd-abaa-10514c346e68 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:23.155704 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e31e0-9d61-48cd-abaa-10514c346e68 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:23.192370 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03471e79-41da-4f0e-9dd0-05b37f68a610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:23.193177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03471e79-41da-4f0e-9dd0-05b37f68a610 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:23.193457 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03471e79-41da-4f0e-9dd0-05b37f68a610 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:23.193730 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03471e79-41da-4f0e-9dd0-05b37f68a610 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:23.206322 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03471e79-41da-4f0e-9dd0-05b37f68a610 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:23.207817 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03471e79-41da-4f0e-9dd0-05b37f68a610 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:23.226087 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-03471e79-41da-4f0e-9dd0-05b37f68a610 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:17:23.226087 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:17:23.226087 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:17:23.226087 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:17:23.226087 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:17:23.226087 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:17:23.226087 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:17:23.226087 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:17:23.226087 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:17:23.226087 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:17:23.226087 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:17:23.226087 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:17:23.226087 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:17:23.226087 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:17:23.226087 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:17:23.228131 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:17:23.228131 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:17:23.228131 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:17:23.228131 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:17:23.228131 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:17:23.228131 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:17:23.228131 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:17:23.228131 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:17:23.228131 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:17:23.228131 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:17:23.228131 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:17:23.228131 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:17:23.228131 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:17:23.228131 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:17:23.228131 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:17:23.228131 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:17:23.228131 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:17:23.229274 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:17:23.229274 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:17:23.229274 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:17:23.229274 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:17:23.229274 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 643/1278] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:17:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:17:23.234277 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc2ca3-0dfb-40a0-b3ee-41fc7890cfed None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:23.340190 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc2ca3-0dfb-40a0-b3ee-41fc7890cfed None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:23.374821 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9e68c-d88d-4361-a47a-274a018811ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:23.375551 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9e68c-d88d-4361-a47a-274a018811ae None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:23.375878 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9e68c-d88d-4361-a47a-274a018811ae None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:23.376198 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9e68c-d88d-4361-a47a-274a018811ae None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:23.376982 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b9e68c-d88d-4361-a47a-274a018811ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:17:23.377327 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b9e68c-d88d-4361-a47a-274a018811ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:23.378773 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b9e68c-d88d-4361-a47a-274a018811ae None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:23.392672 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 636/1279] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:17:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:17:23.401523 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03471e79-41da-4f0e-9dd0-05b37f68a610 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:23.435366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:23.513933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03471e79-41da-4f0e-9dd0-05b37f68a610 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:23.548148 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b595f-2ac4-4499-a439-97270ef556df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:23.548958 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b595f-2ac4-4499-a439-97270ef556df None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:23.549239 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b595f-2ac4-4499-a439-97270ef556df None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:23.549514 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b595f-2ac4-4499-a439-97270ef556df None admin] PATH_INFO: `/v3/users/placement` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:23.558358 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b595f-2ac4-4499-a439-97270ef556df None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:23.560443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b595f-2ac4-4499-a439-97270ef556df None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:23.577191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-db4b595f-2ac4-4499-a439-97270ef556df None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 01 04:17:23.577191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:17:23.577191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:17:23.577191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:17:23.577191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:17:23.577191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:17:23.577191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:17:23.577191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:17:23.577191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:17:23.577191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:17:23.577191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:17:23.577191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:17:23.577191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 04:17:23.577191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 04:17:23.577191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 04:17:23.577191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 04:17:23.579066 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:17:23.579066 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:17:23.579066 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 04:17:23.579066 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:17:23.579066 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 04:17:23.579066 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 04:17:23.579066 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:17:23.579066 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:17:23.579066 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:17:23.579066 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:17:23.579066 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:17:23.579066 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:17:23.579066 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:17:23.579066 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:17:23.579066 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:17:23.579066 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:17:23.579066 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:17:23.579066 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:17:23.580916 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:17:23.580916 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:17:23.580916 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 04:17:23.580916 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 04:17:23.580916 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 04:17:23.580916 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 04:17:23.580916 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 04:17:23.580916 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 04:17:23.580916 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 01 04:17:23.580916 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:17:23.580916 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 644/1280] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:17:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:17:23.584700 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9e68c-d88d-4361-a47a-274a018811ae None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:23.590990 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:23.695653 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9e68c-d88d-4361-a47a-274a018811ae None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:23.733387 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13c9c5-b440-4354-a781-3a181fa9b169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:23.734093 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13c9c5-b440-4354-a781-3a181fa9b169 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:23.734375 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13c9c5-b440-4354-a781-3a181fa9b169 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:23.734648 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13c9c5-b440-4354-a781-3a181fa9b169 None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:23.735490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13c9c5-b440-4354-a781-3a181fa9b169 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:17:23.735785 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13c9c5-b440-4354-a781-3a181fa9b169 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:23.737228 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13c9c5-b440-4354-a781-3a181fa9b169 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:23.757068 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 637/1281] 10.222.0.32 () {56 vars in 1143 bytes} [Wed Jun 1 04:17:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:17:23.763687 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b595f-2ac4-4499-a439-97270ef556df None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:23.935486 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:23.955532 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b595f-2ac4-4499-a439-97270ef556df None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:24.018557 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba7160-bcf0-4016-9c11-cfe5b9fde1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:24.019643 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba7160-bcf0-4016-9c11-cfe5b9fde1fc None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:24.020127 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba7160-bcf0-4016-9c11-cfe5b9fde1fc None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:24.020615 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba7160-bcf0-4016-9c11-cfe5b9fde1fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:24.095639 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba7160-bcf0-4016-9c11-cfe5b9fde1fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:24.097095 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba7160-bcf0-4016-9c11-cfe5b9fde1fc None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:24.194426 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:24.205673 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 645/1282] 10.222.0.32 () {58 vars in 1282 bytes} [Wed Jun 1 04:17:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 01 04:17:24.215899 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13c9c5-b440-4354-a781-3a181fa9b169 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:24.306888 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:24.350628 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13c9c5-b440-4354-a781-3a181fa9b169 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:24.399480 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5681401c-0363-4ef3-8037-9786ac76f9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:24.400345 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681401c-0363-4ef3-8037-9786ac76f9b0 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:24.400674 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681401c-0363-4ef3-8037-9786ac76f9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:24.400998 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681401c-0363-4ef3-8037-9786ac76f9b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:24.414386 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5681401c-0363-4ef3-8037-9786ac76f9b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:24.415992 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5681401c-0363-4ef3-8037-9786ac76f9b0 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:24.436438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-5681401c-0363-4ef3-8037-9786ac76f9b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:17:24.436438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:17:24.436438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:17:24.436438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:17:24.436438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:17:24.436438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:17:24.436438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:17:24.436438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:17:24.436438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:17:24.436438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:17:24.436438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:17:24.436438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:17:24.436438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 04:17:24.436438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 04:17:24.436438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 04:17:24.438309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 04:17:24.438309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:17:24.438309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:17:24.438309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:17:24.438309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:17:24.438309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:17:24.438309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:17:24.438309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:17:24.438309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:17:24.438309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:17:24.438309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:17:24.438309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:17:24.438309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:17:24.438309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:17:24.438309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:17:24.438309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:17:24.438309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:17:24.440313 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 04:17:24.440313 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 04:17:24.440313 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 04:17:24.440313 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:17:24.440313 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 638/1283] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:17:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:17:24.445184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba7160-bcf0-4016-9c11-cfe5b9fde1fc None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:24.599872 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba7160-bcf0-4016-9c11-cfe5b9fde1fc None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:24.655779 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b2b20-03e6-457f-8bd0-cab81725791a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:24.656930 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b2b20-03e6-457f-8bd0-cab81725791a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:24.657435 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b2b20-03e6-457f-8bd0-cab81725791a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:24.657923 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b2b20-03e6-457f-8bd0-cab81725791a None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:24.659302 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b2b20-03e6-457f-8bd0-cab81725791a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:17:24.659863 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b2b20-03e6-457f-8bd0-cab81725791a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:24.662513 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b2b20-03e6-457f-8bd0-cab81725791a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:24.683932 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 646/1284] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Jun 1 04:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:17:24.689497 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5681401c-0363-4ef3-8037-9786ac76f9b0 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:24.798384 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5681401c-0363-4ef3-8037-9786ac76f9b0 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:24.814855 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:24.839530 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7bea2c-d630-4add-8f7d-6dbc4715d0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:24.840892 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7bea2c-d630-4add-8f7d-6dbc4715d0a2 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:24.841174 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7bea2c-d630-4add-8f7d-6dbc4715d0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:24.841451 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7bea2c-d630-4add-8f7d-6dbc4715d0a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:24.849490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7bea2c-d630-4add-8f7d-6dbc4715d0a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:24.851064 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7bea2c-d630-4add-8f7d-6dbc4715d0a2 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:24.867059 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-3e7bea2c-d630-4add-8f7d-6dbc4715d0a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:17:24.867059 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:17:24.867059 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:17:24.867059 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:17:24.867059 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:17:24.867059 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:17:24.867059 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:17:24.867059 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:17:24.867059 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:17:24.867059 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:17:24.867059 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:17:24.867059 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:17:24.867059 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 04:17:24.867059 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 04:17:24.867059 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 04:17:24.868827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 04:17:24.868827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:17:24.868827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:17:24.868827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:17:24.868827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:17:24.868827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:17:24.868827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:17:24.868827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:17:24.868827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Jun 01 04:17:24.868827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:17:24.868827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:17:24.868827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:17:24.868827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:17:24.868827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:17:24.868827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:17:24.868827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:17:24.868827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:17:24.870418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 04:17:24.870418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 04:17:24.870418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 04:17:24.870418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 04:17:24.870418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 04:17:24.870418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 04:17:24.870418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 04:17:24.870418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Jun 01 04:17:24.870418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 639/1285] 10.222.0.32 () {56 vars in 1111 bytes} [Wed Jun 1 04:17:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:17:24.877841 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b2b20-03e6-457f-8bd0-cab81725791a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:24.952480 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:25.011016 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b2b20-03e6-457f-8bd0-cab81725791a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:25.049540 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336523e-85f7-441c-ac23-f79577fa8b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:25.050249 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336523e-85f7-441c-ac23-f79577fa8b8b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:25.050537 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336523e-85f7-441c-ac23-f79577fa8b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:25.050814 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336523e-85f7-441c-ac23-f79577fa8b8b None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:25.051616 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336523e-85f7-441c-ac23-f79577fa8b8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:17:25.051927 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336523e-85f7-441c-ac23-f79577fa8b8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:25.053397 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336523e-85f7-441c-ac23-f79577fa8b8b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:25.066612 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 647/1286] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Jun 1 04:17:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:17:25.073149 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7bea2c-d630-4add-8f7d-6dbc4715d0a2 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:25.189850 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7bea2c-d630-4add-8f7d-6dbc4715d0a2 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:25.227970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0c5f8-4c24-4217-9f32-f5f241565af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:25.228624 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0c5f8-4c24-4217-9f32-f5f241565af2 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:25.228908 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0c5f8-4c24-4217-9f32-f5f241565af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:25.229180 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0c5f8-4c24-4217-9f32-f5f241565af2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:25.230030 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0c5f8-4c24-4217-9f32-f5f241565af2 None admin] RBAC: Adding query filter params (role.id=76fc054ad9544460a7be1e2010c23642, scope.project.id=31d68f64d21647688074554062952074, user.id=0433f6219478476286ea27c5c82d41a9) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:17:25.230350 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0c5f8-4c24-4217-9f32-f5f241565af2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:25.231846 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0c5f8-4c24-4217-9f32-f5f241565af2 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:25.238670 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 640/1287] 10.222.0.32 () {56 vars in 1374 bytes} [Wed Jun 1 04:17:25 2022] GET /identity/v3/role_assignments?user.id=0433f6219478476286ea27c5c82d41a9&scope.project.id=31d68f64d21647688074554062952074&role.id=76fc054ad9544460a7be1e2010c23642 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:17:27.583244 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f5f3b-7659-4f55-a506-73f9d8721193 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:27.583809 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f5f3b-7659-4f55-a506-73f9d8721193 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:27.584184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f5f3b-7659-4f55-a506-73f9d8721193 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:27.586648 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 648/1288] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:17:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:17:27.592283 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3564a-edf8-4dff-b0c4-5e51b61a175c None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:27.592785 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3564a-edf8-4dff-b0c4-5e51b61a175c None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:27.592939 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3564a-edf8-4dff-b0c4-5e51b61a175c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:27.610671 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-9ee3564a-edf8-4dff-b0c4-5e51b61a175c None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:17:27.611941 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-9ee3564a-edf8-4dff-b0c4-5e51b61a175c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:17:27.644174 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:27.713110 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 641/1289] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:17:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:17:27.735735 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f5f3b-7659-4f55-a506-73f9d8721193 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:27.845082 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f5f3b-7659-4f55-a506-73f9d8721193 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:27.856904 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:27.881815 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64457b-646f-4875-acb1-a6a2bc031ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:27.882659 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64457b-646f-4875-acb1-a6a2bc031ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:27.882943 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64457b-646f-4875-acb1-a6a2bc031ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:27.883220 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64457b-646f-4875-acb1-a6a2bc031ef8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:27.883878 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64457b-646f-4875-acb1-a6a2bc031ef8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:27.885261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64457b-646f-4875-acb1-a6a2bc031ef8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:27.897494 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-2f64457b-646f-4875-acb1-a6a2bc031ef8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 01 04:17:27.897494 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:17:27.897494 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 04:17:27.897494 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 04:17:27.897494 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 04:17:27.897494 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 04:17:27.897494 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 04:17:27.897494 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:17:27.897494 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 01 04:17:27.897494 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:17:27.897494 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 04:17:27.897494 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:17:27.897494 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:17:27.897494 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:17:27.897494 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:17:27.897494 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:17:27.897494 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:17:27.899507 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:17:27.899507 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:17:27.899507 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:17:27.899507 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:17:27.899507 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:17:27.899507 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:17:27.899507 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 04:17:27.899507 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 04:17:27.899507 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 04:17:27.899507 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 04:17:27.899507 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:17:27.899507 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:17:27.899507 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:17:27.899507 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:17:27.899507 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:17:27.899507 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:17:27.901060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:17:27.901060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:17:27.901060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:17:27.901060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:17:27.901060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:17:27.901060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:17:27.901060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:17:27.901060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:17:27.901060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:17:27.901060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:17:27.901060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 04:17:27.901060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:17:27.901060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 01 04:17:27.901060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:17:27.901060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 649/1290] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Jun 1 04:17:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:17:27.905653 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3564a-edf8-4dff-b0c4-5e51b61a175c None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:28.022869 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3564a-edf8-4dff-b0c4-5e51b61a175c None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:28.062274 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d62ef3-4968-4dd3-9e5a-60e3af6a5123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:28.062961 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d62ef3-4968-4dd3-9e5a-60e3af6a5123 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:28.063247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d62ef3-4968-4dd3-9e5a-60e3af6a5123 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:28.063527 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d62ef3-4968-4dd3-9e5a-60e3af6a5123 None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:28.064249 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d62ef3-4968-4dd3-9e5a-60e3af6a5123 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:17:28.064557 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d62ef3-4968-4dd3-9e5a-60e3af6a5123 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:28.065966 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d62ef3-4968-4dd3-9e5a-60e3af6a5123 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:28.071922 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 642/1291] 10.222.0.32 () {56 vars in 1116 bytes} [Wed Jun 1 04:17:27 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:17:28.081405 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64457b-646f-4875-acb1-a6a2bc031ef8 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:28.217403 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64457b-646f-4875-acb1-a6a2bc031ef8 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:28.256576 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd72a6-b346-4bba-81bc-25e8f7dfc523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:28.257632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd72a6-b346-4bba-81bc-25e8f7dfc523 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:28.258159 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd72a6-b346-4bba-81bc-25e8f7dfc523 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:28.258647 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd72a6-b346-4bba-81bc-25e8f7dfc523 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:28.259928 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fd72a6-b346-4bba-81bc-25e8f7dfc523 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:17:28.260472 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fd72a6-b346-4bba-81bc-25e8f7dfc523 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:28.263552 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fd72a6-b346-4bba-81bc-25e8f7dfc523 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:28.271531 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 650/1292] 10.222.0.32 () {56 vars in 1116 bytes} [Wed Jun 1 04:17:28 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:17:30.558918 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345706c-bea0-42c5-adb3-9ae5dafaa9f5 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:30.559483 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345706c-bea0-42c5-adb3-9ae5dafaa9f5 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:30.559483 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345706c-bea0-42c5-adb3-9ae5dafaa9f5 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:30.560830 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 643/1293] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:17:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:17:30.566241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ac50b-ecff-46ae-9d30-199b22c61671 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:30.566694 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ac50b-ecff-46ae-9d30-199b22c61671 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:30.567046 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ac50b-ecff-46ae-9d30-199b22c61671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:30.584235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-3a4ac50b-ecff-46ae-9d30-199b22c61671 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:17:30.585457 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3a4ac50b-ecff-46ae-9d30-199b22c61671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:17:30.616389 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:30.657323 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 651/1294] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:17:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:17:30.680153 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345706c-bea0-42c5-adb3-9ae5dafaa9f5 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:30.713334 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:30.794405 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345706c-bea0-42c5-adb3-9ae5dafaa9f5 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:30.833996 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606f136-3c96-48ad-9599-4fa5fc29608f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:30.834606 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606f136-3c96-48ad-9599-4fa5fc29608f None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:30.834892 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606f136-3c96-48ad-9599-4fa5fc29608f None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:30.835171 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606f136-3c96-48ad-9599-4fa5fc29608f None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:30.835941 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b606f136-3c96-48ad-9599-4fa5fc29608f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:30.837339 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b606f136-3c96-48ad-9599-4fa5fc29608f None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:30.853688 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 644/1295] 10.222.0.32 () {60 vars in 1141 bytes} [Wed Jun 1 04:17:30 2022] POST /identity/v3/services => generated 246 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:17:33.206702 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5566c-c525-45a4-aa08-da4a24cd5910 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:33.207251 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5566c-c525-45a4-aa08-da4a24cd5910 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:33.207251 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5566c-c525-45a4-aa08-da4a24cd5910 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:33.208647 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 652/1296] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:17:33.214292 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53471c-3755-4926-8193-e120bb978f85 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:33.215607 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53471c-3755-4926-8193-e120bb978f85 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:33.215759 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53471c-3755-4926-8193-e120bb978f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:33.233194 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-dc53471c-3755-4926-8193-e120bb978f85 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:17:33.234429 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-dc53471c-3755-4926-8193-e120bb978f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:17:33.315726 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 645/1297] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:17:33 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 04:17:33.340038 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5566c-c525-45a4-aa08-da4a24cd5910 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:33.446335 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5566c-c525-45a4-aa08-da4a24cd5910 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:33.482960 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48cc89-8874-42da-a829-253849709735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:33.483772 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48cc89-8874-42da-a829-253849709735 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:33.484056 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48cc89-8874-42da-a829-253849709735 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:33.484335 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48cc89-8874-42da-a829-253849709735 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:33.484990 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48cc89-8874-42da-a829-253849709735 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:33.486433 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48cc89-8874-42da-a829-253849709735 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:33.498950 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-1f48cc89-8874-42da-a829-253849709735 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 01 04:17:33.498950 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:17:33.498950 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 04:17:33.498950 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 04:17:33.498950 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 04:17:33.498950 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 04:17:33.498950 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 04:17:33.498950 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:17:33.498950 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 01 04:17:33.498950 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:17:33.498950 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 04:17:33.498950 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:17:33.498950 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:17:33.498950 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:17:33.498950 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:17:33.498950 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:17:33.498950 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:17:33.500897 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:17:33.500897 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:17:33.500897 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:17:33.500897 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:17:33.500897 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:17:33.500897 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:17:33.500897 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 04:17:33.500897 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 04:17:33.500897 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 04:17:33.500897 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 04:17:33.500897 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:17:33.500897 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:17:33.500897 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:17:33.500897 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:17:33.500897 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:17:33.500897 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:17:33.502807 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:17:33.502807 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:17:33.502807 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:17:33.502807 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:17:33.502807 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:17:33.502807 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:17:33.502807 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:17:33.502807 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:17:33.502807 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:17:33.502807 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:17:33.502807 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 04:17:33.502807 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:17:33.502807 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 01 04:17:33.502807 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:17:33.502807 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 653/1298] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Jun 1 04:17:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 04:17:33.508164 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53471c-3755-4926-8193-e120bb978f85 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:33.527994 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:33.621869 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53471c-3755-4926-8193-e120bb978f85 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:33.655818 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6115c-e613-428d-97d9-0dc15f88301c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:33.656548 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6115c-e613-428d-97d9-0dc15f88301c None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:33.656876 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6115c-e613-428d-97d9-0dc15f88301c None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:33.657197 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6115c-e613-428d-97d9-0dc15f88301c None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:33.657941 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c6115c-e613-428d-97d9-0dc15f88301c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:17:33.658333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c6115c-e613-428d-97d9-0dc15f88301c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:33.659744 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c6115c-e613-428d-97d9-0dc15f88301c None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:33.665288 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 646/1299] 10.222.0.32 () {56 vars in 1116 bytes} [Wed Jun 1 04:17:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:17:33.672116 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48cc89-8874-42da-a829-253849709735 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:33.722368 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:33.802918 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48cc89-8874-42da-a829-253849709735 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:33.836725 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51d753-ca67-4332-b1f3-0c72bbfbb584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:33.837391 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51d753-ca67-4332-b1f3-0c72bbfbb584 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:33.837676 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51d753-ca67-4332-b1f3-0c72bbfbb584 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:33.837955 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51d753-ca67-4332-b1f3-0c72bbfbb584 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:33.838776 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51d753-ca67-4332-b1f3-0c72bbfbb584 None admin] RBAC: Adding query filter params (interface=public, service_id=41c308f88ff7401db88b8f1eae370454, region_id=RegionOne) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:17:33.839094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51d753-ca67-4332-b1f3-0c72bbfbb584 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:33.841048 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51d753-ca67-4332-b1f3-0c72bbfbb584 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:33.846588 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 654/1300] 10.222.0.32 () {56 vars in 1251 bytes} [Wed Jun 1 04:17:33 2022] GET /identity/v3/endpoints?service_id=41c308f88ff7401db88b8f1eae370454&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:17:33.852890 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6115c-e613-428d-97d9-0dc15f88301c None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:33.946712 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:33.977223 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6115c-e613-428d-97d9-0dc15f88301c None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:34.034851 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adafe16-66e7-4d83-a1ae-6af9351b417e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:34.035832 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adafe16-66e7-4d83-a1ae-6af9351b417e None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:34.036250 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adafe16-66e7-4d83-a1ae-6af9351b417e None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:34.036667 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adafe16-66e7-4d83-a1ae-6af9351b417e None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:34.037716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adafe16-66e7-4d83-a1ae-6af9351b417e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:34.039916 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adafe16-66e7-4d83-a1ae-6af9351b417e None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:34.052579 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 647/1301] 10.222.0.32 () {56 vars in 1087 bytes} [Wed Jun 1 04:17:33 2022] GET /identity/v3/services => generated 2191 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:17:36.333460 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d314de3-af52-49e2-b5b0-2aa106aaaf07 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:36.334049 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d314de3-af52-49e2-b5b0-2aa106aaaf07 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:36.334049 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d314de3-af52-49e2-b5b0-2aa106aaaf07 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:36.335411 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 655/1302] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:17:36.341719 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f89f29-7730-42b5-821c-8e355c47dce2 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:36.342315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f89f29-7730-42b5-821c-8e355c47dce2 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:36.342315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f89f29-7730-42b5-821c-8e355c47dce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:36.359827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-74f89f29-7730-42b5-821c-8e355c47dce2 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:17:36.361027 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-74f89f29-7730-42b5-821c-8e355c47dce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:17:36.430711 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 648/1303] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:17:36 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 04:17:36.454794 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d314de3-af52-49e2-b5b0-2aa106aaaf07 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:36.553837 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:36.561821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d314de3-af52-49e2-b5b0-2aa106aaaf07 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:36.601009 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faea536-0b89-445b-bb5e-3dcfe88386f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:36.601809 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faea536-0b89-445b-bb5e-3dcfe88386f8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:36.602121 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faea536-0b89-445b-bb5e-3dcfe88386f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:36.602396 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faea536-0b89-445b-bb5e-3dcfe88386f8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:36.603044 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faea536-0b89-445b-bb5e-3dcfe88386f8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:36.604412 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faea536-0b89-445b-bb5e-3dcfe88386f8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:36.616475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-7faea536-0b89-445b-bb5e-3dcfe88386f8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 01 04:17:36.616475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:17:36.616475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 04:17:36.616475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 04:17:36.616475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 04:17:36.616475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 04:17:36.616475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 04:17:36.616475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:17:36.616475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 01 04:17:36.616475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:17:36.616475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 04:17:36.616475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:17:36.616475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 04:17:36.616475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 04:17:36.616475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 04:17:36.616475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 04:17:36.616475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 04:17:36.618372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 04:17:36.618372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 04:17:36.618372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 04:17:36.618372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 04:17:36.618372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 04:17:36.618372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 04:17:36.618372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 04:17:36.618372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 04:17:36.618372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 04:17:36.618372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 04:17:36.618372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 04:17:36.618372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 04:17:36.618372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 04:17:36.618372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 04:17:36.618372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 04:17:36.618372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 04:17:36.619966 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 04:17:36.619966 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jun 01 04:17:36.619966 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 04:17:36.619966 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jun 01 04:17:36.619966 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 04:17:36.619966 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 04:17:36.619966 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 04:17:36.619966 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jun 01 04:17:36.619966 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 04:17:36.619966 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jun 01 04:17:36.619966 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 04:17:36.619966 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 04:17:36.619966 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 01 04:17:36.619966 dv-cinder-667108-37-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jun 01 04:17:36.619966 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 656/1304] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Jun 1 04:17:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 04:17:36.627407 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f89f29-7730-42b5-821c-8e355c47dce2 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:36.709567 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:36.733313 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f89f29-7730-42b5-821c-8e355c47dce2 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:36.772750 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae4639-4328-46a7-94a6-7c25c205b9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:36.773581 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae4639-4328-46a7-94a6-7c25c205b9fd None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:36.773867 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae4639-4328-46a7-94a6-7c25c205b9fd None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:36.774193 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae4639-4328-46a7-94a6-7c25c205b9fd None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:36.775021 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae4639-4328-46a7-94a6-7c25c205b9fd None admin] RBAC: Adding query filter params (name=placement) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:17:36.775362 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae4639-4328-46a7-94a6-7c25c205b9fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:36.777489 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae4639-4328-46a7-94a6-7c25c205b9fd None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:36.783341 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 649/1305] 10.222.0.32 () {56 vars in 1116 bytes} [Wed Jun 1 04:17:36 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:17:36.790308 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faea536-0b89-445b-bb5e-3dcfe88386f8 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:17:36.910811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faea536-0b89-445b-bb5e-3dcfe88386f8 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:17:36.951594 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7aa18-7b40-4b9e-9fe5-ae135afcde17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:17:36.952282 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7aa18-7b40-4b9e-9fe5-ae135afcde17 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:17:36.952568 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7aa18-7b40-4b9e-9fe5-ae135afcde17 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:17:36.952845 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7aa18-7b40-4b9e-9fe5-ae135afcde17 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:17:36.953615 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b7aa18-7b40-4b9e-9fe5-ae135afcde17 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:17:36.955058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b7aa18-7b40-4b9e-9fe5-ae135afcde17 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:17:36.976486 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 657/1306] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Jun 1 04:17:36 2022] POST /identity/v3/endpoints => generated 331 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:17:46.780988 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=30 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:17:46.971838 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:18:42.994787 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50cfeb-9b15-4e97-817d-23bdb5afd98e None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:18:42.995379 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50cfeb-9b15-4e97-817d-23bdb5afd98e None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:18:42.995379 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50cfeb-9b15-4e97-817d-23bdb5afd98e None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:18:43.000671 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 650/1307] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:18:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:18:43.002092 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7aa1e-c41b-4c92-ab13-094e4223397c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:18:43.002548 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7aa1e-c41b-4c92-ab13-094e4223397c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:18:43.002644 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7aa1e-c41b-4c92-ab13-094e4223397c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:18:43.102211 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-39d7aa1e-c41b-4c92-ab13-094e4223397c None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:18:43.104316 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-39d7aa1e-c41b-4c92-ab13-094e4223397c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:18:43.229330 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 658/1308] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:18:43.278358 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ea9a1-b0fd-4977-a2bf-aba8f9a68c17 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:18:43.279020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ea9a1-b0fd-4977-a2bf-aba8f9a68c17 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:18:43.279533 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ea9a1-b0fd-4977-a2bf-aba8f9a68c17 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:18:43.281451 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 651/1309] 10.222.0.32 () {54 vars in 964 bytes} [Wed Jun 1 04:18:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:18:43.287552 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64de7be-63a5-4ce2-b4c0-eadf166a37d7 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:18:43.287953 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64de7be-63a5-4ce2-b4c0-eadf166a37d7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:18:43.288340 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64de7be-63a5-4ce2-b4c0-eadf166a37d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:18:43.376605 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-f64de7be-63a5-4ce2-b4c0-eadf166a37d7 None None] MFA Rules not processed for user `dca5f9455ef349738adf4569fe5ed165`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:18:43.377850 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f64de7be-63a5-4ce2-b4c0-eadf166a37d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:18:43.400433 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:18:43.470780 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 659/1310] 10.222.0.32 () {58 vars in 1061 bytes} [Wed Jun 1 04:18:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:18:43.480813 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ea9a1-b0fd-4977-a2bf-aba8f9a68c17 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:18:43.482587 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-8b9ea9a1-b0fd-4977-a2bf-aba8f9a68c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:18:43.667277 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ea9a1-b0fd-4977-a2bf-aba8f9a68c17 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:18:43.749789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa277f0-c004-4f0e-ab30-5bf54bd294c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:18:43.750510 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa277f0-c004-4f0e-ab30-5bf54bd294c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:18:43.750794 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa277f0-c004-4f0e-ab30-5bf54bd294c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:18:43.751072 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa277f0-c004-4f0e-ab30-5bf54bd294c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:18:43.752970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-bfa277f0-c004-4f0e-ab30-5bf54bd294c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:18:43.814632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:18:43.879202 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa277f0-c004-4f0e-ab30-5bf54bd294c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:18:43.880705 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa277f0-c004-4f0e-ab30-5bf54bd294c7 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:18:43.906340 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 652/1311] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:18:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:18:46.629878 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376637e3-12c6-4854-b7dd-4a839455da88 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:18:46.630499 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376637e3-12c6-4854-b7dd-4a839455da88 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:18:46.630499 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376637e3-12c6-4854-b7dd-4a839455da88 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:18:46.636688 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 660/1312] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:18:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:18:46.638428 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe4a27-b772-44c4-83cc-434bdc1c6b3f None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:18:46.638930 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe4a27-b772-44c4-83cc-434bdc1c6b3f None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:18:46.639027 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe4a27-b772-44c4-83cc-434bdc1c6b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:18:46.769816 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-4afe4a27-b772-44c4-83cc-434bdc1c6b3f None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:18:46.771822 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-4afe4a27-b772-44c4-83cc-434bdc1c6b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:18:46.914492 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 653/1313] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:18:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:18:46.970794 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad599b-f1a1-45ea-af5c-a0e545c1e09a None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:18:46.971002 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad599b-f1a1-45ea-af5c-a0e545c1e09a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:18:46.971227 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad599b-f1a1-45ea-af5c-a0e545c1e09a None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:18:46.972826 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 661/1314] 10.222.0.32 () {54 vars in 964 bytes} [Wed Jun 1 04:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:18:46.980343 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628be861-e7ed-4fd4-b4f4-e53ee4290d6e None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:18:46.980838 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628be861-e7ed-4fd4-b4f4-e53ee4290d6e None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:18:46.981128 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628be861-e7ed-4fd4-b4f4-e53ee4290d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:18:46.994514 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:18:47.218983 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-628be861-e7ed-4fd4-b4f4-e53ee4290d6e None None] MFA Rules not processed for user `dca5f9455ef349738adf4569fe5ed165`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:18:47.220419 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-628be861-e7ed-4fd4-b4f4-e53ee4290d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:18:47.311414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 654/1315] 10.222.0.32 () {58 vars in 1061 bytes} [Wed Jun 1 04:18:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:18:47.321177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad599b-f1a1-45ea-af5c-a0e545c1e09a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:18:47.323778 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-10ad599b-f1a1-45ea-af5c-a0e545c1e09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:18:47.475521 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad599b-f1a1-45ea-af5c-a0e545c1e09a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:18:47.588454 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:18:47.592140 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dccfce-775d-4f15-ab0e-292788ebda40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:18:47.593504 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dccfce-775d-4f15-ab0e-292788ebda40 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:18:47.594405 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dccfce-775d-4f15-ab0e-292788ebda40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:18:47.594954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dccfce-775d-4f15-ab0e-292788ebda40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:18:47.598072 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-42dccfce-775d-4f15-ab0e-292788ebda40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:18:47.753807 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dccfce-775d-4f15-ab0e-292788ebda40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:18:47.755474 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dccfce-775d-4f15-ab0e-292788ebda40 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:18:47.782025 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 662/1316] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:18:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:18:50.687193 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ab412-1c2d-4cfa-8ce8-940500de1c91 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:18:50.687795 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ab412-1c2d-4cfa-8ce8-940500de1c91 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:18:50.687795 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ab412-1c2d-4cfa-8ce8-940500de1c91 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:18:50.689131 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 655/1317] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:18:50.694892 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30eb6f-471a-46d3-a3d4-35cb610eff79 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:18:50.695359 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30eb6f-471a-46d3-a3d4-35cb610eff79 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:18:50.695463 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30eb6f-471a-46d3-a3d4-35cb610eff79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:18:50.761515 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-da30eb6f-471a-46d3-a3d4-35cb610eff79 None None] MFA Rules not processed for user `afb251a9af9a4e5b99e5cdd71c34f147`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:18:50.762775 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-da30eb6f-471a-46d3-a3d4-35cb610eff79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:18:50.816113 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:18:50.864225 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 663/1318] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:18:50 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:18:50.904333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ab412-1c2d-4cfa-8ce8-940500de1c91 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:18:50.905891 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-491ab412-1c2d-4cfa-8ce8-940500de1c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:18:51.029188 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ab412-1c2d-4cfa-8ce8-940500de1c91 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:18:51.032359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:18:51.109412 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ed442-299e-4ecc-a7f0-5c9ff2ebc4e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:18:51.110096 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ed442-299e-4ecc-a7f0-5c9ff2ebc4e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:18:51.110392 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ed442-299e-4ecc-a7f0-5c9ff2ebc4e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:18:51.110673 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ed442-299e-4ecc-a7f0-5c9ff2ebc4e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:18:51.112379 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-9c2ed442-299e-4ecc-a7f0-5c9ff2ebc4e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:18:51.231880 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ed442-299e-4ecc-a7f0-5c9ff2ebc4e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:18:51.233337 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ed442-299e-4ecc-a7f0-5c9ff2ebc4e8 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:18:51.253735 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 656/1319] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:18:50 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:18:54.340211 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94379364-3973-49d3-90c8-f222e43cb8b1 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:18:54.340873 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94379364-3973-49d3-90c8-f222e43cb8b1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:18:54.340873 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94379364-3973-49d3-90c8-f222e43cb8b1 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:18:54.342155 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 664/1320] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:18:54.347462 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcd313-ee20-4b46-8e9e-e605d8e5df46 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:18:54.347909 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcd313-ee20-4b46-8e9e-e605d8e5df46 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:18:54.348016 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcd313-ee20-4b46-8e9e-e605d8e5df46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:18:54.388383 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:18:54.414267 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-63dcd313-ee20-4b46-8e9e-e605d8e5df46 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:18:54.415395 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-63dcd313-ee20-4b46-8e9e-e605d8e5df46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:18:54.510201 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 657/1321] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:18:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:18:54.548754 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94379364-3973-49d3-90c8-f222e43cb8b1 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:18:54.550324 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-94379364-3973-49d3-90c8-f222e43cb8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:18:54.655562 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94379364-3973-49d3-90c8-f222e43cb8b1 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:18:54.732046 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dafd32-9938-494c-a9c8-f9c9bc929e6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:18:54.732680 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dafd32-9938-494c-a9c8-f9c9bc929e6d service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:18:54.732903 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dafd32-9938-494c-a9c8-f9c9bc929e6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:18:54.733183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dafd32-9938-494c-a9c8-f9c9bc929e6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:18:54.734931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-45dafd32-9938-494c-a9c8-f9c9bc929e6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:18:54.742239 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:18:54.845240 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dafd32-9938-494c-a9c8-f9c9bc929e6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:18:54.846740 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dafd32-9938-494c-a9c8-f9c9bc929e6d service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:18:54.866563 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 665/1322] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:18:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:18:57.887613 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8fd97-49f9-4d09-a7ec-ce7505431706 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:18:57.888203 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8fd97-49f9-4d09-a7ec-ce7505431706 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:18:57.888203 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8fd97-49f9-4d09-a7ec-ce7505431706 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:18:57.889695 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 658/1323] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:18:57.895022 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130a3f2-c172-4dd6-8253-648a62d9c4d8 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:18:57.895447 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130a3f2-c172-4dd6-8253-648a62d9c4d8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:18:57.895584 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130a3f2-c172-4dd6-8253-648a62d9c4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:18:57.962821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7130a3f2-c172-4dd6-8253-648a62d9c4d8 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:18:57.964054 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7130a3f2-c172-4dd6-8253-648a62d9c4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:18:58.021058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:18:58.061625 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 666/1324] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:18:58.098248 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8fd97-49f9-4d09-a7ec-ce7505431706 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:18:58.099777 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-fda8fd97-49f9-4d09-a7ec-ce7505431706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:18:58.205848 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8fd97-49f9-4d09-a7ec-ce7505431706 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:18:58.218742 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:18:58.283263 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e0108-afc1-4260-97ce-f470777808b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:18:58.283928 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e0108-afc1-4260-97ce-f470777808b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:18:58.284215 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e0108-afc1-4260-97ce-f470777808b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:18:58.284492 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e0108-afc1-4260-97ce-f470777808b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:18:58.286400 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-2d7e0108-afc1-4260-97ce-f470777808b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:18:58.404645 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e0108-afc1-4260-97ce-f470777808b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:18:58.406407 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e0108-afc1-4260-97ce-f470777808b3 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:18:58.424480 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 659/1325] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:18:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:19:00.740858 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e310af-92a9-4e94-ae3e-75a699f54807 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:00.741409 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e310af-92a9-4e94-ae3e-75a699f54807 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:00.741409 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e310af-92a9-4e94-ae3e-75a699f54807 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:00.742965 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 667/1326] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:19:00.748327 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0cada-baf9-4395-b09e-74b46eab335d None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:00.748762 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0cada-baf9-4395-b09e-74b46eab335d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:00.749035 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0cada-baf9-4395-b09e-74b46eab335d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:00.800136 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:19:00.819803 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-ede0cada-baf9-4395-b09e-74b46eab335d None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:19:00.821058 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-ede0cada-baf9-4395-b09e-74b46eab335d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:19:00.922471 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 660/1327] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:19:00.959463 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e310af-92a9-4e94-ae3e-75a699f54807 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:19:00.961087 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d3e310af-92a9-4e94-ae3e-75a699f54807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:19:01.199326 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e310af-92a9-4e94-ae3e-75a699f54807 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:19:01.275825 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee59c6d-ecc2-42b7-a2f3-3336239ebc9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:19:01.276482 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee59c6d-ecc2-42b7-a2f3-3336239ebc9d service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:01.276766 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee59c6d-ecc2-42b7-a2f3-3336239ebc9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:01.277041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee59c6d-ecc2-42b7-a2f3-3336239ebc9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:01.278742 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0ee59c6d-ecc2-42b7-a2f3-3336239ebc9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:19:01.296690 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:19:01.391297 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee59c6d-ecc2-42b7-a2f3-3336239ebc9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:19:01.392730 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee59c6d-ecc2-42b7-a2f3-3336239ebc9d service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:19:01.411389 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 668/1328] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:19:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:19:03.750085 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259206d-f6dc-44b3-8834-6929944e62ed None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:03.750696 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259206d-f6dc-44b3-8834-6929944e62ed None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:03.750696 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259206d-f6dc-44b3-8834-6929944e62ed None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:03.752092 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 661/1329] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:19:03.758092 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b9892-35d0-4f5d-93b8-35c9ca7368aa None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:03.758655 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b9892-35d0-4f5d-93b8-35c9ca7368aa None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:03.758655 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b9892-35d0-4f5d-93b8-35c9ca7368aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:03.832806 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-643b9892-35d0-4f5d-93b8-35c9ca7368aa None None] MFA Rules not processed for user `afb251a9af9a4e5b99e5cdd71c34f147`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:19:03.834071 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-643b9892-35d0-4f5d-93b8-35c9ca7368aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:19:03.905991 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:19:03.941126 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 669/1330] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:19:03 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:19:03.982994 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259206d-f6dc-44b3-8834-6929944e62ed None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:19:03.984530 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6259206d-f6dc-44b3-8834-6929944e62ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:19:04.091147 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259206d-f6dc-44b3-8834-6929944e62ed None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:19:04.111284 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:19:04.171443 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389ed89-2b34-4056-83f5-bce0762da4e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:19:04.172098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389ed89-2b34-4056-83f5-bce0762da4e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:04.172385 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389ed89-2b34-4056-83f5-bce0762da4e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:04.172664 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389ed89-2b34-4056-83f5-bce0762da4e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:04.174372 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-1389ed89-2b34-4056-83f5-bce0762da4e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:19:04.284475 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389ed89-2b34-4056-83f5-bce0762da4e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:19:04.285920 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389ed89-2b34-4056-83f5-bce0762da4e4 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:19:04.304017 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 662/1331] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:19:03 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:19:06.814676 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aaa3b1-997d-46ed-a31c-4d383211377f None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:06.815172 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aaa3b1-997d-46ed-a31c-4d383211377f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:06.815172 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aaa3b1-997d-46ed-a31c-4d383211377f None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:06.816516 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 670/1332] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:19:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:19:06.822813 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c860561-dcaa-414a-97f3-6d275b1ba6d0 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:06.823442 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c860561-dcaa-414a-97f3-6d275b1ba6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:06.823442 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c860561-dcaa-414a-97f3-6d275b1ba6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:06.887054 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:19:06.894198 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-7c860561-dcaa-414a-97f3-6d275b1ba6d0 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:19:06.895431 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7c860561-dcaa-414a-97f3-6d275b1ba6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:19:07.005426 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 663/1333] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:19:07.041322 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aaa3b1-997d-46ed-a31c-4d383211377f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:19:07.042877 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c6aaa3b1-997d-46ed-a31c-4d383211377f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:19:07.144407 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aaa3b1-997d-46ed-a31c-4d383211377f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:19:07.220882 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82385fce-ca08-4237-b1c6-971e0d6b0e79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:19:07.221548 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82385fce-ca08-4237-b1c6-971e0d6b0e79 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:07.221826 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82385fce-ca08-4237-b1c6-971e0d6b0e79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:07.222454 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82385fce-ca08-4237-b1c6-971e0d6b0e79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:07.223905 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-82385fce-ca08-4237-b1c6-971e0d6b0e79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:19:07.253874 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:19:07.353767 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82385fce-ca08-4237-b1c6-971e0d6b0e79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:19:07.355301 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82385fce-ca08-4237-b1c6-971e0d6b0e79 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:19:07.376183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 671/1334] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:19:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:19:09.706072 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66066982-eab5-4b27-b4fc-ec77a6bd0302 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:09.706598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66066982-eab5-4b27-b4fc-ec77a6bd0302 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:09.706692 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66066982-eab5-4b27-b4fc-ec77a6bd0302 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:09.708010 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 664/1335] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:19:09.713929 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecd7d9-3240-4552-87b5-730e969b5f69 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:09.714409 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecd7d9-3240-4552-87b5-730e969b5f69 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:09.714655 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecd7d9-3240-4552-87b5-730e969b5f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:09.779110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c1ecd7d9-3240-4552-87b5-730e969b5f69 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:19:09.780328 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c1ecd7d9-3240-4552-87b5-730e969b5f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:19:09.853142 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:19:09.875302 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 672/1336] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:19:09.916684 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66066982-eab5-4b27-b4fc-ec77a6bd0302 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:19:09.918337 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-66066982-eab5-4b27-b4fc-ec77a6bd0302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:19:10.032841 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66066982-eab5-4b27-b4fc-ec77a6bd0302 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:19:10.061260 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:19:10.106724 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e566761-af98-4033-bc0f-8f914bec3f01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:19:10.107366 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e566761-af98-4033-bc0f-8f914bec3f01 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:10.107648 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e566761-af98-4033-bc0f-8f914bec3f01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:10.107927 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e566761-af98-4033-bc0f-8f914bec3f01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:10.109571 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-8e566761-af98-4033-bc0f-8f914bec3f01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:19:10.218437 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e566761-af98-4033-bc0f-8f914bec3f01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:19:10.219875 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e566761-af98-4033-bc0f-8f914bec3f01 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:19:10.237595 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 665/1337] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:19:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:19:12.824944 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98703d-bdee-44f0-85cc-c3330acb01d3 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:12.825491 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98703d-bdee-44f0-85cc-c3330acb01d3 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:12.825491 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98703d-bdee-44f0-85cc-c3330acb01d3 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:12.826882 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 673/1338] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:19:12.832189 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d9547-8e0f-425c-9c13-6c88c05c76e7 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:12.832619 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d9547-8e0f-425c-9c13-6c88c05c76e7 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:12.832758 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d9547-8e0f-425c-9c13-6c88c05c76e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:12.898038 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-e95d9547-8e0f-425c-9c13-6c88c05c76e7 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:19:12.899266 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e95d9547-8e0f-425c-9c13-6c88c05c76e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:19:12.907686 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:19:13.001950 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 666/1339] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:19:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:19:13.037915 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98703d-bdee-44f0-85cc-c3330acb01d3 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:19:13.041469 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8d98703d-bdee-44f0-85cc-c3330acb01d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:19:13.146873 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98703d-bdee-44f0-85cc-c3330acb01d3 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:19:13.160976 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71432e11-d52c-47a2-ae4b-d3c48cae53d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:19:13.161626 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71432e11-d52c-47a2-ae4b-d3c48cae53d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:13.161907 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71432e11-d52c-47a2-ae4b-d3c48cae53d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:13.162210 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71432e11-d52c-47a2-ae4b-d3c48cae53d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:13.163825 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-71432e11-d52c-47a2-ae4b-d3c48cae53d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:19:13.266177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:19:13.268530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71432e11-d52c-47a2-ae4b-d3c48cae53d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:19:13.270574 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71432e11-d52c-47a2-ae4b-d3c48cae53d2 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:19:13.291436 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 674/1340] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:19:13 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:19:17.723047 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a50783-71b3-4b42-b47f-a95e609b37b5 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:17.723618 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a50783-71b3-4b42-b47f-a95e609b37b5 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:17.723618 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a50783-71b3-4b42-b47f-a95e609b37b5 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:17.724875 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 667/1341] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:19:17.730624 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e435a7-3aa1-40ec-a06f-171fef61f781 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:17.731073 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e435a7-3aa1-40ec-a06f-171fef61f781 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:17.731184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e435a7-3aa1-40ec-a06f-171fef61f781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:17.776671 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b8e435a7-3aa1-40ec-a06f-171fef61f781 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:19:17.777868 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b8e435a7-3aa1-40ec-a06f-171fef61f781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:19:17.861612 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 675/1342] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:19:17.900462 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a50783-71b3-4b42-b47f-a95e609b37b5 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:19:17.902709 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-92a50783-71b3-4b42-b47f-a95e609b37b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:19:17.926028 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a50783-71b3-4b42-b47f-a95e609b37b5 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:19:17.929601 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487b022-abda-4775-aba9-2a2bd5bb24bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:19:17.930339 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487b022-abda-4775-aba9-2a2bd5bb24bb service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:17.930692 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487b022-abda-4775-aba9-2a2bd5bb24bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:17.930966 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487b022-abda-4775-aba9-2a2bd5bb24bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:17.940445 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2487b022-abda-4775-aba9-2a2bd5bb24bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:19:17.942059 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2487b022-abda-4775-aba9-2a2bd5bb24bb service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:19:17.954171 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 668/1343] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:19:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:19:20.840111 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254336d-848c-4f19-845a-0629469a076f None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:20.840646 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254336d-848c-4f19-845a-0629469a076f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:20.840646 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254336d-848c-4f19-845a-0629469a076f None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:20.842045 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 676/1344] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:19:20.847574 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30ec9b-7b73-4bac-958d-91095c0b2dde None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:20.848141 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30ec9b-7b73-4bac-958d-91095c0b2dde None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:20.848141 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30ec9b-7b73-4bac-958d-91095c0b2dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:20.877491 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-2c30ec9b-7b73-4bac-958d-91095c0b2dde None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:19:20.878740 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-2c30ec9b-7b73-4bac-958d-91095c0b2dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:19:20.887254 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 669/1345] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:19:20 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:19:20.924655 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0254336d-848c-4f19-845a-0629469a076f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:19:20.935584 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0254336d-848c-4f19-845a-0629469a076f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:19:20.939192 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ef2d5-4572-49cc-81e8-af651e924f67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:19:20.939838 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ef2d5-4572-49cc-81e8-af651e924f67 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:20.940142 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ef2d5-4572-49cc-81e8-af651e924f67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:20.940418 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ef2d5-4572-49cc-81e8-af651e924f67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:20.951445 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ef2d5-4572-49cc-81e8-af651e924f67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:19:20.952926 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ef2d5-4572-49cc-81e8-af651e924f67 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:19:20.963543 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 677/1346] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:19:20 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:19:25.310318 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d0334-af27-4403-8790-6f8035ba45ba None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:25.310794 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d0334-af27-4403-8790-6f8035ba45ba None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:25.310901 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d0334-af27-4403-8790-6f8035ba45ba None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:25.312235 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 670/1347] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:19:25.317809 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae60e6a-2f2a-474d-88ab-adefd1d172a4 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:25.318574 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae60e6a-2f2a-474d-88ab-adefd1d172a4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:25.318695 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae60e6a-2f2a-474d-88ab-adefd1d172a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:25.336238 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2ae60e6a-2f2a-474d-88ab-adefd1d172a4 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:19:25.337962 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2ae60e6a-2f2a-474d-88ab-adefd1d172a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:19:25.345718 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 678/1348] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:19:25.383180 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d0334-af27-4403-8790-6f8035ba45ba None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:19:25.395191 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d0334-af27-4403-8790-6f8035ba45ba None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:19:25.399116 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b6f52-cabc-4ca0-a4cb-355487fe5b47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:19:25.400364 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b6f52-cabc-4ca0-a4cb-355487fe5b47 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:25.400650 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b6f52-cabc-4ca0-a4cb-355487fe5b47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:25.400924 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b6f52-cabc-4ca0-a4cb-355487fe5b47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:25.411038 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b6f52-cabc-4ca0-a4cb-355487fe5b47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:19:25.412494 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b6f52-cabc-4ca0-a4cb-355487fe5b47 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:19:25.422595 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 671/1349] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:19:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:19:30.858556 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e1162-c74c-4053-b61f-739532369392 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:30.859074 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e1162-c74c-4053-b61f-739532369392 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:30.859256 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e1162-c74c-4053-b61f-739532369392 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:30.866078 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 679/1350] 10.222.0.32 () {54 vars in 921 bytes} [Wed Jun 1 04:19:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:19:30.874386 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee55666-b7ac-4fdd-a060-bdbeda885f3a None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:30.874911 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee55666-b7ac-4fdd-a060-bdbeda885f3a None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:30.875038 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee55666-b7ac-4fdd-a060-bdbeda885f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:30.971395 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-aee55666-b7ac-4fdd-a060-bdbeda885f3a None None] MFA Rules not processed for user `0433f6219478476286ea27c5c82d41a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:19:30.972786 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-aee55666-b7ac-4fdd-a060-bdbeda885f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:19:31.029396 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:19:31.131903 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 672/1351] 10.222.0.32 () {58 vars in 1018 bytes} [Wed Jun 1 04:19:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:19:35.330946 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=60 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:19:35.695175 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2084b18-1616-4880-b789-f3a2d0c30bc2 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:35.695423 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2084b18-1616-4880-b789-f3a2d0c30bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:35.695880 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2084b18-1616-4880-b789-f3a2d0c30bc2 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:35.697810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 680/1352] 10.222.0.32 () {54 vars in 921 bytes} [Wed Jun 1 04:19:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:19:35.703096 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ded69-5826-4606-a0aa-527cbe3fc60f None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:35.703614 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ded69-5826-4606-a0aa-527cbe3fc60f None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:35.703693 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ded69-5826-4606-a0aa-527cbe3fc60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:35.723663 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-d50ded69-5826-4606-a0aa-527cbe3fc60f None None] MFA Rules not processed for user `0433f6219478476286ea27c5c82d41a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:19:35.725053 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d50ded69-5826-4606-a0aa-527cbe3fc60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:19:35.734008 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 673/1353] 10.222.0.32 () {58 vars in 1018 bytes} [Wed Jun 1 04:19:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:19:37.130602 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9ec2c-eb01-46f6-a121-4972ca2c2dc8 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:37.131203 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9ec2c-eb01-46f6-a121-4972ca2c2dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:37.131203 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9ec2c-eb01-46f6-a121-4972ca2c2dc8 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:37.132525 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 681/1354] 10.222.0.32 () {54 vars in 921 bytes} [Wed Jun 1 04:19:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:19:37.138132 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0ca27-4b55-4e43-9825-9e9a387d0547 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:37.138545 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0ca27-4b55-4e43-9825-9e9a387d0547 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:37.138805 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0ca27-4b55-4e43-9825-9e9a387d0547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:37.158183 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-fda0ca27-4b55-4e43-9825-9e9a387d0547 None None] MFA Rules not processed for user `0433f6219478476286ea27c5c82d41a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:19:37.159137 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-fda0ca27-4b55-4e43-9825-9e9a387d0547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:19:37.167882 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 674/1355] 10.222.0.32 () {58 vars in 1018 bytes} [Wed Jun 1 04:19:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:19:42.333862 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74a3ba-735f-42e6-bf00-0c76aeceb3ea None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:42.334592 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74a3ba-735f-42e6-bf00-0c76aeceb3ea None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:42.334592 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74a3ba-735f-42e6-bf00-0c76aeceb3ea None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:42.335906 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 682/1356] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:19:42.343491 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c919bd-12d3-4532-aa40-b49c9d463307 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:42.344202 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c919bd-12d3-4532-aa40-b49c9d463307 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:42.344601 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c919bd-12d3-4532-aa40-b49c9d463307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:42.365338 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-a3c919bd-12d3-4532-aa40-b49c9d463307 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:19:42.366591 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a3c919bd-12d3-4532-aa40-b49c9d463307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:19:42.374916 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 675/1357] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:19:42.432318 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d24702-644e-4428-a133-e56374ce4a43 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:42.432975 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d24702-644e-4428-a133-e56374ce4a43 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:42.433415 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d24702-644e-4428-a133-e56374ce4a43 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:42.435354 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 683/1358] 10.222.0.32 () {54 vars in 961 bytes} [Wed Jun 1 04:19:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:19:42.451778 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ec9d3-8b24-4fc6-add2-cfaace8fef46 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:42.452535 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ec9d3-8b24-4fc6-add2-cfaace8fef46 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:42.453047 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ec9d3-8b24-4fc6-add2-cfaace8fef46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:42.559597 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-ca9ec9d3-8b24-4fc6-add2-cfaace8fef46 None None] MFA Rules not processed for user `79d614f85f5541d3babbb41468cbf55c`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:19:42.562099 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-ca9ec9d3-8b24-4fc6-add2-cfaace8fef46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:19:42.711227 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 676/1359] 10.222.0.32 () {58 vars in 1058 bytes} [Wed Jun 1 04:19:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:19:42.720541 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d24702-644e-4428-a133-e56374ce4a43 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:19:42.745358 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d24702-644e-4428-a133-e56374ce4a43 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:19:42.754175 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60a202-a0ef-468e-a2d6-694ee3969175 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:19:42.755391 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60a202-a0ef-468e-a2d6-694ee3969175 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:42.755944 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60a202-a0ef-468e-a2d6-694ee3969175 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:42.756483 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60a202-a0ef-468e-a2d6-694ee3969175 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:42.771826 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60a202-a0ef-468e-a2d6-694ee3969175 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:19:42.774838 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60a202-a0ef-468e-a2d6-694ee3969175 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:19:42.793155 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 684/1360] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:19:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:19:45.903991 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca1ded-49cc-4fe2-a5dd-a33bb6b9eec1 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:45.903991 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca1ded-49cc-4fe2-a5dd-a33bb6b9eec1 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:45.905151 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca1ded-49cc-4fe2-a5dd-a33bb6b9eec1 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:45.916793 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269b8b3-93c4-4ac7-acc8-f1d0183b76fa None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:45.916793 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269b8b3-93c4-4ac7-acc8-f1d0183b76fa None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:45.917838 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269b8b3-93c4-4ac7-acc8-f1d0183b76fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:45.920166 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 677/1361] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:19:45 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:19:45.952873 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d269b8b3-93c4-4ac7-acc8-f1d0183b76fa None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:19:45.955322 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d269b8b3-93c4-4ac7-acc8-f1d0183b76fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:19:45.981832 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 685/1362] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:19:46.040513 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca1ded-49cc-4fe2-a5dd-a33bb6b9eec1 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:19:46.066540 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca1ded-49cc-4fe2-a5dd-a33bb6b9eec1 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:19:46.073850 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1c1f6-f740-4600-9e10-21d4c8ddc446 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:19:46.074778 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1c1f6-f740-4600-9e10-21d4c8ddc446 service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:46.075212 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1c1f6-f740-4600-9e10-21d4c8ddc446 service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:46.075653 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1c1f6-f740-4600-9e10-21d4c8ddc446 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:46.087258 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1c1f6-f740-4600-9e10-21d4c8ddc446 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:19:46.089100 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1c1f6-f740-4600-9e10-21d4c8ddc446 service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:19:46.104741 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 678/1363] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:19:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:19:49.159029 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9eaeb3-41e8-43cb-a268-0eaaea803218 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:49.160936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9eaeb3-41e8-43cb-a268-0eaaea803218 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:49.161761 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9eaeb3-41e8-43cb-a268-0eaaea803218 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:49.166321 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 686/1364] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:19:49 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:19:49.176112 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551583f-5efc-442f-9452-4f54a367cb49 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:49.176986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551583f-5efc-442f-9452-4f54a367cb49 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:49.177148 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551583f-5efc-442f-9452-4f54a367cb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:49.212863 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-f551583f-5efc-442f-9452-4f54a367cb49 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:19:49.215449 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f551583f-5efc-442f-9452-4f54a367cb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:19:49.234063 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 679/1365] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:19:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:19:49.315854 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ac996-1681-4fec-b87d-91f25924a221 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:49.316159 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ac996-1681-4fec-b87d-91f25924a221 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:49.316403 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ac996-1681-4fec-b87d-91f25924a221 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:49.318208 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 687/1366] 10.222.0.32 () {54 vars in 961 bytes} [Wed Jun 1 04:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:19:49.326406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a687fbf-e27b-4a26-a5c4-528a438bef61 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:49.326859 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a687fbf-e27b-4a26-a5c4-528a438bef61 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:49.327338 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a687fbf-e27b-4a26-a5c4-528a438bef61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:49.358424 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-2a687fbf-e27b-4a26-a5c4-528a438bef61 None None] MFA Rules not processed for user `79d614f85f5541d3babbb41468cbf55c`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:19:49.360407 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-2a687fbf-e27b-4a26-a5c4-528a438bef61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:19:49.376614 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 680/1367] 10.222.0.32 () {58 vars in 1058 bytes} [Wed Jun 1 04:19:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:19:49.386109 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ac996-1681-4fec-b87d-91f25924a221 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:19:49.403884 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ac996-1681-4fec-b87d-91f25924a221 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:19:49.410656 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc82b80-d770-4ae7-b7a3-bd21feae5efd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:19:49.411357 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc82b80-d770-4ae7-b7a3-bd21feae5efd service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:49.411845 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc82b80-d770-4ae7-b7a3-bd21feae5efd service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:49.412132 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc82b80-d770-4ae7-b7a3-bd21feae5efd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:49.423622 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc82b80-d770-4ae7-b7a3-bd21feae5efd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:19:49.425275 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc82b80-d770-4ae7-b7a3-bd21feae5efd service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:19:49.438335 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 688/1368] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:19:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:19:51.384643 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563f6e5-6b6f-43fd-a3ca-15287988c81c None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:51.385483 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563f6e5-6b6f-43fd-a3ca-15287988c81c None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:51.385483 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563f6e5-6b6f-43fd-a3ca-15287988c81c None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:51.388337 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 681/1369] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:19:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:19:51.393412 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db726144-ffba-448c-9408-49f27a2530ae None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:51.394257 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db726144-ffba-448c-9408-49f27a2530ae None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:51.394257 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db726144-ffba-448c-9408-49f27a2530ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:51.415696 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-db726144-ffba-448c-9408-49f27a2530ae None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:19:51.416825 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-db726144-ffba-448c-9408-49f27a2530ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:19:51.429863 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 689/1370] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:19:51.757277 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13966643-e241-44de-b2ea-06a954dfffae None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:51.757277 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13966643-e241-44de-b2ea-06a954dfffae None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:51.757277 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13966643-e241-44de-b2ea-06a954dfffae None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:51.759593 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 682/1371] 10.222.0.32 () {54 vars in 963 bytes} [Wed Jun 1 04:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:19:51.767071 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a28e45-402b-4832-97a8-e5a9367c9fcb None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:51.767071 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a28e45-402b-4832-97a8-e5a9367c9fcb None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:51.767071 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a28e45-402b-4832-97a8-e5a9367c9fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:51.829146 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e5a28e45-402b-4832-97a8-e5a9367c9fcb None None] MFA Rules not processed for user `c1fbe41fbc1e4ac4964e3a5a417b6253`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:19:51.830419 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e5a28e45-402b-4832-97a8-e5a9367c9fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:19:51.907859 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 690/1372] 10.222.0.32 () {58 vars in 1060 bytes} [Wed Jun 1 04:19:51 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:19:51.917359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13966643-e241-44de-b2ea-06a954dfffae None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:19:51.938920 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13966643-e241-44de-b2ea-06a954dfffae None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:19:51.946680 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a1061-a6e2-4cae-9fad-8b077963b270 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:19:51.948183 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a1061-a6e2-4cae-9fad-8b077963b270 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:51.948704 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a1061-a6e2-4cae-9fad-8b077963b270 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:51.949580 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a1061-a6e2-4cae-9fad-8b077963b270 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:51.954215 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854fe6d-987c-4e2e-9f83-0ac7a497199c None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:51.954512 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854fe6d-987c-4e2e-9f83-0ac7a497199c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:51.954777 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854fe6d-987c-4e2e-9f83-0ac7a497199c None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:51.956646 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 691/1373] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:19:51.966810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a04c7-f10d-4bdd-8a35-38da143814d0 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:51.967138 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a1061-a6e2-4cae-9fad-8b077963b270 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:19:51.967356 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a04c7-f10d-4bdd-8a35-38da143814d0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:51.967805 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a04c7-f10d-4bdd-8a35-38da143814d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:51.968656 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a1061-a6e2-4cae-9fad-8b077963b270 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:19:51.981230 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 683/1374] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:19:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:19:52.000319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-ff1a04c7-f10d-4bdd-8a35-38da143814d0 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:19:52.002423 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ff1a04c7-f10d-4bdd-8a35-38da143814d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:19:52.021584 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 692/1375] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:19:52.100414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a1061-a6e2-4cae-9fad-8b077963b270 service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:19:52.123074 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a1061-a6e2-4cae-9fad-8b077963b270 service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:19:52.133679 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105138b-4044-4b25-bd57-ff5e87c16811 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:19:52.135022 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105138b-4044-4b25-bd57-ff5e87c16811 service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:52.135543 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105138b-4044-4b25-bd57-ff5e87c16811 service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:52.136045 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105138b-4044-4b25-bd57-ff5e87c16811 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:52.164051 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105138b-4044-4b25-bd57-ff5e87c16811 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:19:52.167951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105138b-4044-4b25-bd57-ff5e87c16811 service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:19:52.182264 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 684/1376] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:19:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:19:54.787000 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba59597-d700-4798-a553-b4305e63a505 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:54.788000 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba59597-d700-4798-a553-b4305e63a505 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:54.788411 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba59597-d700-4798-a553-b4305e63a505 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:54.790245 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 693/1377] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:19:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:19:54.797101 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc689fe5-cbd2-4f2b-8330-bf42cceaaffb None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:54.797855 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc689fe5-cbd2-4f2b-8330-bf42cceaaffb None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:54.798603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc689fe5-cbd2-4f2b-8330-bf42cceaaffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:54.826426 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-cc689fe5-cbd2-4f2b-8330-bf42cceaaffb None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:19:54.828541 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-cc689fe5-cbd2-4f2b-8330-bf42cceaaffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:19:54.840609 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 685/1378] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:19:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:19:54.894259 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba59597-d700-4798-a553-b4305e63a505 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:19:54.917699 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba59597-d700-4798-a553-b4305e63a505 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:19:54.924665 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0aa6e-3ef6-4a12-b3c8-704e4948a76e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:19:54.924974 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0aa6e-3ef6-4a12-b3c8-704e4948a76e service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:54.925686 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0aa6e-3ef6-4a12-b3c8-704e4948a76e service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:54.925686 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0aa6e-3ef6-4a12-b3c8-704e4948a76e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:54.935181 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0aa6e-3ef6-4a12-b3c8-704e4948a76e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:19:54.936771 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0aa6e-3ef6-4a12-b3c8-704e4948a76e service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:19:54.948751 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 694/1379] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:19:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:19:57.423229 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01238ff-1efb-4eeb-b946-e2d6556cdc81 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:57.423805 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01238ff-1efb-4eeb-b946-e2d6556cdc81 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:57.423805 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01238ff-1efb-4eeb-b946-e2d6556cdc81 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:57.425077 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 686/1380] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:19:57.430991 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b77277-3de5-4718-9f3a-5b3b4f30e252 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:57.431538 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b77277-3de5-4718-9f3a-5b3b4f30e252 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:57.431538 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b77277-3de5-4718-9f3a-5b3b4f30e252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:57.451251 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a9b77277-3de5-4718-9f3a-5b3b4f30e252 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:19:57.452459 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a9b77277-3de5-4718-9f3a-5b3b4f30e252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:19:57.461635 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 695/1381] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:19:57.507806 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01238ff-1efb-4eeb-b946-e2d6556cdc81 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:19:57.516843 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:19:57.526721 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01238ff-1efb-4eeb-b946-e2d6556cdc81 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:19:57.532876 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6bf92-3d90-4294-9e47-9d92d5715c2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:19:57.533918 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6bf92-3d90-4294-9e47-9d92d5715c2f service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:19:57.534336 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6bf92-3d90-4294-9e47-9d92d5715c2f service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:19:57.534737 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6bf92-3d90-4294-9e47-9d92d5715c2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:19:57.546552 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6bf92-3d90-4294-9e47-9d92d5715c2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:19:57.549230 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6bf92-3d90-4294-9e47-9d92d5715c2f service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:19:57.578021 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 687/1382] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:19:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:20:00.167095 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab94bc-de2e-409c-8552-4e06932aed01 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:00.167672 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab94bc-de2e-409c-8552-4e06932aed01 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:00.167672 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab94bc-de2e-409c-8552-4e06932aed01 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:00.169428 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 696/1383] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:20:00.178300 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9072f-b19e-40e6-8381-31ad9c7454b5 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:00.178980 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9072f-b19e-40e6-8381-31ad9c7454b5 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:00.179087 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9072f-b19e-40e6-8381-31ad9c7454b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:00.207701 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-def9072f-b19e-40e6-8381-31ad9c7454b5 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:20:00.209887 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-def9072f-b19e-40e6-8381-31ad9c7454b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:20:00.222494 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 688/1384] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:20:00.274804 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab94bc-de2e-409c-8552-4e06932aed01 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:20:00.294445 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab94bc-de2e-409c-8552-4e06932aed01 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:20:00.302242 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308ce6d-676d-4653-a567-d3e9756c9038 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:20:00.303268 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308ce6d-676d-4653-a567-d3e9756c9038 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:00.303748 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308ce6d-676d-4653-a567-d3e9756c9038 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:00.304267 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308ce6d-676d-4653-a567-d3e9756c9038 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:00.319324 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308ce6d-676d-4653-a567-d3e9756c9038 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:20:00.321144 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308ce6d-676d-4653-a567-d3e9756c9038 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:20:00.332642 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 697/1385] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:20:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:20:03.099892 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb3cf5-497b-4ead-ae01-1a4d15132ae8 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:03.100478 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb3cf5-497b-4ead-ae01-1a4d15132ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:03.100587 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb3cf5-497b-4ead-ae01-1a4d15132ae8 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:03.102815 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 689/1386] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:20:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:20:03.108871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36070d68-f791-4336-9766-6b23fd67d8a0 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:03.109910 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36070d68-f791-4336-9766-6b23fd67d8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:03.109910 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36070d68-f791-4336-9766-6b23fd67d8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:03.132286 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-36070d68-f791-4336-9766-6b23fd67d8a0 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:20:03.133459 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-36070d68-f791-4336-9766-6b23fd67d8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:20:03.142403 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 698/1387] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:20:03.198017 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb3cf5-497b-4ead-ae01-1a4d15132ae8 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:20:03.223509 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb3cf5-497b-4ead-ae01-1a4d15132ae8 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:20:03.237521 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0e846-e891-4a45-b35b-5693e544ea41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:20:03.238649 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0e846-e891-4a45-b35b-5693e544ea41 service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:03.239541 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0e846-e891-4a45-b35b-5693e544ea41 service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:03.240008 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0e846-e891-4a45-b35b-5693e544ea41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:03.256302 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0e846-e891-4a45-b35b-5693e544ea41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:20:03.258642 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0e846-e891-4a45-b35b-5693e544ea41 service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:20:03.280284 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 690/1388] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:20:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:20:05.818673 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f7400-ef5b-4b28-804b-1435386f2fdf None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:05.819557 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f7400-ef5b-4b28-804b-1435386f2fdf None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:05.819698 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f7400-ef5b-4b28-804b-1435386f2fdf None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:05.822128 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 699/1389] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:20:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:20:05.828490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c701f5-b961-4d6d-a67c-f94edb1bb7e9 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:05.829137 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c701f5-b961-4d6d-a67c-f94edb1bb7e9 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:05.829137 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c701f5-b961-4d6d-a67c-f94edb1bb7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:05.856070 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-d5c701f5-b961-4d6d-a67c-f94edb1bb7e9 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:20:05.858307 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d5c701f5-b961-4d6d-a67c-f94edb1bb7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:20:05.871692 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 691/1390] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:20:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:20:05.922100 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f7400-ef5b-4b28-804b-1435386f2fdf None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:20:05.933602 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=78 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:20:05.943158 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f7400-ef5b-4b28-804b-1435386f2fdf None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:20:05.950883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f81709-6dea-4e5b-9132-bb17c5752c69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:20:05.951750 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f81709-6dea-4e5b-9132-bb17c5752c69 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:05.952109 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f81709-6dea-4e5b-9132-bb17c5752c69 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:05.952462 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f81709-6dea-4e5b-9132-bb17c5752c69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:05.965014 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f81709-6dea-4e5b-9132-bb17c5752c69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:20:05.967047 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f81709-6dea-4e5b-9132-bb17c5752c69 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:20:05.980344 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 700/1391] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:20:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:20:08.528757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900f50b-41af-430f-81c8-72ae3a5bff67 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:08.529420 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900f50b-41af-430f-81c8-72ae3a5bff67 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:08.529420 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900f50b-41af-430f-81c8-72ae3a5bff67 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:08.530955 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 692/1392] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:20:08.536775 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971408eb-ecd3-4fe4-89ce-8ebb19853c4e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:08.537599 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971408eb-ecd3-4fe4-89ce-8ebb19853c4e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:08.537599 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971408eb-ecd3-4fe4-89ce-8ebb19853c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:08.563535 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-971408eb-ecd3-4fe4-89ce-8ebb19853c4e None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:20:08.565398 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-971408eb-ecd3-4fe4-89ce-8ebb19853c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:20:08.578648 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 701/1393] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:20:08.652985 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900f50b-41af-430f-81c8-72ae3a5bff67 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:20:08.670421 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900f50b-41af-430f-81c8-72ae3a5bff67 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:20:08.676166 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bddb6dd-235a-4281-980f-70ae495e6397 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:20:08.676865 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bddb6dd-235a-4281-980f-70ae495e6397 service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:08.677151 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bddb6dd-235a-4281-980f-70ae495e6397 service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:08.677429 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bddb6dd-235a-4281-980f-70ae495e6397 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:08.688721 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bddb6dd-235a-4281-980f-70ae495e6397 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:20:08.690888 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bddb6dd-235a-4281-980f-70ae495e6397 service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:20:08.704194 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 693/1394] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:20:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:20:08.806945 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c090a1-a8e9-4ee5-b5c1-0152cb7e494f None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:08.807172 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c090a1-a8e9-4ee5-b5c1-0152cb7e494f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:08.807420 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c090a1-a8e9-4ee5-b5c1-0152cb7e494f None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:08.809123 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 702/1395] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:20:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:20:08.816066 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6dbcc-6038-4be5-a709-a3bb2fbc4edc None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:08.816350 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6dbcc-6038-4be5-a709-a3bb2fbc4edc None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:08.816656 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6dbcc-6038-4be5-a709-a3bb2fbc4edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:08.837728 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-67a6dbcc-6038-4be5-a709-a3bb2fbc4edc None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:20:08.839017 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-67a6dbcc-6038-4be5-a709-a3bb2fbc4edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:20:08.847934 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 694/1396] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:20:08.913054 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741f87c-b2ed-41de-9124-b03d9b867e6e None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:08.913359 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741f87c-b2ed-41de-9124-b03d9b867e6e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:08.913592 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741f87c-b2ed-41de-9124-b03d9b867e6e None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:08.915097 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 703/1397] 10.222.0.32 () {54 vars in 962 bytes} [Wed Jun 1 04:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:20:08.921012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807f5d9-6f33-4582-af54-eeab5648936b None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:08.921289 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807f5d9-6f33-4582-af54-eeab5648936b None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:08.921568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807f5d9-6f33-4582-af54-eeab5648936b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:08.994382 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-1807f5d9-6f33-4582-af54-eeab5648936b None None] MFA Rules not processed for user `7ac83171b9284163a71cc729cef076f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:20:08.995854 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-1807f5d9-6f33-4582-af54-eeab5648936b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:20:09.079773 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 695/1398] 10.222.0.32 () {58 vars in 1059 bytes} [Wed Jun 1 04:20:08 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:20:09.087916 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741f87c-b2ed-41de-9124-b03d9b867e6e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:20:09.099493 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741f87c-b2ed-41de-9124-b03d9b867e6e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:20:09.104167 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aafb1d-bfa1-4e97-bf62-ce594e5b45a3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac83171b9284163a71cc729cef076f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:20:09.104884 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aafb1d-bfa1-4e97-bf62-ce594e5b45a3 service glance] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:09.105234 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aafb1d-bfa1-4e97-bf62-ce594e5b45a3 service glance] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:09.105570 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aafb1d-bfa1-4e97-bf62-ce594e5b45a3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:09.115905 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aafb1d-bfa1-4e97-bf62-ce594e5b45a3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:20:09.119133 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aafb1d-bfa1-4e97-bf62-ce594e5b45a3 service glance] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:20:09.129279 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 704/1399] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:20:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:20:09.745046 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57da2d-14fe-4722-95ff-a96f7dc4c811 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:09.745603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57da2d-14fe-4722-95ff-a96f7dc4c811 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:09.745829 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57da2d-14fe-4722-95ff-a96f7dc4c811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:09.809282 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-ae57da2d-14fe-4722-95ff-a96f7dc4c811 None None] MFA Rules not processed for user `3fa2ad34164a4631adf76fbd042679ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:20:09.810657 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-ae57da2d-14fe-4722-95ff-a96f7dc4c811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:20:09.864566 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:20:09.884093 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 696/1400] 10.222.0.32 () {58 vars in 1009 bytes} [Wed Jun 1 04:20:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:20:09.930861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6719b1a-f14d-4c6f-81c9-4516ee9a64f2 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:09.931455 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6719b1a-f14d-4c6f-81c9-4516ee9a64f2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:09.931558 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6719b1a-f14d-4c6f-81c9-4516ee9a64f2 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:09.933184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 705/1401] 10.222.0.32 () {54 vars in 942 bytes} [Wed Jun 1 04:20:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:20:09.940549 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904e03a-5be3-4088-9c7c-4ec14d3c8ebb None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:09.941087 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904e03a-5be3-4088-9c7c-4ec14d3c8ebb None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:09.941422 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904e03a-5be3-4088-9c7c-4ec14d3c8ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:10.001028 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-8904e03a-5be3-4088-9c7c-4ec14d3c8ebb None None] MFA Rules not processed for user `413c6613b4ec4e53aeeaf6828c807273`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:20:10.002358 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-8904e03a-5be3-4088-9c7c-4ec14d3c8ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:20:10.085125 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 697/1402] 10.222.0.32 () {58 vars in 1039 bytes} [Wed Jun 1 04:20:09 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:20:10.095521 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6719b1a-f14d-4c6f-81c9-4516ee9a64f2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:20:10.110082 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6719b1a-f14d-4c6f-81c9-4516ee9a64f2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:20:10.115318 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1ac16-8b56-4929-902b-c5d0d76d2f93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413c6613b4ec4e53aeeaf6828c807273', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:20:10.116071 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1ac16-8b56-4929-902b-c5d0d76d2f93 service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:10.116426 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1ac16-8b56-4929-902b-c5d0d76d2f93 service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:10.116781 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1ac16-8b56-4929-902b-c5d0d76d2f93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:10.125930 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1ac16-8b56-4929-902b-c5d0d76d2f93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:20:10.127685 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1ac16-8b56-4929-902b-c5d0d76d2f93 service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:20:10.136903 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 706/1403] 10.222.0.32 () {60 vars in 1384 bytes} [Wed Jun 1 04:20:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 01 04:20:11.097311 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc27b10-c217-4f44-9ee7-5cecf249cf35 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:11.097887 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc27b10-c217-4f44-9ee7-5cecf249cf35 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:11.097887 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc27b10-c217-4f44-9ee7-5cecf249cf35 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:11.099479 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 698/1404] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:20:11.105928 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209d682-2433-4b1f-9c6a-99db9646c700 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:11.106443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209d682-2433-4b1f-9c6a-99db9646c700 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:11.106526 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209d682-2433-4b1f-9c6a-99db9646c700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:11.126182 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-5209d682-2433-4b1f-9c6a-99db9646c700 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:20:11.127633 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5209d682-2433-4b1f-9c6a-99db9646c700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:20:11.149477 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 707/1405] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:20:11.182736 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc27b10-c217-4f44-9ee7-5cecf249cf35 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:20:11.198675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc27b10-c217-4f44-9ee7-5cecf249cf35 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:20:11.204353 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3022238-8e3f-41b7-a869-ccc03a2525b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:20:11.205004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3022238-8e3f-41b7-a869-ccc03a2525b5 service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:11.205286 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3022238-8e3f-41b7-a869-ccc03a2525b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:11.205560 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3022238-8e3f-41b7-a869-ccc03a2525b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:11.214680 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3022238-8e3f-41b7-a869-ccc03a2525b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:20:11.216293 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3022238-8e3f-41b7-a869-ccc03a2525b5 service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:20:11.228668 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 699/1406] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:20:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:20:13.598562 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8fc6b-5407-41fb-86c0-11e2eb6a4559 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:13.599123 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8fc6b-5407-41fb-86c0-11e2eb6a4559 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:13.599439 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8fc6b-5407-41fb-86c0-11e2eb6a4559 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:13.602079 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 708/1407] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:20:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:20:13.607913 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae493ff2-f3f0-4242-a050-b6c04fda1e9c None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:13.608765 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae493ff2-f3f0-4242-a050-b6c04fda1e9c None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:13.608765 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae493ff2-f3f0-4242-a050-b6c04fda1e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:13.630937 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-ae493ff2-f3f0-4242-a050-b6c04fda1e9c None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:20:13.632199 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-ae493ff2-f3f0-4242-a050-b6c04fda1e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:20:13.640937 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 700/1408] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:20:13.690163 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8fc6b-5407-41fb-86c0-11e2eb6a4559 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:20:13.707284 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8fc6b-5407-41fb-86c0-11e2eb6a4559 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:20:13.713457 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459eb13a-c85c-471c-b244-75e7b8e6376f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:20:13.714140 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459eb13a-c85c-471c-b244-75e7b8e6376f service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:13.714418 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459eb13a-c85c-471c-b244-75e7b8e6376f service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:13.714708 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459eb13a-c85c-471c-b244-75e7b8e6376f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:13.725456 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459eb13a-c85c-471c-b244-75e7b8e6376f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:20:13.728316 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459eb13a-c85c-471c-b244-75e7b8e6376f service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:20:13.754057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 709/1409] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:20:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:20:23.625197 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=57 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:20:23.745626 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=29 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:20:34.045415 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbbd19-d80b-4dc5-8aff-89e558f4bc7e None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:34.046054 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbbd19-d80b-4dc5-8aff-89e558f4bc7e None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:34.046054 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbbd19-d80b-4dc5-8aff-89e558f4bc7e None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:34.047408 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 701/1410] 10.222.0.32 () {54 vars in 918 bytes} [Wed Jun 1 04:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:20:34.053325 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23967ed-cf39-4a45-8180-83ace582a7fa None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:34.053847 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23967ed-cf39-4a45-8180-83ace582a7fa None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:34.053847 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23967ed-cf39-4a45-8180-83ace582a7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:34.073661 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e23967ed-cf39-4a45-8180-83ace582a7fa None None] MFA Rules not processed for user `0433f6219478476286ea27c5c82d41a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:20:34.074900 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e23967ed-cf39-4a45-8180-83ace582a7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:20:34.083416 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 710/1411] 10.222.0.32 () {58 vars in 1015 bytes} [Wed Jun 1 04:20:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:20:34.097958 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341dd34-1310-46be-acf2-8300e41ecc1c None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:34.098370 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341dd34-1310-46be-acf2-8300e41ecc1c None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:34.098696 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341dd34-1310-46be-acf2-8300e41ecc1c None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:34.100128 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 702/1412] 10.222.0.32 () {54 vars in 918 bytes} [Wed Jun 1 04:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:20:34.105414 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c6102-a46b-4473-bc0c-c33e9b3ddc11 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:34.105704 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c6102-a46b-4473-bc0c-c33e9b3ddc11 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:34.106021 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c6102-a46b-4473-bc0c-c33e9b3ddc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:34.124999 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-956c6102-a46b-4473-bc0c-c33e9b3ddc11 None None] MFA Rules not processed for user `79d614f85f5541d3babbb41468cbf55c`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:20:34.126259 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-956c6102-a46b-4473-bc0c-c33e9b3ddc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:20:34.136701 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 711/1413] 10.222.0.32 () {58 vars in 1015 bytes} [Wed Jun 1 04:20:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:20:37.087619 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326dd9fa-8c1d-4e01-8e4f-294cde6cdedd None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:37.088319 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326dd9fa-8c1d-4e01-8e4f-294cde6cdedd None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:37.088319 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326dd9fa-8c1d-4e01-8e4f-294cde6cdedd None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:37.089526 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 703/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 1 04:20:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:20:37.095403 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2bf69-3412-4e20-aa8b-81e2c5d2511f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:37.095922 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2bf69-3412-4e20-aa8b-81e2c5d2511f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:37.096020 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2bf69-3412-4e20-aa8b-81e2c5d2511f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:37.117439 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7cf2bf69-3412-4e20-aa8b-81e2c5d2511f None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:20:37.119103 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7cf2bf69-3412-4e20-aa8b-81e2c5d2511f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:20:37.128119 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 712/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 1 04:20:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:20:37.180899 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326dd9fa-8c1d-4e01-8e4f-294cde6cdedd None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:20:37.197418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326dd9fa-8c1d-4e01-8e4f-294cde6cdedd None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:20:37.203063 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb9345-a031-4b32-93e2-c945521cdeb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:20:37.203710 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb9345-a031-4b32-93e2-c945521cdeb1 service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:37.203989 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb9345-a031-4b32-93e2-c945521cdeb1 service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:37.204262 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb9345-a031-4b32-93e2-c945521cdeb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:37.213858 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb9345-a031-4b32-93e2-c945521cdeb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:20:37.215742 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb9345-a031-4b32-93e2-c945521cdeb1 service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:20:37.226930 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 704/1416] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:20:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:20:38.259021 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b506e4a-cb01-4f6c-aef5-bb9112cd244d None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:38.259605 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b506e4a-cb01-4f6c-aef5-bb9112cd244d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:38.259874 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b506e4a-cb01-4f6c-aef5-bb9112cd244d None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:38.261532 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 713/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 1 04:20:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:20:38.267953 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6aba9-9b51-4812-a8a4-810391999ff0 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:38.268656 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6aba9-9b51-4812-a8a4-810391999ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:38.268656 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6aba9-9b51-4812-a8a4-810391999ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:38.291150 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-dce6aba9-9b51-4812-a8a4-810391999ff0 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:20:38.292375 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-dce6aba9-9b51-4812-a8a4-810391999ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:20:38.300648 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 705/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 1 04:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:20:38.498622 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b506e4a-cb01-4f6c-aef5-bb9112cd244d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:20:38.514964 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b506e4a-cb01-4f6c-aef5-bb9112cd244d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:20:38.520849 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a86e9c-6155-4711-956c-c99a59190a7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:20:38.521518 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a86e9c-6155-4711-956c-c99a59190a7d service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:38.521825 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a86e9c-6155-4711-956c-c99a59190a7d service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:38.522127 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a86e9c-6155-4711-956c-c99a59190a7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:38.532327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a86e9c-6155-4711-956c-c99a59190a7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:20:38.533995 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a86e9c-6155-4711-956c-c99a59190a7d service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:20:38.545343 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 714/1419] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:20:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:20:39.576900 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fcf0a-8b1e-454b-9dd6-ec7520ecfd99 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:39.577537 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fcf0a-8b1e-454b-9dd6-ec7520ecfd99 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:39.577537 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fcf0a-8b1e-454b-9dd6-ec7520ecfd99 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:39.578898 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 706/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 1 04:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:20:39.584822 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425cd5a-305d-4ce4-bef1-5bde10e51893 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:39.585904 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425cd5a-305d-4ce4-bef1-5bde10e51893 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:39.585904 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425cd5a-305d-4ce4-bef1-5bde10e51893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:39.605379 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-6425cd5a-305d-4ce4-bef1-5bde10e51893 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:20:39.606618 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6425cd5a-305d-4ce4-bef1-5bde10e51893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:20:39.614736 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 715/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 1 04:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:20:39.874893 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fcf0a-8b1e-454b-9dd6-ec7520ecfd99 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:20:39.890136 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fcf0a-8b1e-454b-9dd6-ec7520ecfd99 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:20:39.895953 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d855f-5de2-4741-8dae-06f05aa4f8b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:20:39.896614 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d855f-5de2-4741-8dae-06f05aa4f8b1 service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:39.896893 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d855f-5de2-4741-8dae-06f05aa4f8b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:39.897171 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d855f-5de2-4741-8dae-06f05aa4f8b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:39.906475 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d855f-5de2-4741-8dae-06f05aa4f8b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:20:39.908225 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d855f-5de2-4741-8dae-06f05aa4f8b1 service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:20:39.920135 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 707/1422] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:20:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:20:40.923016 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621a5aa-fb5c-43e1-8d81-5b299b93daa4 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:40.923624 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621a5aa-fb5c-43e1-8d81-5b299b93daa4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:40.923624 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621a5aa-fb5c-43e1-8d81-5b299b93daa4 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:40.925180 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 716/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 1 04:20:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:20:40.932007 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bc13b-9d89-4103-991d-6fca4fe4063a None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:40.932598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bc13b-9d89-4103-991d-6fca4fe4063a None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:40.932734 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bc13b-9d89-4103-991d-6fca4fe4063a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:40.954355 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-4b4bc13b-9d89-4103-991d-6fca4fe4063a None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:20:40.955597 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-4b4bc13b-9d89-4103-991d-6fca4fe4063a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:20:40.966051 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 708/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 1 04:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:20:41.130453 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621a5aa-fb5c-43e1-8d81-5b299b93daa4 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:20:41.145284 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621a5aa-fb5c-43e1-8d81-5b299b93daa4 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:20:41.151165 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1caca-67f1-4801-bbc3-1cd189def999 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:20:41.151928 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1caca-67f1-4801-bbc3-1cd189def999 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:41.152274 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1caca-67f1-4801-bbc3-1cd189def999 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:41.152502 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1caca-67f1-4801-bbc3-1cd189def999 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:41.162067 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b1caca-67f1-4801-bbc3-1cd189def999 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:20:41.164337 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b1caca-67f1-4801-bbc3-1cd189def999 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:20:41.174585 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 717/1425] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:20:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:20:42.162733 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ccb38-382b-4b3f-b793-40c45fe168fd None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:42.163966 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ccb38-382b-4b3f-b793-40c45fe168fd None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:42.163966 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ccb38-382b-4b3f-b793-40c45fe168fd None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:42.165457 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 709/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 1 04:20:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:20:42.175231 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922cfbb-87b5-480d-9495-7d18f3688ffb None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:42.175789 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922cfbb-87b5-480d-9495-7d18f3688ffb None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:42.175908 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922cfbb-87b5-480d-9495-7d18f3688ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:42.197365 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-f922cfbb-87b5-480d-9495-7d18f3688ffb None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:20:42.198729 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f922cfbb-87b5-480d-9495-7d18f3688ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:20:42.207583 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 718/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 1 04:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:20:42.364687 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ccb38-382b-4b3f-b793-40c45fe168fd None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:20:42.379912 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ccb38-382b-4b3f-b793-40c45fe168fd None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:20:42.385434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2360fcb-4e94-47ad-a991-eace6215a079 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:20:42.386119 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2360fcb-4e94-47ad-a991-eace6215a079 service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:42.386402 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2360fcb-4e94-47ad-a991-eace6215a079 service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:42.386835 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2360fcb-4e94-47ad-a991-eace6215a079 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:42.396736 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2360fcb-4e94-47ad-a991-eace6215a079 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:20:42.399361 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2360fcb-4e94-47ad-a991-eace6215a079 service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:20:42.412187 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 710/1428] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:20:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:20:43.332676 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e09f2-0990-4540-931c-1efcb2803401 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:43.333262 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e09f2-0990-4540-931c-1efcb2803401 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:43.333262 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e09f2-0990-4540-931c-1efcb2803401 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:43.334669 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 719/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 1 04:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:20:43.340308 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2d259-bf27-4168-ba50-9e7abc312ca2 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:43.340885 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2d259-bf27-4168-ba50-9e7abc312ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:43.340885 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2d259-bf27-4168-ba50-9e7abc312ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:43.360868 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-91f2d259-bf27-4168-ba50-9e7abc312ca2 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:20:43.362112 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-91f2d259-bf27-4168-ba50-9e7abc312ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:20:43.370748 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 711/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 1 04:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:20:43.524284 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e09f2-0990-4540-931c-1efcb2803401 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:20:43.539699 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e09f2-0990-4540-931c-1efcb2803401 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:20:43.545236 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b8469-9c59-490f-9b66-e893a9eba6d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:20:43.545886 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b8469-9c59-490f-9b66-e893a9eba6d8 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:43.546195 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b8469-9c59-490f-9b66-e893a9eba6d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:43.546470 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b8469-9c59-490f-9b66-e893a9eba6d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:43.555889 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b8469-9c59-490f-9b66-e893a9eba6d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:20:43.557515 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b8469-9c59-490f-9b66-e893a9eba6d8 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:20:43.568378 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 720/1431] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:20:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:20:44.465816 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacba68f-67d2-4632-ba94-799a3ef865c8 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:44.466358 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacba68f-67d2-4632-ba94-799a3ef865c8 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:44.466358 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacba68f-67d2-4632-ba94-799a3ef865c8 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:44.467699 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 712/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 1 04:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:20:44.472669 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa9eac-20b4-40e1-86bc-b572d28ee6c0 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:44.473070 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa9eac-20b4-40e1-86bc-b572d28ee6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:44.473220 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa9eac-20b4-40e1-86bc-b572d28ee6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:44.490896 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-86fa9eac-20b4-40e1-86bc-b572d28ee6c0 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:20:44.492616 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-86fa9eac-20b4-40e1-86bc-b572d28ee6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:20:44.500288 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 721/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 1 04:20:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:20:44.652102 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacba68f-67d2-4632-ba94-799a3ef865c8 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:20:44.666335 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacba68f-67d2-4632-ba94-799a3ef865c8 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:20:44.671699 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed565f4-393a-47ba-8045-ad799b68e1a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:20:44.672335 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed565f4-393a-47ba-8045-ad799b68e1a8 service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:44.672620 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed565f4-393a-47ba-8045-ad799b68e1a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:44.672898 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed565f4-393a-47ba-8045-ad799b68e1a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:44.681676 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed565f4-393a-47ba-8045-ad799b68e1a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:20:44.683293 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed565f4-393a-47ba-8045-ad799b68e1a8 service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:20:44.692674 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 713/1434] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:20:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:20:45.545244 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c3703-dc31-4b28-bb7e-10f6cb68edef None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:45.545813 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c3703-dc31-4b28-bb7e-10f6cb68edef None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:45.545813 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c3703-dc31-4b28-bb7e-10f6cb68edef None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:45.547221 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 722/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 1 04:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:20:45.552112 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6977d-abd3-4d4c-9860-40df569c85ba None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:45.552547 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6977d-abd3-4d4c-9860-40df569c85ba None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:45.553160 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6977d-abd3-4d4c-9860-40df569c85ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:45.570814 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-6de6977d-abd3-4d4c-9860-40df569c85ba None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:20:45.571932 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6de6977d-abd3-4d4c-9860-40df569c85ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:20:45.579804 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 714/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 1 04:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:20:45.727150 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c3703-dc31-4b28-bb7e-10f6cb68edef None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:20:45.741304 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c3703-dc31-4b28-bb7e-10f6cb68edef None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:20:45.746986 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ba292-498a-414c-8d48-9ad948119dfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:20:45.747620 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ba292-498a-414c-8d48-9ad948119dfb service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:45.747903 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ba292-498a-414c-8d48-9ad948119dfb service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:45.748178 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ba292-498a-414c-8d48-9ad948119dfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:45.756251 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ba292-498a-414c-8d48-9ad948119dfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:20:45.758370 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ba292-498a-414c-8d48-9ad948119dfb service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:20:45.767734 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 723/1437] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:20:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:20:46.618804 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe1817-920c-44d5-91f6-239aae292536 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:46.619394 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe1817-920c-44d5-91f6-239aae292536 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:46.619394 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe1817-920c-44d5-91f6-239aae292536 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:46.620703 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 715/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 1 04:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:20:46.625773 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9159351-4055-4958-b40f-fae1b516f9ae None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:46.626231 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9159351-4055-4958-b40f-fae1b516f9ae None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:46.626380 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9159351-4055-4958-b40f-fae1b516f9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:46.644639 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-f9159351-4055-4958-b40f-fae1b516f9ae None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:20:46.645854 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f9159351-4055-4958-b40f-fae1b516f9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:20:46.654166 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 724/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 1 04:20:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:20:46.805718 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe1817-920c-44d5-91f6-239aae292536 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:20:46.821420 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe1817-920c-44d5-91f6-239aae292536 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:20:46.827101 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9c87b-d924-466a-910b-b8f49969fd9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:20:46.827775 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9c87b-d924-466a-910b-b8f49969fd9b service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:46.828062 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9c87b-d924-466a-910b-b8f49969fd9b service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:46.828314 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9c87b-d924-466a-910b-b8f49969fd9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:46.837469 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e9c87b-d924-466a-910b-b8f49969fd9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:20:46.839077 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e9c87b-d924-466a-910b-b8f49969fd9b service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:20:46.848424 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 716/1440] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:20:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:20:48.984507 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1db84-e18e-4a63-a16a-94ca5c9975b8 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:48.985088 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1db84-e18e-4a63-a16a-94ca5c9975b8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:48.985088 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1db84-e18e-4a63-a16a-94ca5c9975b8 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:48.986463 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 725/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 1 04:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:20:48.992536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b8490-e962-4a4a-9237-b69068303320 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:48.993027 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b8490-e962-4a4a-9237-b69068303320 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:48.993149 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b8490-e962-4a4a-9237-b69068303320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:49.010405 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-2b6b8490-e962-4a4a-9237-b69068303320 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:20:49.011592 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-2b6b8490-e962-4a4a-9237-b69068303320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:20:49.019231 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 717/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 1 04:20:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:20:49.058336 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1db84-e18e-4a63-a16a-94ca5c9975b8 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:20:49.068784 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1db84-e18e-4a63-a16a-94ca5c9975b8 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:20:49.072532 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afc5c4-6c40-4309-853d-4f3d67a86108 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:20:49.073164 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afc5c4-6c40-4309-853d-4f3d67a86108 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:49.073446 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afc5c4-6c40-4309-853d-4f3d67a86108 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:49.073723 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afc5c4-6c40-4309-853d-4f3d67a86108 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:49.082690 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02afc5c4-6c40-4309-853d-4f3d67a86108 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:20:49.084097 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02afc5c4-6c40-4309-853d-4f3d67a86108 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:20:49.093907 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 726/1443] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:20:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:20:51.576172 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d50d9-d756-4c02-85cc-d674a1c09081 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:51.576686 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d50d9-d756-4c02-85cc-d674a1c09081 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:51.576783 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d50d9-d756-4c02-85cc-d674a1c09081 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:51.578117 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 718/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 1 04:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:20:51.583441 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba1fd2-3022-4212-a84c-0fe3753e3e96 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:51.583857 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba1fd2-3022-4212-a84c-0fe3753e3e96 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:51.584009 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba1fd2-3022-4212-a84c-0fe3753e3e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:51.602073 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-10ba1fd2-3022-4212-a84c-0fe3753e3e96 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:20:51.603269 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-10ba1fd2-3022-4212-a84c-0fe3753e3e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:20:51.611151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 727/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 1 04:20:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:20:51.649122 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d50d9-d756-4c02-85cc-d674a1c09081 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:20:51.660030 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d50d9-d756-4c02-85cc-d674a1c09081 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:20:51.664012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e5599-628d-4ff5-b207-b0be03c2807c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:20:51.664639 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e5599-628d-4ff5-b207-b0be03c2807c service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:51.664918 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e5599-628d-4ff5-b207-b0be03c2807c service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:51.665190 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e5599-628d-4ff5-b207-b0be03c2807c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:51.674394 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e5599-628d-4ff5-b207-b0be03c2807c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:20:51.675814 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e5599-628d-4ff5-b207-b0be03c2807c service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:20:51.685905 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 719/1446] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:20:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:20:54.313852 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7163fb3-eaa7-41f7-9472-d97246fbde65 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:54.314476 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7163fb3-eaa7-41f7-9472-d97246fbde65 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:54.314476 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7163fb3-eaa7-41f7-9472-d97246fbde65 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:54.315954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 728/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 1 04:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:20:54.322774 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5950f6-e32b-4909-b38e-9e35d1694768 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:54.322774 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5950f6-e32b-4909-b38e-9e35d1694768 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:54.323427 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5950f6-e32b-4909-b38e-9e35d1694768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:54.342190 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-ab5950f6-e32b-4909-b38e-9e35d1694768 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:20:54.343398 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-ab5950f6-e32b-4909-b38e-9e35d1694768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:20:54.351774 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 720/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 1 04:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:20:54.392432 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7163fb3-eaa7-41f7-9472-d97246fbde65 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:20:54.403290 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7163fb3-eaa7-41f7-9472-d97246fbde65 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:20:54.407463 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff9326-a50d-44ec-ab39-1336424d944f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:20:54.408153 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff9326-a50d-44ec-ab39-1336424d944f service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:54.408385 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff9326-a50d-44ec-ab39-1336424d944f service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:54.408657 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff9326-a50d-44ec-ab39-1336424d944f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:54.418113 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ff9326-a50d-44ec-ab39-1336424d944f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:20:54.419535 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ff9326-a50d-44ec-ab39-1336424d944f service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:20:54.429767 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 729/1449] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:20:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:20:56.824326 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec17d67-c269-4123-ab64-afde5bd8e014 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:56.825247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec17d67-c269-4123-ab64-afde5bd8e014 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:56.825535 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec17d67-c269-4123-ab64-afde5bd8e014 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:56.826957 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 721/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 1 04:20:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:20:56.832787 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b706f-4231-498e-9304-5fc9466065d7 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:56.833349 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b706f-4231-498e-9304-5fc9466065d7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:56.833454 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b706f-4231-498e-9304-5fc9466065d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:56.852499 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a34b706f-4231-498e-9304-5fc9466065d7 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:20:56.853720 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a34b706f-4231-498e-9304-5fc9466065d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:20:56.861534 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 730/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 1 04:20:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:20:56.901024 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec17d67-c269-4123-ab64-afde5bd8e014 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:20:56.915161 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec17d67-c269-4123-ab64-afde5bd8e014 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:20:56.920812 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8746ad0-9e80-403e-a191-5f98328c05f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:20:56.921858 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8746ad0-9e80-403e-a191-5f98328c05f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:56.922378 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8746ad0-9e80-403e-a191-5f98328c05f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:56.922690 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8746ad0-9e80-403e-a191-5f98328c05f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:56.933261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8746ad0-9e80-403e-a191-5f98328c05f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:20:56.934759 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8746ad0-9e80-403e-a191-5f98328c05f0 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:20:56.945413 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 722/1452] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:20:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:20:59.314638 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc75054-641c-42a9-a0d1-8f78107b31cd None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:59.315207 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc75054-641c-42a9-a0d1-8f78107b31cd None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:59.315207 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc75054-641c-42a9-a0d1-8f78107b31cd None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:59.316564 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 731/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 1 04:20:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:20:59.323171 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f30599-2824-42b5-a9c8-5acf25885904 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:59.323905 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f30599-2824-42b5-a9c8-5acf25885904 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:59.323905 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f30599-2824-42b5-a9c8-5acf25885904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:59.342763 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-13f30599-2824-42b5-a9c8-5acf25885904 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:20:59.344015 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-13f30599-2824-42b5-a9c8-5acf25885904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:20:59.351997 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 723/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 1 04:20:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:20:59.390101 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc75054-641c-42a9-a0d1-8f78107b31cd None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:20:59.402010 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc75054-641c-42a9-a0d1-8f78107b31cd None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:20:59.405549 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9a311-04ae-47fc-82f2-1a87876103eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:20:59.406247 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9a311-04ae-47fc-82f2-1a87876103eb service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:20:59.406527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9a311-04ae-47fc-82f2-1a87876103eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:20:59.406804 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9a311-04ae-47fc-82f2-1a87876103eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:20:59.419610 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9a311-04ae-47fc-82f2-1a87876103eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:20:59.420974 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9a311-04ae-47fc-82f2-1a87876103eb service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:20:59.431497 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 732/1455] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:20:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:21:01.760609 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3d8f4-2efe-4c0d-8e91-197246b2c5cb None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:21:01.761176 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3d8f4-2efe-4c0d-8e91-197246b2c5cb None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:21:01.761327 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3d8f4-2efe-4c0d-8e91-197246b2c5cb None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:21:01.762655 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 724/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 1 04:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:21:01.767957 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45256a00-b9ff-4955-b885-712256867e3c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:21:01.768366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45256a00-b9ff-4955-b885-712256867e3c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:21:01.768510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45256a00-b9ff-4955-b885-712256867e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:21:01.786442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-45256a00-b9ff-4955-b885-712256867e3c None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:21:01.787623 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-45256a00-b9ff-4955-b885-712256867e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:21:01.795911 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 733/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 1 04:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:21:01.834564 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3d8f4-2efe-4c0d-8e91-197246b2c5cb None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:21:01.846067 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3d8f4-2efe-4c0d-8e91-197246b2c5cb None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:21:01.850029 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c282d39-7cc5-478f-b649-27e3058906b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:21:01.851320 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c282d39-7cc5-478f-b649-27e3058906b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:21:01.851612 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c282d39-7cc5-478f-b649-27e3058906b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:21:01.851891 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c282d39-7cc5-478f-b649-27e3058906b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:21:01.862002 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c282d39-7cc5-478f-b649-27e3058906b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:21:01.863485 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c282d39-7cc5-478f-b649-27e3058906b8 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:21:01.873622 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 725/1458] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:21:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:21:04.188465 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45dbca-e6cd-44f2-a1e6-4fdc846f99c6 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:21:04.188972 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45dbca-e6cd-44f2-a1e6-4fdc846f99c6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:21:04.189086 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45dbca-e6cd-44f2-a1e6-4fdc846f99c6 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:21:04.190394 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 734/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 1 04:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:21:04.196098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512b7df-d0e4-4a08-abfc-65eb9929c2fb None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:21:04.196543 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512b7df-d0e4-4a08-abfc-65eb9929c2fb None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:21:04.196648 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512b7df-d0e4-4a08-abfc-65eb9929c2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:21:04.202589 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=70 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:21:04.215445 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-f512b7df-d0e4-4a08-abfc-65eb9929c2fb None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:21:04.216620 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f512b7df-d0e4-4a08-abfc-65eb9929c2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:21:04.224751 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 726/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 1 04:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:21:04.262106 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec45dbca-e6cd-44f2-a1e6-4fdc846f99c6 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:21:04.267489 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=73 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:21:04.274387 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec45dbca-e6cd-44f2-a1e6-4fdc846f99c6 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:21:04.277875 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ceaad7-abdd-441d-a22b-274e4cd020ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:21:04.278546 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ceaad7-abdd-441d-a22b-274e4cd020ce service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:21:04.278832 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ceaad7-abdd-441d-a22b-274e4cd020ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:21:04.279110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ceaad7-abdd-441d-a22b-274e4cd020ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:21:04.288559 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ceaad7-abdd-441d-a22b-274e4cd020ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:21:04.290006 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ceaad7-abdd-441d-a22b-274e4cd020ce service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:21:04.299672 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 735/1461] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:21:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:21:06.602485 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb4b32-11a0-47cf-a6ae-f7eeebc9ec10 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:21:06.603122 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb4b32-11a0-47cf-a6ae-f7eeebc9ec10 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:21:06.603122 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb4b32-11a0-47cf-a6ae-f7eeebc9ec10 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:21:06.604412 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 727/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 1 04:21:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:21:06.609965 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993b7d2-bdc6-4d21-9a6b-cd7ac0662fd6 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:21:06.610466 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993b7d2-bdc6-4d21-9a6b-cd7ac0662fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:21:06.610578 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993b7d2-bdc6-4d21-9a6b-cd7ac0662fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:21:06.628260 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a993b7d2-bdc6-4d21-9a6b-cd7ac0662fd6 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:21:06.629473 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a993b7d2-bdc6-4d21-9a6b-cd7ac0662fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:21:06.638252 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 736/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 1 04:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:21:06.676399 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb4b32-11a0-47cf-a6ae-f7eeebc9ec10 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:21:06.678141 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-26fb4b32-11a0-47cf-a6ae-f7eeebc9ec10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:21:06.691880 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb4b32-11a0-47cf-a6ae-f7eeebc9ec10 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:21:06.696377 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae90915-0d1b-4552-b01a-d0f97fe97cb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:21:06.697026 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae90915-0d1b-4552-b01a-d0f97fe97cb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:21:06.697312 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae90915-0d1b-4552-b01a-d0f97fe97cb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:21:06.697592 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae90915-0d1b-4552-b01a-d0f97fe97cb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:21:06.707576 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae90915-0d1b-4552-b01a-d0f97fe97cb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:21:06.709014 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae90915-0d1b-4552-b01a-d0f97fe97cb6 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:21:06.719593 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 728/1464] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:21:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:21:09.047475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541cbe5-9a14-4605-bdc6-619a6d628d57 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:21:09.048062 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541cbe5-9a14-4605-bdc6-619a6d628d57 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:21:09.048062 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541cbe5-9a14-4605-bdc6-619a6d628d57 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:21:09.049395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 737/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 1 04:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:21:09.055344 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dbaad-29c0-47af-8447-32c2767a28b9 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:21:09.055752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dbaad-29c0-47af-8447-32c2767a28b9 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:21:09.055907 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dbaad-29c0-47af-8447-32c2767a28b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:21:09.073579 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-3b0dbaad-29c0-47af-8447-32c2767a28b9 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:21:09.074801 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3b0dbaad-29c0-47af-8447-32c2767a28b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:21:09.082631 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 729/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 1 04:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:21:09.119629 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541cbe5-9a14-4605-bdc6-619a6d628d57 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:21:09.130413 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541cbe5-9a14-4605-bdc6-619a6d628d57 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:21:09.134033 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0350d-65de-46ee-b695-a216558daa2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:21:09.134679 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0350d-65de-46ee-b695-a216558daa2d service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:21:09.134966 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0350d-65de-46ee-b695-a216558daa2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:21:09.135245 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0350d-65de-46ee-b695-a216558daa2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:21:09.144254 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0350d-65de-46ee-b695-a216558daa2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:21:09.146181 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0350d-65de-46ee-b695-a216558daa2d service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:21:09.156146 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 738/1467] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:21:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:21:11.423268 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b98adc-41f8-47ce-9b9f-4abf8b80338a None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:21:11.423788 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b98adc-41f8-47ce-9b9f-4abf8b80338a None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:21:11.423788 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b98adc-41f8-47ce-9b9f-4abf8b80338a None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:21:11.425132 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 730/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 1 04:21:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:21:11.430502 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731626f-5848-4e36-b655-19826695453a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:21:11.430931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731626f-5848-4e36-b655-19826695453a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:21:11.431062 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731626f-5848-4e36-b655-19826695453a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:21:11.449340 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-6731626f-5848-4e36-b655-19826695453a None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:21:11.450588 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6731626f-5848-4e36-b655-19826695453a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:21:11.458626 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 739/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 1 04:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:21:11.495837 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b98adc-41f8-47ce-9b9f-4abf8b80338a None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:21:11.506466 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b98adc-41f8-47ce-9b9f-4abf8b80338a None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:21:11.510555 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088c1c0-bb9f-48bf-b735-cc97368216b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:21:11.511178 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088c1c0-bb9f-48bf-b735-cc97368216b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:21:11.511460 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088c1c0-bb9f-48bf-b735-cc97368216b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:21:11.511737 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088c1c0-bb9f-48bf-b735-cc97368216b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:21:11.520564 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088c1c0-bb9f-48bf-b735-cc97368216b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:21:11.522008 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088c1c0-bb9f-48bf-b735-cc97368216b5 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:21:11.531662 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 731/1470] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:21:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:21:21.443415 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=17 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:21:21.527345 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=17 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:21:44.232546 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf6c42-bae3-4a33-972f-c55dd537cc14 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:21:44.233181 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf6c42-bae3-4a33-972f-c55dd537cc14 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:21:44.233181 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf6c42-bae3-4a33-972f-c55dd537cc14 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:21:44.234516 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 740/1471] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:21:44.239928 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b9ca5-63dc-4d6b-9b76-6a18b49d44bf None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:21:44.240384 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b9ca5-63dc-4d6b-9b76-6a18b49d44bf None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:21:44.240536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b9ca5-63dc-4d6b-9b76-6a18b49d44bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:21:44.258668 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-bc5b9ca5-63dc-4d6b-9b76-6a18b49d44bf None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:21:44.259878 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-bc5b9ca5-63dc-4d6b-9b76-6a18b49d44bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:21:44.267814 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 732/1472] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:21:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:21:44.317035 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999fe9c-fba5-4343-8650-dde8b051c6f7 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:21:44.317324 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999fe9c-fba5-4343-8650-dde8b051c6f7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:21:44.317603 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999fe9c-fba5-4343-8650-dde8b051c6f7 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:21:44.319004 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 741/1473] 10.222.0.32 () {54 vars in 962 bytes} [Wed Jun 1 04:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:21:44.324218 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c49c1-b319-47e8-a104-de40ed2f8b82 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:21:44.324501 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c49c1-b319-47e8-a104-de40ed2f8b82 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:21:44.324778 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c49c1-b319-47e8-a104-de40ed2f8b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:21:44.342845 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-3b3c49c1-b319-47e8-a104-de40ed2f8b82 None None] MFA Rules not processed for user `7ac83171b9284163a71cc729cef076f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:21:44.343892 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3b3c49c1-b319-47e8-a104-de40ed2f8b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:21:44.351543 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 733/1474] 10.222.0.32 () {58 vars in 1059 bytes} [Wed Jun 1 04:21:44 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:21:44.359053 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d999fe9c-fba5-4343-8650-dde8b051c6f7 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:21:44.370501 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d999fe9c-fba5-4343-8650-dde8b051c6f7 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:21:44.374163 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3255b5-95ac-403a-80ac-fdafa1b3ece3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac83171b9284163a71cc729cef076f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:21:44.374836 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3255b5-95ac-403a-80ac-fdafa1b3ece3 service glance] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:21:44.375125 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3255b5-95ac-403a-80ac-fdafa1b3ece3 service glance] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:21:44.375403 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3255b5-95ac-403a-80ac-fdafa1b3ece3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:21:44.384492 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3255b5-95ac-403a-80ac-fdafa1b3ece3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:21:44.385908 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3255b5-95ac-403a-80ac-fdafa1b3ece3 service glance] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:21:44.395341 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 742/1475] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:21:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:21:46.754629 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c9cae-1590-4476-8ec9-a075b1c77b62 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:21:46.755199 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c9cae-1590-4476-8ec9-a075b1c77b62 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:21:46.755199 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c9cae-1590-4476-8ec9-a075b1c77b62 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:21:46.756549 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 734/1476] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:21:46.761761 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abef592-f356-42ed-9bcc-589dafa0012f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:21:46.762293 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abef592-f356-42ed-9bcc-589dafa0012f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:21:46.762399 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abef592-f356-42ed-9bcc-589dafa0012f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:21:46.780704 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-6abef592-f356-42ed-9bcc-589dafa0012f None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:21:46.781915 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6abef592-f356-42ed-9bcc-589dafa0012f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:21:46.790360 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 743/1477] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:21:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:21:46.813536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c9cae-1590-4476-8ec9-a075b1c77b62 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:21:46.827756 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c9cae-1590-4476-8ec9-a075b1c77b62 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:21:46.833259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efad47-701c-448a-b4d2-64b4d29ffe03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:21:46.834670 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efad47-701c-448a-b4d2-64b4d29ffe03 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:21:46.834978 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efad47-701c-448a-b4d2-64b4d29ffe03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:21:46.835310 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efad47-701c-448a-b4d2-64b4d29ffe03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:21:46.836222 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efad47-701c-448a-b4d2-64b4d29ffe03 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:21:46.838138 dv-cinder-667108-37-smb devstack@keystone.service[80232]: WARNING py.warnings [None req-09efad47-701c-448a-b4d2-64b4d29ffe03 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 01 04:21:46.838138 dv-cinder-667108-37-smb devstack@keystone.service[80232]: warnings.warn(msg) Jun 01 04:21:46.838138 dv-cinder-667108-37-smb devstack@keystone.service[80232]: Jun 01 04:21:46.839426 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efad47-701c-448a-b4d2-64b4d29ffe03 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:21:46.859852 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 735/1478] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Jun 1 04:21:46 2022] GET /identity/v3/projects => generated 2553 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:21:49.154657 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e470f2-be7b-4624-97ca-9e2162d5cdda None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:21:49.155634 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e470f2-be7b-4624-97ca-9e2162d5cdda None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:21:49.155634 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e470f2-be7b-4624-97ca-9e2162d5cdda None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:21:49.157742 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 744/1479] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:21:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:21:49.163970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a5a45-e207-4c60-a78b-e0c9eac02946 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:21:49.164514 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a5a45-e207-4c60-a78b-e0c9eac02946 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:21:49.164514 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a5a45-e207-4c60-a78b-e0c9eac02946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:21:49.184075 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-b67a5a45-e207-4c60-a78b-e0c9eac02946 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:21:49.185313 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-b67a5a45-e207-4c60-a78b-e0c9eac02946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:21:49.194206 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 736/1480] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:21:49.239211 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e470f2-be7b-4624-97ca-9e2162d5cdda None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:21:49.254345 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e470f2-be7b-4624-97ca-9e2162d5cdda None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:21:49.260391 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4560f71-c25b-4af9-ba50-ad6b2bd774b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:21:49.261033 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4560f71-c25b-4af9-ba50-ad6b2bd774b4 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:21:49.261318 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4560f71-c25b-4af9-ba50-ad6b2bd774b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:21:49.261595 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4560f71-c25b-4af9-ba50-ad6b2bd774b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:21:49.270365 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4560f71-c25b-4af9-ba50-ad6b2bd774b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:21:49.271982 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4560f71-c25b-4af9-ba50-ad6b2bd774b4 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:21:49.281852 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 745/1481] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:21:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:21:51.751482 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd22df-1fe8-49c6-8d0e-0767971fac7d None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:21:51.752050 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd22df-1fe8-49c6-8d0e-0767971fac7d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:21:51.752050 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd22df-1fe8-49c6-8d0e-0767971fac7d None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:21:51.753417 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 737/1482] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:21:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:21:51.760959 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b85415-ff0e-40e7-a07c-216c45033681 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:21:51.761522 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b85415-ff0e-40e7-a07c-216c45033681 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:21:51.761522 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b85415-ff0e-40e7-a07c-216c45033681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:21:51.779320 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-39b85415-ff0e-40e7-a07c-216c45033681 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:21:51.780568 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-39b85415-ff0e-40e7-a07c-216c45033681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:21:51.789056 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 746/1483] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:21:51.825852 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd22df-1fe8-49c6-8d0e-0767971fac7d None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:21:51.836560 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd22df-1fe8-49c6-8d0e-0767971fac7d None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:21:51.840177 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8578de9-ea0f-43a7-8239-bcc38844dd59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:21:51.840762 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8578de9-ea0f-43a7-8239-bcc38844dd59 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:21:51.841042 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8578de9-ea0f-43a7-8239-bcc38844dd59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:21:51.841316 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8578de9-ea0f-43a7-8239-bcc38844dd59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:21:51.851449 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8578de9-ea0f-43a7-8239-bcc38844dd59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:21:51.852870 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8578de9-ea0f-43a7-8239-bcc38844dd59 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:21:51.862674 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 738/1484] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:21:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:21:54.210311 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8189b00-93aa-4d09-a300-d86160bfc7be None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:21:54.210875 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8189b00-93aa-4d09-a300-d86160bfc7be None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:21:54.210875 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8189b00-93aa-4d09-a300-d86160bfc7be None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:21:54.212242 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 747/1485] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:21:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:21:54.218006 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d058dd5-e98a-47b5-abc6-ebf4a17b4866 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:21:54.218482 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d058dd5-e98a-47b5-abc6-ebf4a17b4866 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:21:54.218600 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d058dd5-e98a-47b5-abc6-ebf4a17b4866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:21:54.236380 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-3d058dd5-e98a-47b5-abc6-ebf4a17b4866 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:21:54.237589 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3d058dd5-e98a-47b5-abc6-ebf4a17b4866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:21:54.246228 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 739/1486] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:21:54.284875 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8189b00-93aa-4d09-a300-d86160bfc7be None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:21:54.296208 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8189b00-93aa-4d09-a300-d86160bfc7be None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:21:54.299816 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadc2a9-0831-4906-953a-701aa3e62f3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:21:54.300478 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadc2a9-0831-4906-953a-701aa3e62f3a service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:21:54.300763 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadc2a9-0831-4906-953a-701aa3e62f3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:21:54.301043 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadc2a9-0831-4906-953a-701aa3e62f3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:21:54.310998 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cadc2a9-0831-4906-953a-701aa3e62f3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:21:54.312430 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cadc2a9-0831-4906-953a-701aa3e62f3a service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:21:54.323144 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 748/1487] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:21:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:21:56.707794 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9ad77-2584-40e4-97ae-075cd36fd411 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:21:56.708400 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9ad77-2584-40e4-97ae-075cd36fd411 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:21:56.708400 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9ad77-2584-40e4-97ae-075cd36fd411 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:21:56.710321 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 740/1488] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:21:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:21:56.715876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4e1c0-ed2e-4460-a1ff-8563c5049ad4 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:21:56.716368 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4e1c0-ed2e-4460-a1ff-8563c5049ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:21:56.716475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4e1c0-ed2e-4460-a1ff-8563c5049ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:21:56.734600 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-4ca4e1c0-ed2e-4460-a1ff-8563c5049ad4 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:21:56.735769 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4ca4e1c0-ed2e-4460-a1ff-8563c5049ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:21:56.743469 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 749/1489] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:21:56.783428 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9ad77-2584-40e4-97ae-075cd36fd411 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:21:56.794857 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9ad77-2584-40e4-97ae-075cd36fd411 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:21:56.798370 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd238b8-03e4-4974-847d-10d4a166a3e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:21:56.799007 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd238b8-03e4-4974-847d-10d4a166a3e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:21:56.799286 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd238b8-03e4-4974-847d-10d4a166a3e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:21:56.799558 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd238b8-03e4-4974-847d-10d4a166a3e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:21:56.808893 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd238b8-03e4-4974-847d-10d4a166a3e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:21:56.810363 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd238b8-03e4-4974-847d-10d4a166a3e4 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:21:56.820567 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 741/1490] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:21:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:21:59.341081 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f71e71-b784-4eb9-ac8e-a3e25d2a1be9 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:21:59.341670 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f71e71-b784-4eb9-ac8e-a3e25d2a1be9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:21:59.341670 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f71e71-b784-4eb9-ac8e-a3e25d2a1be9 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:21:59.343039 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 750/1491] 10.222.0.32 () {54 vars in 926 bytes} [Wed Jun 1 04:21:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:21:59.348902 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b054387-a399-4b43-a423-b15823c3f30f None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:21:59.350031 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b054387-a399-4b43-a423-b15823c3f30f None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:21:59.350031 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b054387-a399-4b43-a423-b15823c3f30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:21:59.368971 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-6b054387-a399-4b43-a423-b15823c3f30f None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:21:59.370221 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6b054387-a399-4b43-a423-b15823c3f30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:21:59.378233 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 742/1492] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Jun 1 04:21:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:21:59.418698 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f71e71-b784-4eb9-ac8e-a3e25d2a1be9 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:21:59.430189 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f71e71-b784-4eb9-ac8e-a3e25d2a1be9 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:21:59.433770 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a53611-c8f7-4bee-8664-d8e7a126695e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:21:59.434456 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a53611-c8f7-4bee-8664-d8e7a126695e service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:21:59.434742 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a53611-c8f7-4bee-8664-d8e7a126695e service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:21:59.435024 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a53611-c8f7-4bee-8664-d8e7a126695e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:21:59.445467 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a53611-c8f7-4bee-8664-d8e7a126695e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:21:59.447126 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a53611-c8f7-4bee-8664-d8e7a126695e service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:21:59.457488 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 751/1493] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:21:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:22:09.362708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=33 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:22:09.452975 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=33 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:23:31.346451 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a852177-9a6f-40fb-8f6a-2bc01da7606a None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:23:31.347583 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a852177-9a6f-40fb-8f6a-2bc01da7606a None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:23:31.347583 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a852177-9a6f-40fb-8f6a-2bc01da7606a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:23:31.368910 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-5a852177-9a6f-40fb-8f6a-2bc01da7606a None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:23:31.370254 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-5a852177-9a6f-40fb-8f6a-2bc01da7606a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:23:31.378463 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 743/1494] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:23:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:23:31.386948 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3260b-49b0-48fd-9591-52041613cf6e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:23:31.387450 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3260b-49b0-48fd-9591-52041613cf6e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:23:31.387572 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3260b-49b0-48fd-9591-52041613cf6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:23:31.404932 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-35c3260b-49b0-48fd-9591-52041613cf6e None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:23:31.406147 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-35c3260b-49b0-48fd-9591-52041613cf6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:23:31.414395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 752/1495] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:23:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:23:31.418944 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a852177-9a6f-40fb-8f6a-2bc01da7606a None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:23:31.429331 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a852177-9a6f-40fb-8f6a-2bc01da7606a None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:23:31.433915 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c198be-a056-40ac-9a85-6f124f56f65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:23:31.434595 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c198be-a056-40ac-9a85-6f124f56f65b admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:23:31.434882 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c198be-a056-40ac-9a85-6f124f56f65b admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:23:31.435162 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c198be-a056-40ac-9a85-6f124f56f65b admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:23:31.435908 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c198be-a056-40ac-9a85-6f124f56f65b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:23:31.436216 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c198be-a056-40ac-9a85-6f124f56f65b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:23:31.437228 dv-cinder-667108-37-smb devstack@keystone.service[80232]: WARNING py.warnings [None req-03c198be-a056-40ac-9a85-6f124f56f65b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 01 04:23:31.437228 dv-cinder-667108-37-smb devstack@keystone.service[80232]: warnings.warn(msg) Jun 01 04:23:31.437228 dv-cinder-667108-37-smb devstack@keystone.service[80232]: Jun 01 04:23:31.438181 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c198be-a056-40ac-9a85-6f124f56f65b admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:23:31.449951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 744/1496] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:23:31.458193 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3260b-49b0-48fd-9591-52041613cf6e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:23:31.467191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3260b-49b0-48fd-9591-52041613cf6e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:23:31.471629 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6f70d-987c-4ec1-837c-313020f88b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:23:31.472770 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6f70d-987c-4ec1-837c-313020f88b19 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:23:31.473049 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6f70d-987c-4ec1-837c-313020f88b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:23:31.473324 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6f70d-987c-4ec1-837c-313020f88b19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:23:31.474028 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab6f70d-987c-4ec1-837c-313020f88b19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:23:31.475737 dv-cinder-667108-37-smb devstack@keystone.service[80231]: WARNING py.warnings [None req-eab6f70d-987c-4ec1-837c-313020f88b19 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 01 04:23:31.475737 dv-cinder-667108-37-smb devstack@keystone.service[80231]: warnings.warn(msg) Jun 01 04:23:31.475737 dv-cinder-667108-37-smb devstack@keystone.service[80231]: Jun 01 04:23:31.476914 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab6f70d-987c-4ec1-837c-313020f88b19 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:23:31.513253 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 753/1497] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:23:31 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:23:31.517413 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c198be-a056-40ac-9a85-6f124f56f65b admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:23:31.527303 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c198be-a056-40ac-9a85-6f124f56f65b admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:23:31.583424 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97061ee8-5e82-4e8b-bc8d-e0e17cbe1cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:23:31.584089 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97061ee8-5e82-4e8b-bc8d-e0e17cbe1cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:23:31.584371 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97061ee8-5e82-4e8b-bc8d-e0e17cbe1cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:23:31.584645 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97061ee8-5e82-4e8b-bc8d-e0e17cbe1cf4 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:23:31.585326 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97061ee8-5e82-4e8b-bc8d-e0e17cbe1cf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:23:31.586373 dv-cinder-667108-37-smb devstack@keystone.service[80232]: WARNING py.warnings [None req-97061ee8-5e82-4e8b-bc8d-e0e17cbe1cf4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 01 04:23:31.586373 dv-cinder-667108-37-smb devstack@keystone.service[80232]: warnings.warn(msg) Jun 01 04:23:31.586373 dv-cinder-667108-37-smb devstack@keystone.service[80232]: Jun 01 04:23:31.587560 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97061ee8-5e82-4e8b-bc8d-e0e17cbe1cf4 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:23:31.608214 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 745/1498] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:23:31 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:23:31.612317 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6f70d-987c-4ec1-837c-313020f88b19 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:23:31.623206 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6f70d-987c-4ec1-837c-313020f88b19 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:23:31.627759 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd763d4c-aeb1-4467-b238-0c2ce6fadbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:23:31.628944 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd763d4c-aeb1-4467-b238-0c2ce6fadbfe admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:23:31.629227 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd763d4c-aeb1-4467-b238-0c2ce6fadbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:23:31.629505 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd763d4c-aeb1-4467-b238-0c2ce6fadbfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:23:31.630274 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd763d4c-aeb1-4467-b238-0c2ce6fadbfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:23:31.631294 dv-cinder-667108-37-smb devstack@keystone.service[80231]: WARNING py.warnings [None req-dd763d4c-aeb1-4467-b238-0c2ce6fadbfe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 01 04:23:31.631294 dv-cinder-667108-37-smb devstack@keystone.service[80231]: warnings.warn(msg) Jun 01 04:23:31.631294 dv-cinder-667108-37-smb devstack@keystone.service[80231]: Jun 01 04:23:31.632191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd763d4c-aeb1-4467-b238-0c2ce6fadbfe admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:23:31.645841 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 754/1499] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:23:31.649891 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97061ee8-5e82-4e8b-bc8d-e0e17cbe1cf4 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:23:31.659992 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97061ee8-5e82-4e8b-bc8d-e0e17cbe1cf4 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:23:31.664630 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae7dfa-f177-431f-88c8-153151f58ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:23:31.665221 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae7dfa-f177-431f-88c8-153151f58ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:23:31.665506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae7dfa-f177-431f-88c8-153151f58ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:23:31.665786 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae7dfa-f177-431f-88c8-153151f58ec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:23:31.666550 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae7dfa-f177-431f-88c8-153151f58ec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:23:31.667563 dv-cinder-667108-37-smb devstack@keystone.service[80232]: WARNING py.warnings [None req-d6ae7dfa-f177-431f-88c8-153151f58ec8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 01 04:23:31.667563 dv-cinder-667108-37-smb devstack@keystone.service[80232]: warnings.warn(msg) Jun 01 04:23:31.667563 dv-cinder-667108-37-smb devstack@keystone.service[80232]: Jun 01 04:23:31.668441 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae7dfa-f177-431f-88c8-153151f58ec8 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:23:31.682167 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 746/1500] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:23:31.686282 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd763d4c-aeb1-4467-b238-0c2ce6fadbfe admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:23:31.696992 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd763d4c-aeb1-4467-b238-0c2ce6fadbfe admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:23:31.701621 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628da151-8d7a-4cfb-b016-146c0bd043e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:23:31.702539 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628da151-8d7a-4cfb-b016-146c0bd043e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:23:31.702825 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628da151-8d7a-4cfb-b016-146c0bd043e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:23:31.703100 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628da151-8d7a-4cfb-b016-146c0bd043e0 admin admin] PATH_INFO: `/v3/projects/a12ceec5041344919a7f3614e4edb530/users/32599d8eb80c4dbca2714f5e82fc32b3/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:23:31.718932 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628da151-8d7a-4cfb-b016-146c0bd043e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a12ceec5041344919a7f3614e4edb530, user_id=32599d8eb80c4dbca2714f5e82fc32b3, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:23:31.719966 dv-cinder-667108-37-smb devstack@keystone.service[80231]: WARNING py.warnings [None req-628da151-8d7a-4cfb-b016-146c0bd043e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 01 04:23:31.719966 dv-cinder-667108-37-smb devstack@keystone.service[80231]: warnings.warn(msg) Jun 01 04:23:31.719966 dv-cinder-667108-37-smb devstack@keystone.service[80231]: Jun 01 04:23:31.722041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628da151-8d7a-4cfb-b016-146c0bd043e0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:23:31.735557 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 755/1501] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:23:31 2022] PUT /identity/v3/projects/a12ceec5041344919a7f3614e4edb530/users/32599d8eb80c4dbca2714f5e82fc32b3/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:23:31.748280 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72b2e9-54ab-45f0-96b5-d2d4da4269a1 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:23:31.748596 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72b2e9-54ab-45f0-96b5-d2d4da4269a1 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:23:31.748879 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72b2e9-54ab-45f0-96b5-d2d4da4269a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:23:31.775891 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-7e72b2e9-54ab-45f0-96b5-d2d4da4269a1 None None] MFA Rules not processed for user `32599d8eb80c4dbca2714f5e82fc32b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:23:31.777108 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7e72b2e9-54ab-45f0-96b5-d2d4da4269a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:23:31.841726 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 747/1502] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:23:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:23:31.854850 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78375d69-88ff-4b0b-94a1-c54269474160 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:23:31.855145 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78375d69-88ff-4b0b-94a1-c54269474160 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:23:31.855429 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78375d69-88ff-4b0b-94a1-c54269474160 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:23:31.856818 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 756/1503] 10.222.0.32 () {54 vars in 963 bytes} [Wed Jun 1 04:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:23:31.861469 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f4f07-b633-4c5c-acd4-ca2c31f717a2 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:23:31.861761 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f4f07-b633-4c5c-acd4-ca2c31f717a2 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:23:31.862075 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f4f07-b633-4c5c-acd4-ca2c31f717a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:23:31.881664 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-5c0f4f07-b633-4c5c-acd4-ca2c31f717a2 None None] MFA Rules not processed for user `c1fbe41fbc1e4ac4964e3a5a417b6253`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:23:31.882915 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-5c0f4f07-b633-4c5c-acd4-ca2c31f717a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:23:31.935828 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:23:31.944364 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 748/1504] 10.222.0.32 () {58 vars in 1060 bytes} [Wed Jun 1 04:23:31 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:23:31.952639 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78375d69-88ff-4b0b-94a1-c54269474160 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:23:31.963827 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78375d69-88ff-4b0b-94a1-c54269474160 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:23:31.967335 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff6c66-2da7-4214-903a-a722e2a88238 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:23:31.967974 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff6c66-2da7-4214-903a-a722e2a88238 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:23:31.968261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff6c66-2da7-4214-903a-a722e2a88238 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:23:31.968541 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff6c66-2da7-4214-903a-a722e2a88238 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:23:31.978959 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff6c66-2da7-4214-903a-a722e2a88238 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:23:31.980586 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff6c66-2da7-4214-903a-a722e2a88238 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:23:31.992469 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 757/1505] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:23:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:23:32.036458 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47caee74-8d45-47ae-a5f8-0575a8c7b684 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:23:32.036752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47caee74-8d45-47ae-a5f8-0575a8c7b684 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:23:32.037039 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47caee74-8d45-47ae-a5f8-0575a8c7b684 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:23:32.038375 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 749/1506] 10.222.0.32 () {52 vars in 829 bytes} [Wed Jun 1 04:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:23:32.041960 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff6c66-2da7-4214-903a-a722e2a88238 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:23:32.104202 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff6c66-2da7-4214-903a-a722e2a88238 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:23:32.108796 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94461497-df70-4086-aba5-beb99b3025ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:23:32.109672 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94461497-df70-4086-aba5-beb99b3025ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:23:32.109960 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94461497-df70-4086-aba5-beb99b3025ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:23:32.110272 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94461497-df70-4086-aba5-beb99b3025ce admin admin] PATH_INFO: `/v3/users/32599d8eb80c4dbca2714f5e82fc32b3` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:23:32.111457 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94461497-df70-4086-aba5-beb99b3025ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=32599d8eb80c4dbca2714f5e82fc32b3)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:23:32.113093 dv-cinder-667108-37-smb devstack@keystone.service[80231]: WARNING py.warnings [None req-94461497-df70-4086-aba5-beb99b3025ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 01 04:23:32.113093 dv-cinder-667108-37-smb devstack@keystone.service[80231]: warnings.warn(msg) Jun 01 04:23:32.113093 dv-cinder-667108-37-smb devstack@keystone.service[80231]: Jun 01 04:23:32.114357 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94461497-df70-4086-aba5-beb99b3025ce admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:23:32.181366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-94461497-df70-4086-aba5-beb99b3025ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32599d8eb80c4dbca2714f5e82fc32b3'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:23:32.182041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-94461497-df70-4086-aba5-beb99b3025ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32599d8eb80c4dbca2714f5e82fc32b3'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:23:32.201101 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-94461497-df70-4086-aba5-beb99b3025ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32599d8eb80c4dbca2714f5e82fc32b3'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:23:32.210476 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-94461497-df70-4086-aba5-beb99b3025ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32599d8eb80c4dbca2714f5e82fc32b3'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:23:32.211183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-94461497-df70-4086-aba5-beb99b3025ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32599d8eb80c4dbca2714f5e82fc32b3'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:23:32.219868 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:23:32.231591 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 758/1507] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:23:32 2022] DELETE /identity/v3/users/32599d8eb80c4dbca2714f5e82fc32b3 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:23:32.236147 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c245d-9c65-46e4-8400-c1d9b92147dc None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:23:32.236433 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c245d-9c65-46e4-8400-c1d9b92147dc None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:23:32.236713 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c245d-9c65-46e4-8400-c1d9b92147dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:23:32.256350 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-418c245d-9c65-46e4-8400-c1d9b92147dc None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:23:32.257568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-418c245d-9c65-46e4-8400-c1d9b92147dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:23:32.317716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 750/1508] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:23:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:23:32.327642 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94461497-df70-4086-aba5-beb99b3025ce admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:23:32.329246 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-94461497-df70-4086-aba5-beb99b3025ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:23:32.389659 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94461497-df70-4086-aba5-beb99b3025ce admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:23:32.393361 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6bf55e-8a7d-4ba0-85f4-19b259d254f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:23:32.394095 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bf55e-8a7d-4ba0-85f4-19b259d254f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:23:32.394417 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bf55e-8a7d-4ba0-85f4-19b259d254f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:23:32.394697 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bf55e-8a7d-4ba0-85f4-19b259d254f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:23:32.404520 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6bf55e-8a7d-4ba0-85f4-19b259d254f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:23:32.405969 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6bf55e-8a7d-4ba0-85f4-19b259d254f7 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:23:32.416351 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 759/1509] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:23:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:23:32.769147 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c245d-9c65-46e4-8400-c1d9b92147dc None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:23:32.771004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-418c245d-9c65-46e4-8400-c1d9b92147dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:23:32.784096 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c245d-9c65-46e4-8400-c1d9b92147dc None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:23:32.789842 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996bc85c-14b4-405e-be62-803fcf1d5d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:23:32.790899 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bc85c-14b4-405e-be62-803fcf1d5d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:23:32.791276 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bc85c-14b4-405e-be62-803fcf1d5d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:23:32.791701 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bc85c-14b4-405e-be62-803fcf1d5d71 admin admin] PATH_INFO: `/v3/projects/a12ceec5041344919a7f3614e4edb530` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:23:32.793335 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996bc85c-14b4-405e-be62-803fcf1d5d71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a12ceec5041344919a7f3614e4edb530)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:23:32.795054 dv-cinder-667108-37-smb devstack@keystone.service[80232]: WARNING py.warnings [None req-996bc85c-14b4-405e-be62-803fcf1d5d71 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 01 04:23:32.795054 dv-cinder-667108-37-smb devstack@keystone.service[80232]: warnings.warn(msg) Jun 01 04:23:32.795054 dv-cinder-667108-37-smb devstack@keystone.service[80232]: Jun 01 04:23:32.795575 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996bc85c-14b4-405e-be62-803fcf1d5d71 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:23:32.861573 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-996bc85c-14b4-405e-be62-803fcf1d5d71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a12ceec5041344919a7f3614e4edb530', 'request_id': 'req-996bc85c-14b4-405e-be62-803fcf1d5d71'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:23:32.871048 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-996bc85c-14b4-405e-be62-803fcf1d5d71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a12ceec5041344919a7f3614e4edb530', 'request_id': 'req-996bc85c-14b4-405e-be62-803fcf1d5d71'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:23:32.877521 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-996bc85c-14b4-405e-be62-803fcf1d5d71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a12ceec5041344919a7f3614e4edb530', 'request_id': 'req-996bc85c-14b4-405e-be62-803fcf1d5d71'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:23:32.897536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-996bc85c-14b4-405e-be62-803fcf1d5d71 admin admin] The token cache is being invalidate because project a12ceec5041344919a7f3614e4edb530 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:23:32.897824 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-996bc85c-14b4-405e-be62-803fcf1d5d71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:23:32.898518 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-996bc85c-14b4-405e-be62-803fcf1d5d71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:23:32.900561 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 751/1510] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:23:32 2022] DELETE /identity/v3/projects/a12ceec5041344919a7f3614e4edb530 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:23:42.411986 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=29 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:23:42.894401 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:25:20.432484 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727713c4-a990-4a7e-a92b-51fe28156c08 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:25:20.433063 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727713c4-a990-4a7e-a92b-51fe28156c08 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:25:20.433170 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727713c4-a990-4a7e-a92b-51fe28156c08 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:25:20.434609 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 760/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 1 04:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:25:20.439685 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cacc1-9515-43e7-9421-4b2d301f08d8 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:25:20.440233 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cacc1-9515-43e7-9421-4b2d301f08d8 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:25:20.440233 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cacc1-9515-43e7-9421-4b2d301f08d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:25:20.459425 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-247cacc1-9515-43e7-9421-4b2d301f08d8 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:25:20.460682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-247cacc1-9515-43e7-9421-4b2d301f08d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:25:20.521410 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 752/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 1 04:25:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:25:20.690292 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727713c4-a990-4a7e-a92b-51fe28156c08 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:25:20.691983 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-727713c4-a990-4a7e-a92b-51fe28156c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:25:20.764924 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727713c4-a990-4a7e-a92b-51fe28156c08 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:25:20.770764 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4f172-82d4-40ac-8863-c75a4522d80b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:25:20.771409 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4f172-82d4-40ac-8863-c75a4522d80b service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:25:20.771690 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4f172-82d4-40ac-8863-c75a4522d80b service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:25:20.771967 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4f172-82d4-40ac-8863-c75a4522d80b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:25:20.780247 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4f172-82d4-40ac-8863-c75a4522d80b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:25:20.782481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4f172-82d4-40ac-8863-c75a4522d80b service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:25:20.791881 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 761/1513] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:25:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:25:21.670835 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f043fa-4c82-4a4d-b5fb-d70f24f1498e None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:25:21.671411 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f043fa-4c82-4a4d-b5fb-d70f24f1498e None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:25:21.671411 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f043fa-4c82-4a4d-b5fb-d70f24f1498e None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:25:21.672773 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 753/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 1 04:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:25:21.677642 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568f146-3be9-4e4f-a8da-e3fea3f62645 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:25:21.678075 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568f146-3be9-4e4f-a8da-e3fea3f62645 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:25:21.678256 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568f146-3be9-4e4f-a8da-e3fea3f62645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:25:21.696727 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c568f146-3be9-4e4f-a8da-e3fea3f62645 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:25:21.698213 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c568f146-3be9-4e4f-a8da-e3fea3f62645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:25:21.706555 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 762/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 1 04:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:25:21.835900 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695be15-0b00-463b-8ce9-cd5652565d07 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:25:21.836196 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695be15-0b00-463b-8ce9-cd5652565d07 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:25:21.836481 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695be15-0b00-463b-8ce9-cd5652565d07 None None] PATH_INFO: `/v3` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:25:21.837810 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 754/1516] 10.222.0.50 () {54 vars in 925 bytes} [Wed Jun 1 04:25:21 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:25:21.845242 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa255626-e7bb-44d8-8504-7ff18bc4f3ee None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:25:21.845637 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa255626-e7bb-44d8-8504-7ff18bc4f3ee None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:25:21.846023 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa255626-e7bb-44d8-8504-7ff18bc4f3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:25:21.861333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695be15-0b00-463b-8ce9-cd5652565d07 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:25:21.864395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-fa255626-e7bb-44d8-8504-7ff18bc4f3ee None None] MFA Rules not processed for user `0433f6219478476286ea27c5c82d41a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:25:21.865597 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-fa255626-e7bb-44d8-8504-7ff18bc4f3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:25:21.876700 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695be15-0b00-463b-8ce9-cd5652565d07 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:25:21.882386 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f671ba4-6516-46b0-926f-119d2f67c2d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:25:21.883034 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f671ba4-6516-46b0-926f-119d2f67c2d3 service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:25:21.883316 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f671ba4-6516-46b0-926f-119d2f67c2d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:25:21.883597 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f671ba4-6516-46b0-926f-119d2f67c2d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:25:21.893723 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f671ba4-6516-46b0-926f-119d2f67c2d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:25:21.895422 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f671ba4-6516-46b0-926f-119d2f67c2d3 service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:25:21.906271 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 755/1517] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:25:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:25:21.932276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 763/1518] 10.222.0.50 () {58 vars in 1015 bytes} [Wed Jun 1 04:25:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:25:30.979487 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42ea57-3d04-45ea-8c5e-fb24ce534b24 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:25:30.980186 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42ea57-3d04-45ea-8c5e-fb24ce534b24 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:25:30.980186 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42ea57-3d04-45ea-8c5e-fb24ce534b24 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:25:30.981291 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 756/1519] 10.222.0.32 () {54 vars in 960 bytes} [Wed Jun 1 04:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:25:30.987085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d81a03-c57a-4af1-b29a-74beec882977 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:25:30.987640 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d81a03-c57a-4af1-b29a-74beec882977 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:25:30.987797 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d81a03-c57a-4af1-b29a-74beec882977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:25:31.008784 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-04d81a03-c57a-4af1-b29a-74beec882977 None None] MFA Rules not processed for user `0433f6219478476286ea27c5c82d41a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:25:31.010076 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-04d81a03-c57a-4af1-b29a-74beec882977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:25:31.019539 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 764/1520] 10.222.0.32 () {58 vars in 1057 bytes} [Wed Jun 1 04:25:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:25:31.026994 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42ea57-3d04-45ea-8c5e-fb24ce534b24 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:25:31.041005 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42ea57-3d04-45ea-8c5e-fb24ce534b24 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:25:31.045891 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d658b2-9981-4d7a-8d8f-a69590079d06 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0433f6219478476286ea27c5c82d41a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:25:31.047105 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d658b2-9981-4d7a-8d8f-a69590079d06 service placement] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:25:31.047368 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d658b2-9981-4d7a-8d8f-a69590079d06 service placement] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:25:31.047685 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d658b2-9981-4d7a-8d8f-a69590079d06 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:25:31.056510 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d658b2-9981-4d7a-8d8f-a69590079d06 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:25:31.057920 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d658b2-9981-4d7a-8d8f-a69590079d06 service placement] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:25:31.068175 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 757/1521] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:25:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:25:33.197269 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c5df9-b965-4710-9d46-730be932cb4f None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:25:33.197823 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c5df9-b965-4710-9d46-730be932cb4f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:25:33.197823 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c5df9-b965-4710-9d46-730be932cb4f None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:25:33.199277 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 765/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 1 04:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:25:33.204514 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c09b17-cb64-444b-95d2-70042ee77160 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:25:33.204928 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c09b17-cb64-444b-95d2-70042ee77160 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:25:33.205077 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c09b17-cb64-444b-95d2-70042ee77160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:25:33.223708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-57c09b17-cb64-444b-95d2-70042ee77160 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:25:33.224903 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-57c09b17-cb64-444b-95d2-70042ee77160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:25:33.232775 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 758/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 1 04:25:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:25:33.384944 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c5df9-b965-4710-9d46-730be932cb4f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:25:33.402872 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c5df9-b965-4710-9d46-730be932cb4f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:25:33.408974 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ae1da-cbac-45e6-91d8-494c27db9f3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:25:33.409567 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ae1da-cbac-45e6-91d8-494c27db9f3c service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:25:33.409846 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ae1da-cbac-45e6-91d8-494c27db9f3c service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:25:33.410156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ae1da-cbac-45e6-91d8-494c27db9f3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:25:33.420182 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ae1da-cbac-45e6-91d8-494c27db9f3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:25:33.421822 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ae1da-cbac-45e6-91d8-494c27db9f3c service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:25:33.432484 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 766/1524] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:25:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:25:34.306031 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a35e3-8b69-4b1b-9755-737dfd145698 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:25:34.306568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a35e3-8b69-4b1b-9755-737dfd145698 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:25:34.306680 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a35e3-8b69-4b1b-9755-737dfd145698 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:25:34.308027 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 759/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 1 04:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:25:34.313491 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77f8e7-ae9d-4df6-a078-afff3638a849 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:25:34.313965 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77f8e7-ae9d-4df6-a078-afff3638a849 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:25:34.314101 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77f8e7-ae9d-4df6-a078-afff3638a849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:25:34.332092 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7d77f8e7-ae9d-4df6-a078-afff3638a849 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:25:34.333288 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7d77f8e7-ae9d-4df6-a078-afff3638a849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:25:34.341195 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 767/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 1 04:25:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:25:34.490926 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a35e3-8b69-4b1b-9755-737dfd145698 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:25:34.505707 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a35e3-8b69-4b1b-9755-737dfd145698 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:25:34.511083 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352a29c-2d2f-4ef1-a331-eabc7729b168 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:25:34.511714 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352a29c-2d2f-4ef1-a331-eabc7729b168 service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:25:34.511997 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352a29c-2d2f-4ef1-a331-eabc7729b168 service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:25:34.512273 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352a29c-2d2f-4ef1-a331-eabc7729b168 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:25:34.521036 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352a29c-2d2f-4ef1-a331-eabc7729b168 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:25:34.522649 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352a29c-2d2f-4ef1-a331-eabc7729b168 service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:25:34.532054 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 760/1527] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:25:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:25:38.560025 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2781d-7f44-4037-80f6-9c6056bfb0f4 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:25:38.560593 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2781d-7f44-4037-80f6-9c6056bfb0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:25:38.560593 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2781d-7f44-4037-80f6-9c6056bfb0f4 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:25:38.562536 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 768/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 1 04:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:25:38.567715 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e324e36-dad6-4079-83bb-159904d4e3e2 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:25:38.568155 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e324e36-dad6-4079-83bb-159904d4e3e2 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:25:38.568302 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e324e36-dad6-4079-83bb-159904d4e3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:25:38.586379 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-2e324e36-dad6-4079-83bb-159904d4e3e2 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:25:38.587576 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-2e324e36-dad6-4079-83bb-159904d4e3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:25:38.595614 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 761/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 1 04:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:25:38.632876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2781d-7f44-4037-80f6-9c6056bfb0f4 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:25:38.634594 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-eca2781d-7f44-4037-80f6-9c6056bfb0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:25:38.695167 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:25:38.700127 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2781d-7f44-4037-80f6-9c6056bfb0f4 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:25:38.703799 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d47cca-5f4f-4454-a858-e0ff989af793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:25:38.704511 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d47cca-5f4f-4454-a858-e0ff989af793 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:25:38.704727 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d47cca-5f4f-4454-a858-e0ff989af793 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:25:38.704997 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d47cca-5f4f-4454-a858-e0ff989af793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:25:38.714687 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d47cca-5f4f-4454-a858-e0ff989af793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:25:38.716107 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d47cca-5f4f-4454-a858-e0ff989af793 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:25:38.725639 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 769/1530] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:25:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:25:40.964897 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a92f27-a6ad-4de3-975e-2feffcc6c6e2 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:25:40.965429 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a92f27-a6ad-4de3-975e-2feffcc6c6e2 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:25:40.965429 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a92f27-a6ad-4de3-975e-2feffcc6c6e2 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:25:40.966847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 762/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 1 04:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:25:40.972004 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e514952-0600-4269-9cea-445f2310e931 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:25:40.972463 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e514952-0600-4269-9cea-445f2310e931 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:25:40.972569 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e514952-0600-4269-9cea-445f2310e931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:25:40.991665 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-4e514952-0600-4269-9cea-445f2310e931 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:25:40.992926 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4e514952-0600-4269-9cea-445f2310e931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:25:41.001442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 770/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 1 04:25:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:25:41.037231 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a92f27-a6ad-4de3-975e-2feffcc6c6e2 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:25:41.042839 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-b5a92f27-a6ad-4de3-975e-2feffcc6c6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:25:41.056286 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a92f27-a6ad-4de3-975e-2feffcc6c6e2 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:25:41.060029 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02df8c1-a8fe-4aab-94db-219f9c50d624 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:25:41.060658 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02df8c1-a8fe-4aab-94db-219f9c50d624 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:25:41.061128 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02df8c1-a8fe-4aab-94db-219f9c50d624 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:25:41.061674 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02df8c1-a8fe-4aab-94db-219f9c50d624 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:25:41.072627 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02df8c1-a8fe-4aab-94db-219f9c50d624 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:25:41.074072 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02df8c1-a8fe-4aab-94db-219f9c50d624 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:25:41.083941 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 763/1533] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:25:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:25:44.684731 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb979f23-360a-4e77-84bd-ffef78b0f127 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:25:44.685313 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb979f23-360a-4e77-84bd-ffef78b0f127 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:25:44.685313 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb979f23-360a-4e77-84bd-ffef78b0f127 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:25:44.687264 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 771/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 1 04:25:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:25:44.692725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b457be-be48-4609-83f9-040b71a601a9 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:25:44.693177 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b457be-be48-4609-83f9-040b71a601a9 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:25:44.693330 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b457be-be48-4609-83f9-040b71a601a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:25:44.700078 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=58 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:25:44.713157 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-d5b457be-be48-4609-83f9-040b71a601a9 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:25:44.714416 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d5b457be-be48-4609-83f9-040b71a601a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:25:44.722789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 764/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 1 04:25:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:25:44.997520 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb979f23-360a-4e77-84bd-ffef78b0f127 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:25:44.999884 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cb979f23-360a-4e77-84bd-ffef78b0f127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:25:45.059109 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb979f23-360a-4e77-84bd-ffef78b0f127 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:25:45.063505 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15c3de-a9ef-492c-bf26-8cde3cf6b37e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:25:45.064957 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15c3de-a9ef-492c-bf26-8cde3cf6b37e service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:25:45.065244 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15c3de-a9ef-492c-bf26-8cde3cf6b37e service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:25:45.065706 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15c3de-a9ef-492c-bf26-8cde3cf6b37e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:25:45.075878 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15c3de-a9ef-492c-bf26-8cde3cf6b37e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:25:45.077939 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15c3de-a9ef-492c-bf26-8cde3cf6b37e service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:25:45.088164 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 772/1536] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:25:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:25:47.385026 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6c6e2-dc39-4801-abbe-12c0e2c26651 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:25:47.385581 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6c6e2-dc39-4801-abbe-12c0e2c26651 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:25:47.385581 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6c6e2-dc39-4801-abbe-12c0e2c26651 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:25:47.386988 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 765/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 1 04:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:25:47.392510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6f745-35e2-4921-8692-5e6510e9cf44 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:25:47.392987 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6f745-35e2-4921-8692-5e6510e9cf44 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:25:47.393087 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6f745-35e2-4921-8692-5e6510e9cf44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:25:47.412334 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-76d6f745-35e2-4921-8692-5e6510e9cf44 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:25:47.413463 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-76d6f745-35e2-4921-8692-5e6510e9cf44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:25:47.421873 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 773/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 1 04:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:25:47.693150 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6c6e2-dc39-4801-abbe-12c0e2c26651 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:25:47.694888 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-efb6c6e2-dc39-4801-abbe-12c0e2c26651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:25:47.708350 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6c6e2-dc39-4801-abbe-12c0e2c26651 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:25:47.711832 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79056414-1a7c-4530-ac6b-c6e676929d2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:25:47.712468 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79056414-1a7c-4530-ac6b-c6e676929d2b service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:25:47.712750 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79056414-1a7c-4530-ac6b-c6e676929d2b service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:25:47.713025 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79056414-1a7c-4530-ac6b-c6e676929d2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:25:47.722354 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79056414-1a7c-4530-ac6b-c6e676929d2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:25:47.723789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79056414-1a7c-4530-ac6b-c6e676929d2b service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:25:47.733802 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 766/1539] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:25:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:25:57.407286 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=36 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:25:57.729104 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=8 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:23.186042 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cb3fb-4e18-41b5-bad2-d61e2c8fed52 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:23.186680 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cb3fb-4e18-41b5-bad2-d61e2c8fed52 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:23.186839 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cb3fb-4e18-41b5-bad2-d61e2c8fed52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:23.221046 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-277cb3fb-4e18-41b5-bad2-d61e2c8fed52 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:23.222294 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-277cb3fb-4e18-41b5-bad2-d61e2c8fed52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:23.234602 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 774/1540] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:27:23.243420 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f715d9-99ea-44fe-ae45-48e0f8e02111 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:23.244333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f715d9-99ea-44fe-ae45-48e0f8e02111 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:23.244776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f715d9-99ea-44fe-ae45-48e0f8e02111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:23.281467 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ddde8-d4f1-46e8-95d8-3bcd55567dc2 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:23.281790 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ddde8-d4f1-46e8-95d8-3bcd55567dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:23.282293 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ddde8-d4f1-46e8-95d8-3bcd55567dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:23.282945 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-d4f715d9-99ea-44fe-ae45-48e0f8e02111 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:23.284821 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d4f715d9-99ea-44fe-ae45-48e0f8e02111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:23.303605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 767/1541] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:23.314109 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f715d9-99ea-44fe-ae45-48e0f8e02111 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:23.314389 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d85ddde8-d4f1-46e8-95d8-3bcd55567dc2 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:23.315630 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d85ddde8-d4f1-46e8-95d8-3bcd55567dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:23.325134 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f715d9-99ea-44fe-ae45-48e0f8e02111 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:23.331888 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 775/1542] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:23.338707 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd13f1-5b8f-44ce-814b-f44537a06db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:23.339628 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd13f1-5b8f-44ce-814b-f44537a06db7 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:23.340086 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd13f1-5b8f-44ce-814b-f44537a06db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:23.340527 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd13f1-5b8f-44ce-814b-f44537a06db7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:23.342001 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd13f1-5b8f-44ce-814b-f44537a06db7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:27:23.342637 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd13f1-5b8f-44ce-814b-f44537a06db7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:23.344565 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd13f1-5b8f-44ce-814b-f44537a06db7 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:23.352731 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5ba06-29c9-4a71-b26e-c7ab6ff856c5 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:23.353039 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5ba06-29c9-4a71-b26e-c7ab6ff856c5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:23.353420 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5ba06-29c9-4a71-b26e-c7ab6ff856c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:23.367170 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 768/1543] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:27:23.383258 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd13f1-5b8f-44ce-814b-f44537a06db7 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:23.383736 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-21f5ba06-29c9-4a71-b26e-c7ab6ff856c5 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:23.384980 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-21f5ba06-29c9-4a71-b26e-c7ab6ff856c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:23.399598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd13f1-5b8f-44ce-814b-f44537a06db7 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:23.406062 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 776/1544] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:27:23.406062 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e421fc7-efb2-4b63-812a-501aae12371e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:23.406062 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e421fc7-efb2-4b63-812a-501aae12371e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:23.406062 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e421fc7-efb2-4b63-812a-501aae12371e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:23.411399 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42c1c1-44c2-4845-8c52-0c7a39ec5ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:23.412471 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42c1c1-44c2-4845-8c52-0c7a39ec5ce4 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:23.412958 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42c1c1-44c2-4845-8c52-0c7a39ec5ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:23.413430 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42c1c1-44c2-4845-8c52-0c7a39ec5ce4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:23.414340 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb42c1c1-44c2-4845-8c52-0c7a39ec5ce4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:23.415680 dv-cinder-667108-37-smb devstack@keystone.service[80232]: WARNING py.warnings [None req-fb42c1c1-44c2-4845-8c52-0c7a39ec5ce4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 01 04:27:23.415680 dv-cinder-667108-37-smb devstack@keystone.service[80232]: warnings.warn(msg) Jun 01 04:27:23.415680 dv-cinder-667108-37-smb devstack@keystone.service[80232]: Jun 01 04:27:23.416883 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb42c1c1-44c2-4845-8c52-0c7a39ec5ce4 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:23.443856 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2e421fc7-efb2-4b63-812a-501aae12371e None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:23.445400 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2e421fc7-efb2-4b63-812a-501aae12371e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:23.459781 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 777/1545] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:23.460654 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e421fc7-efb2-4b63-812a-501aae12371e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:23.471012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 769/1546] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:27:23 2022] POST /identity/v3/projects => generated 385 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:27:23.472353 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a17824-bc04-4bb9-8f9c-0ff01974e3a5 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:23.472598 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e421fc7-efb2-4b63-812a-501aae12371e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:23.472717 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a17824-bc04-4bb9-8f9c-0ff01974e3a5 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:23.472926 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a17824-bc04-4bb9-8f9c-0ff01974e3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:23.493022 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-d4a17824-bc04-4bb9-8f9c-0ff01974e3a5 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:23.494404 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d4a17824-bc04-4bb9-8f9c-0ff01974e3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:23.544011 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf9dc8-2366-4916-8667-c84a9cc396f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:23.544686 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf9dc8-2366-4916-8667-c84a9cc396f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:23.544963 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf9dc8-2366-4916-8667-c84a9cc396f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:23.545238 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf9dc8-2366-4916-8667-c84a9cc396f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:23.546144 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf9dc8-2366-4916-8667-c84a9cc396f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:27:23.546458 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf9dc8-2366-4916-8667-c84a9cc396f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:23.547461 dv-cinder-667108-37-smb devstack@keystone.service[80231]: WARNING py.warnings [None req-5bbf9dc8-2366-4916-8667-c84a9cc396f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 01 04:27:23.547461 dv-cinder-667108-37-smb devstack@keystone.service[80231]: warnings.warn(msg) Jun 01 04:27:23.547461 dv-cinder-667108-37-smb devstack@keystone.service[80231]: Jun 01 04:27:23.548346 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf9dc8-2366-4916-8667-c84a9cc396f7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:23.559997 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 778/1547] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:27:23.561255 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a3bfb-f868-4639-b804-e65c0e6a5e68 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:23.561550 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a3bfb-f868-4639-b804-e65c0e6a5e68 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:23.561829 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a3bfb-f868-4639-b804-e65c0e6a5e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:23.568956 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 770/1548] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:23.570452 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92be48-2a1a-482d-9007-2c7c7660b0a4 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:23.570851 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92be48-2a1a-482d-9007-2c7c7660b0a4 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:23.571241 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92be48-2a1a-482d-9007-2c7c7660b0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:23.589622 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-f72a3bfb-f868-4639-b804-e65c0e6a5e68 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:23.591442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f72a3bfb-f868-4639-b804-e65c0e6a5e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:23.592289 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-5f92be48-2a1a-482d-9007-2c7c7660b0a4 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:23.593433 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-5f92be48-2a1a-482d-9007-2c7c7660b0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:23.599243 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 779/1549] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:23.608708 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5ba95-6e47-4199-8567-cd5bcbf69790 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:23.608708 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5ba95-6e47-4199-8567-cd5bcbf69790 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:23.608708 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5ba95-6e47-4199-8567-cd5bcbf69790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:23.609027 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 771/1550] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:23.609027 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dec99f-6510-40dc-bef2-8b55398b56be None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:23.609027 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dec99f-6510-40dc-bef2-8b55398b56be None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:23.609027 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dec99f-6510-40dc-bef2-8b55398b56be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:23.621585 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-bfc5ba95-6e47-4199-8567-cd5bcbf69790 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:23.623186 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-bfc5ba95-6e47-4199-8567-cd5bcbf69790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:23.627178 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-f4dec99f-6510-40dc-bef2-8b55398b56be None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:23.628346 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f4dec99f-6510-40dc-bef2-8b55398b56be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:23.631584 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 780/1551] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:23.632340 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5ba95-6e47-4199-8567-cd5bcbf69790 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:23.639346 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 772/1552] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:23.640774 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96da0c3-13a8-4a1f-a6ae-d74aa977a0d2 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:23.641069 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96da0c3-13a8-4a1f-a6ae-d74aa977a0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:23.641357 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96da0c3-13a8-4a1f-a6ae-d74aa977a0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:23.642200 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5ba95-6e47-4199-8567-cd5bcbf69790 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:23.650107 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b1845-c47b-438b-ba38-f86c29c181d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:23.650778 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b1845-c47b-438b-ba38-f86c29c181d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:23.651056 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b1845-c47b-438b-ba38-f86c29c181d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:23.651328 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b1845-c47b-438b-ba38-f86c29c181d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:23.652008 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b1845-c47b-438b-ba38-f86c29c181d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:23.653016 dv-cinder-667108-37-smb devstack@keystone.service[80231]: WARNING py.warnings [None req-bf2b1845-c47b-438b-ba38-f86c29c181d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 01 04:27:23.653016 dv-cinder-667108-37-smb devstack@keystone.service[80231]: warnings.warn(msg) Jun 01 04:27:23.653016 dv-cinder-667108-37-smb devstack@keystone.service[80231]: Jun 01 04:27:23.654809 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b1845-c47b-438b-ba38-f86c29c181d5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:23.659803 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-d96da0c3-13a8-4a1f-a6ae-d74aa977a0d2 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:23.661097 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d96da0c3-13a8-4a1f-a6ae-d74aa977a0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:23.669300 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 773/1553] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:23.670151 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96da0c3-13a8-4a1f-a6ae-d74aa977a0d2 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:23.679820 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96da0c3-13a8-4a1f-a6ae-d74aa977a0d2 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:23.684451 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 781/1554] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:27:23 2022] POST /identity/v3/users => generated 293 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:23.684451 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c07cdf-ed10-4b84-b785-2590cc63f8ec None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:23.684451 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c07cdf-ed10-4b84-b785-2590cc63f8ec None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:23.684451 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c07cdf-ed10-4b84-b785-2590cc63f8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:23.686547 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11041087-2cb2-4b5b-b4e2-8d18491e32fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:23.687243 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11041087-2cb2-4b5b-b4e2-8d18491e32fe admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:23.687481 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11041087-2cb2-4b5b-b4e2-8d18491e32fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:23.687760 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11041087-2cb2-4b5b-b4e2-8d18491e32fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:23.688441 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11041087-2cb2-4b5b-b4e2-8d18491e32fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:23.690540 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11041087-2cb2-4b5b-b4e2-8d18491e32fe admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:23.702897 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-59c07cdf-ed10-4b84-b785-2590cc63f8ec None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:23.704092 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-59c07cdf-ed10-4b84-b785-2590cc63f8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:23.712317 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 782/1555] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:23.713573 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4a94b-c5a0-4224-b0bd-ba32bc6f5902 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:23.713857 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4a94b-c5a0-4224-b0bd-ba32bc6f5902 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:23.714154 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4a94b-c5a0-4224-b0bd-ba32bc6f5902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:23.721559 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 774/1556] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:27:23 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:23.723314 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b0c2d-acba-4a76-9bc8-595c20b2bb7c None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:23.723687 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b0c2d-acba-4a76-9bc8-595c20b2bb7c None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:23.723984 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b0c2d-acba-4a76-9bc8-595c20b2bb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:23.734138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-08a4a94b-c5a0-4224-b0bd-ba32bc6f5902 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:23.735319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-08a4a94b-c5a0-4224-b0bd-ba32bc6f5902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:23.742854 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-574b0c2d-acba-4a76-9bc8-595c20b2bb7c None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:23.744180 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-574b0c2d-acba-4a76-9bc8-595c20b2bb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:23.804837 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 783/1557] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:23.804837 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4a94b-c5a0-4224-b0bd-ba32bc6f5902 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:23.810423 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 775/1558] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:23.811725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a0023-5313-42ba-8dec-307ffced1fba None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:23.812016 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a0023-5313-42ba-8dec-307ffced1fba None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:23.812298 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a0023-5313-42ba-8dec-307ffced1fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:23.815159 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4a94b-c5a0-4224-b0bd-ba32bc6f5902 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:23.819797 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5510b0e-4503-480a-9c28-ae6ae964291c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:23.820445 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5510b0e-4503-480a-9c28-ae6ae964291c admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:23.820725 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5510b0e-4503-480a-9c28-ae6ae964291c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:23.820996 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5510b0e-4503-480a-9c28-ae6ae964291c admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:23.821840 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5510b0e-4503-480a-9c28-ae6ae964291c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:27:23.822178 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5510b0e-4503-480a-9c28-ae6ae964291c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:23.824074 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5510b0e-4503-480a-9c28-ae6ae964291c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:23.831088 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-8a2a0023-5313-42ba-8dec-307ffced1fba None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:23.832293 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-8a2a0023-5313-42ba-8dec-307ffced1fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:23.836399 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 784/1559] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:27:23.837874 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b7948-eec0-44c4-9853-4c10c8751f32 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:23.838196 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b7948-eec0-44c4-9853-4c10c8751f32 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:23.838477 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b7948-eec0-44c4-9853-4c10c8751f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:23.844398 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 776/1560] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:23.844398 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a0023-5313-42ba-8dec-307ffced1fba None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:23.852223 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a0023-5313-42ba-8dec-307ffced1fba None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:23.856822 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161e9a5-efba-4e72-b34d-92653efd2fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:23.857475 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161e9a5-efba-4e72-b34d-92653efd2fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:23.857759 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161e9a5-efba-4e72-b34d-92653efd2fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:23.858069 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161e9a5-efba-4e72-b34d-92653efd2fa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:23.858855 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161e9a5-efba-4e72-b34d-92653efd2fa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:23.859808 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-da7b7948-eec0-44c4-9853-4c10c8751f32 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:23.860432 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161e9a5-efba-4e72-b34d-92653efd2fa4 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:23.860987 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-da7b7948-eec0-44c4-9853-4c10c8751f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:23.865749 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:23.869034 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 785/1561] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:23.869820 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b7948-eec0-44c4-9853-4c10c8751f32 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:23.875238 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 777/1562] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:23.876182 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161e9a5-efba-4e72-b34d-92653efd2fa4 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:23.880269 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b7948-eec0-44c4-9853-4c10c8751f32 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:23.884802 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be8bdc-9864-493f-a4df-98734b5b4a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:23.885447 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be8bdc-9864-493f-a4df-98734b5b4a71 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:23.885726 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be8bdc-9864-493f-a4df-98734b5b4a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:23.886021 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be8bdc-9864-493f-a4df-98734b5b4a71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:23.886660 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161e9a5-efba-4e72-b34d-92653efd2fa4 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:23.886770 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be8bdc-9864-493f-a4df-98734b5b4a71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:27:23.887030 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be8bdc-9864-493f-a4df-98734b5b4a71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:23.889173 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be8bdc-9864-493f-a4df-98734b5b4a71 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:23.891859 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6de9d-789c-478b-9aa5-61806c5b3af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:23.892524 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6de9d-789c-478b-9aa5-61806c5b3af3 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:23.892807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6de9d-789c-478b-9aa5-61806c5b3af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:23.893115 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6de9d-789c-478b-9aa5-61806c5b3af3 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:23.893805 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6de9d-789c-478b-9aa5-61806c5b3af3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:23.895754 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6de9d-789c-478b-9aa5-61806c5b3af3 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:23.896178 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:23.910070 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 786/1563] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:27:23.910948 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be8bdc-9864-493f-a4df-98734b5b4a71 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:23.922834 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 778/1564] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:27:23 2022] POST /identity/v3/users => generated 290 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:23.922834 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6de9d-789c-478b-9aa5-61806c5b3af3 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:23.923174 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be8bdc-9864-493f-a4df-98734b5b4a71 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:23.925996 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41559d1-177b-475e-bdca-50ab7146b5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:23.926666 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41559d1-177b-475e-bdca-50ab7146b5fc admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:23.926948 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41559d1-177b-475e-bdca-50ab7146b5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:23.927221 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41559d1-177b-475e-bdca-50ab7146b5fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:23.927944 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41559d1-177b-475e-bdca-50ab7146b5fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:27:23.928249 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41559d1-177b-475e-bdca-50ab7146b5fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:23.929833 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41559d1-177b-475e-bdca-50ab7146b5fc admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:23.930851 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6de9d-789c-478b-9aa5-61806c5b3af3 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:23.935415 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a566beec-279d-4d1e-869d-9c181b018b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:23.936055 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566beec-279d-4d1e-869d-9c181b018b4f admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:23.936333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566beec-279d-4d1e-869d-9c181b018b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:23.936606 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566beec-279d-4d1e-869d-9c181b018b4f admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:23.937329 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a566beec-279d-4d1e-869d-9c181b018b4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:27:23.937631 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a566beec-279d-4d1e-869d-9c181b018b4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:23.939246 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a566beec-279d-4d1e-869d-9c181b018b4f admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:23.941831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 787/1565] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:27:23.942651 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41559d1-177b-475e-bdca-50ab7146b5fc admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:23.955834 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 779/1566] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:27:23.956665 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a566beec-279d-4d1e-869d-9c181b018b4f admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:23.959747 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41559d1-177b-475e-bdca-50ab7146b5fc admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:23.964995 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57e45b-eafd-46c1-a3ee-f214a7a0e14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:23.966208 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57e45b-eafd-46c1-a3ee-f214a7a0e14a admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:23.966719 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57e45b-eafd-46c1-a3ee-f214a7a0e14a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:23.967004 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57e45b-eafd-46c1-a3ee-f214a7a0e14a admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:23.967697 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc57e45b-eafd-46c1-a3ee-f214a7a0e14a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:23.969609 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc57e45b-eafd-46c1-a3ee-f214a7a0e14a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:23.969927 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a566beec-279d-4d1e-869d-9c181b018b4f admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:23.974445 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1970438-bfed-4618-a3d1-d445fc6f68be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:23.975086 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1970438-bfed-4618-a3d1-d445fc6f68be admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:23.975368 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1970438-bfed-4618-a3d1-d445fc6f68be admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:23.975664 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1970438-bfed-4618-a3d1-d445fc6f68be admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:23.976395 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1970438-bfed-4618-a3d1-d445fc6f68be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:27:23.976704 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1970438-bfed-4618-a3d1-d445fc6f68be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:23.978299 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1970438-bfed-4618-a3d1-d445fc6f68be admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:23.998995 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 780/1567] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:27:23.998995 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1970438-bfed-4618-a3d1-d445fc6f68be admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:23.999303 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 788/1568] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:27:23 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:23.999303 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57e45b-eafd-46c1-a3ee-f214a7a0e14a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:24.003191 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1970438-bfed-4618-a3d1-d445fc6f68be admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:24.061402 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf6c30-bc8d-4dbf-8e4f-637a6cf73f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:24.062261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf6c30-bc8d-4dbf-8e4f-637a6cf73f7d admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:24.062652 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf6c30-bc8d-4dbf-8e4f-637a6cf73f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:24.063036 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf6c30-bc8d-4dbf-8e4f-637a6cf73f7d admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:24.063146 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57e45b-eafd-46c1-a3ee-f214a7a0e14a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:24.063941 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf6c30-bc8d-4dbf-8e4f-637a6cf73f7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:27:24.064375 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf6c30-bc8d-4dbf-8e4f-637a6cf73f7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:24.066105 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf6c30-bc8d-4dbf-8e4f-637a6cf73f7d admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:24.068032 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b55fd-3c47-4d0c-9c37-4306bf6902c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:24.069226 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b55fd-3c47-4d0c-9c37-4306bf6902c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:24.069515 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b55fd-3c47-4d0c-9c37-4306bf6902c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:24.069793 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b55fd-3c47-4d0c-9c37-4306bf6902c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:24.070555 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b55fd-3c47-4d0c-9c37-4306bf6902c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:24.072174 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b55fd-3c47-4d0c-9c37-4306bf6902c5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:24.078479 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 781/1569] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:27:24.085644 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 789/1570] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:24.086272 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b55fd-3c47-4d0c-9c37-4306bf6902c5 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:24.086480 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf6c30-bc8d-4dbf-8e4f-637a6cf73f7d admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:24.096460 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b55fd-3c47-4d0c-9c37-4306bf6902c5 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:24.096684 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf6c30-bc8d-4dbf-8e4f-637a6cf73f7d admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:24.101090 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebd5f3-2f6c-4709-9e3c-3e594f32f5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:24.101358 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbf659-ef07-4b9a-ab7f-aaa65f410444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:24.101790 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebd5f3-2f6c-4709-9e3c-3e594f32f5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:24.102021 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbf659-ef07-4b9a-ab7f-aaa65f410444 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:24.102128 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebd5f3-2f6c-4709-9e3c-3e594f32f5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:24.102314 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbf659-ef07-4b9a-ab7f-aaa65f410444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:24.102415 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebd5f3-2f6c-4709-9e3c-3e594f32f5f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:24.102596 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbf659-ef07-4b9a-ab7f-aaa65f410444 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:24.103088 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddebd5f3-2f6c-4709-9e3c-3e594f32f5f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:24.103270 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fbf659-ef07-4b9a-ab7f-aaa65f410444 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:24.104676 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddebd5f3-2f6c-4709-9e3c-3e594f32f5f0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:24.105159 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fbf659-ef07-4b9a-ab7f-aaa65f410444 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:24.115442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 790/1571] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:24.116172 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebd5f3-2f6c-4709-9e3c-3e594f32f5f0 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:24.125834 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebd5f3-2f6c-4709-9e3c-3e594f32f5f0 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:24.130377 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4fbdf-7e42-4785-86de-0601d9ae853a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:24.131020 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4fbdf-7e42-4785-86de-0601d9ae853a admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:24.131303 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4fbdf-7e42-4785-86de-0601d9ae853a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:24.131581 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4fbdf-7e42-4785-86de-0601d9ae853a admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:24.132259 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd4fbdf-7e42-4785-86de-0601d9ae853a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:24.132425 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 782/1572] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:27:24 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:24.133363 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbf659-ef07-4b9a-ab7f-aaa65f410444 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:24.137339 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd4fbdf-7e42-4785-86de-0601d9ae853a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:24.168095 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 791/1573] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:27:24 2022] POST /identity/v3/projects => generated 393 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:24.169506 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4fbdf-7e42-4785-86de-0601d9ae853a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:24.199019 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbf659-ef07-4b9a-ab7f-aaa65f410444 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:24.231104 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4fbdf-7e42-4785-86de-0601d9ae853a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:24.232552 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:24.236155 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1364d-e023-4bde-af0b-39d47bb13a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:24.236863 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1364d-e023-4bde-af0b-39d47bb13a47 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:24.237153 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1364d-e023-4bde-af0b-39d47bb13a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:24.237433 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1364d-e023-4bde-af0b-39d47bb13a47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:24.238168 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb1364d-e023-4bde-af0b-39d47bb13a47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:24.240085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb1364d-e023-4bde-af0b-39d47bb13a47 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:24.259097 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f503c-eba8-4376-ad7e-a82fa4387410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:24.259864 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f503c-eba8-4376-ad7e-a82fa4387410 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:24.260154 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f503c-eba8-4376-ad7e-a82fa4387410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:24.260456 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f503c-eba8-4376-ad7e-a82fa4387410 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:24.261133 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f503c-eba8-4376-ad7e-a82fa4387410 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:24.263704 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f503c-eba8-4376-ad7e-a82fa4387410 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:24.269937 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 792/1574] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:27:24 2022] POST /identity/v3/projects => generated 369 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:24.269937 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1364d-e023-4bde-af0b-39d47bb13a47 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:24.280199 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:24.291155 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 783/1575] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:27:24 2022] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:24.292281 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f503c-eba8-4376-ad7e-a82fa4387410 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:24.330575 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1364d-e023-4bde-af0b-39d47bb13a47 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:24.355404 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f503c-eba8-4376-ad7e-a82fa4387410 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:24.360096 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ecf60-5551-421a-8a61-07a9b576a5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:24.360756 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ecf60-5551-421a-8a61-07a9b576a5ea admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:24.361045 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ecf60-5551-421a-8a61-07a9b576a5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:24.361327 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ecf60-5551-421a-8a61-07a9b576a5ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:24.362039 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ecf60-5551-421a-8a61-07a9b576a5ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:24.363960 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ecf60-5551-421a-8a61-07a9b576a5ea admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:24.388536 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4186eb5-8afe-4ca2-b795-47e61a6bc6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:24.389136 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4186eb5-8afe-4ca2-b795-47e61a6bc6db admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:24.389425 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4186eb5-8afe-4ca2-b795-47e61a6bc6db admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:24.389706 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4186eb5-8afe-4ca2-b795-47e61a6bc6db admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:24.390427 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4186eb5-8afe-4ca2-b795-47e61a6bc6db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:24.390902 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 784/1576] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:27:24 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:24.391721 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ecf60-5551-421a-8a61-07a9b576a5ea admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:24.392401 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4186eb5-8afe-4ca2-b795-47e61a6bc6db admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:24.416502 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 793/1577] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:27:24 2022] POST /identity/v3/users => generated 284 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:24.416502 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4186eb5-8afe-4ca2-b795-47e61a6bc6db admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:24.423867 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4186eb5-8afe-4ca2-b795-47e61a6bc6db admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:24.455309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ecf60-5551-421a-8a61-07a9b576a5ea admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:24.459967 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48fe30-2ce4-4401-b213-a875e702c67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:24.460853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48fe30-2ce4-4401-b213-a875e702c67c admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:24.461141 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48fe30-2ce4-4401-b213-a875e702c67c admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:24.461436 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48fe30-2ce4-4401-b213-a875e702c67c admin admin] PATH_INFO: `/v3/projects/10aba496031d459896c5b5caef19dc77/users/01cbcd59d95f497ea9071ee7be5e3f5c/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:24.476570 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48fe30-2ce4-4401-b213-a875e702c67c admin admin] RBAC: Authorizing `identity:create_grant(project_id=10aba496031d459896c5b5caef19dc77, user_id=01cbcd59d95f497ea9071ee7be5e3f5c, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:24.477617 dv-cinder-667108-37-smb devstack@keystone.service[80232]: WARNING py.warnings [None req-5c48fe30-2ce4-4401-b213-a875e702c67c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 01 04:27:24.477617 dv-cinder-667108-37-smb devstack@keystone.service[80232]: warnings.warn(msg) Jun 01 04:27:24.477617 dv-cinder-667108-37-smb devstack@keystone.service[80232]: Jun 01 04:27:24.479595 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48fe30-2ce4-4401-b213-a875e702c67c admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:24.481079 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cec2f8-3fe2-4683-811c-cef938049dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:24.481785 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cec2f8-3fe2-4683-811c-cef938049dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:24.482095 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cec2f8-3fe2-4683-811c-cef938049dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:24.482375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cec2f8-3fe2-4683-811c-cef938049dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:24.483096 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cec2f8-3fe2-4683-811c-cef938049dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:24.484858 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cec2f8-3fe2-4683-811c-cef938049dc0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:24.493611 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 785/1578] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:27:24 2022] PUT /identity/v3/projects/10aba496031d459896c5b5caef19dc77/users/01cbcd59d95f497ea9071ee7be5e3f5c/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:24.494583 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48fe30-2ce4-4401-b213-a875e702c67c admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:24.498109 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 794/1579] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:24.498109 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cec2f8-3fe2-4683-811c-cef938049dc0 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:24.505882 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cec2f8-3fe2-4683-811c-cef938049dc0 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:24.533187 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:24.547812 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:24.564603 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314d764-a8cf-497b-8642-0edfcdbc6fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:24.565296 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314d764-a8cf-497b-8642-0edfcdbc6fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:24.565583 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314d764-a8cf-497b-8642-0edfcdbc6fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:24.565863 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314d764-a8cf-497b-8642-0edfcdbc6fa8 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:24.566583 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314d764-a8cf-497b-8642-0edfcdbc6fa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:24.568524 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48fe30-2ce4-4401-b213-a875e702c67c admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:24.568665 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314d764-a8cf-497b-8642-0edfcdbc6fa8 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:24.573538 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fef7b7-6b04-4187-b1b6-2fd46e312ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:24.574242 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fef7b7-6b04-4187-b1b6-2fd46e312ff4 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:24.574548 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fef7b7-6b04-4187-b1b6-2fd46e312ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:24.574937 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fef7b7-6b04-4187-b1b6-2fd46e312ff4 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:24.576357 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fef7b7-6b04-4187-b1b6-2fd46e312ff4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:24.579466 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fef7b7-6b04-4187-b1b6-2fd46e312ff4 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:24.589720 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 795/1580] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:27:24 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:24.590848 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314d764-a8cf-497b-8642-0edfcdbc6fa8 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:24.600334 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314d764-a8cf-497b-8642-0edfcdbc6fa8 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:24.606389 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 786/1581] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:27:24 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:24.606389 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fef7b7-6b04-4187-b1b6-2fd46e312ff4 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:24.606618 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150014d-af16-43cd-80c7-816135d1b511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:24.606618 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150014d-af16-43cd-80c7-816135d1b511 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:24.606618 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150014d-af16-43cd-80c7-816135d1b511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:24.606618 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150014d-af16-43cd-80c7-816135d1b511 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:24.607000 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150014d-af16-43cd-80c7-816135d1b511 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:24.608922 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150014d-af16-43cd-80c7-816135d1b511 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:24.613940 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fef7b7-6b04-4187-b1b6-2fd46e312ff4 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:24.618793 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e32c6f-217f-411f-95e7-13622aaa64e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:24.619529 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e32c6f-217f-411f-95e7-13622aaa64e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:24.619796 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e32c6f-217f-411f-95e7-13622aaa64e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:24.620354 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e32c6f-217f-411f-95e7-13622aaa64e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:24.620794 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e32c6f-217f-411f-95e7-13622aaa64e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:24.623784 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e32c6f-217f-411f-95e7-13622aaa64e3 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:24.630383 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 796/1582] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:27:24 2022] POST /identity/v3/users => generated 285 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:24.631253 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150014d-af16-43cd-80c7-816135d1b511 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:24.641758 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150014d-af16-43cd-80c7-816135d1b511 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:24.646393 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85986f-c806-470f-b88c-3e4c4b6f2282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:24.647051 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85986f-c806-470f-b88c-3e4c4b6f2282 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:24.647331 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85986f-c806-470f-b88c-3e4c4b6f2282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:24.647608 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85986f-c806-470f-b88c-3e4c4b6f2282 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:24.648279 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca85986f-c806-470f-b88c-3e4c4b6f2282 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:24.651658 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 787/1583] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:27:24 2022] POST /identity/v3/users => generated 289 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:24.651658 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e32c6f-217f-411f-95e7-13622aaa64e3 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:24.651896 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca85986f-c806-470f-b88c-3e4c4b6f2282 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:24.659600 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e32c6f-217f-411f-95e7-13622aaa64e3 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:24.665202 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca49be-ba08-4880-992f-f05fd190571a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:24.665869 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca49be-ba08-4880-992f-f05fd190571a admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:24.666191 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca49be-ba08-4880-992f-f05fd190571a admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:24.666471 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca49be-ba08-4880-992f-f05fd190571a admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:24.667230 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca49be-ba08-4880-992f-f05fd190571a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:24.668847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca49be-ba08-4880-992f-f05fd190571a admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:24.673868 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 797/1584] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:27:24 2022] POST /identity/v3/users => generated 287 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:24.673868 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85986f-c806-470f-b88c-3e4c4b6f2282 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:24.680605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 788/1585] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:24.681480 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85986f-c806-470f-b88c-3e4c4b6f2282 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:24.682613 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545019b5-84e1-46b3-8b5a-89953c48e4ac None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:24.683005 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545019b5-84e1-46b3-8b5a-89953c48e4ac None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:24.683366 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545019b5-84e1-46b3-8b5a-89953c48e4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:24.686782 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2688a-194e-4fc1-8b49-ca065842080a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:24.687653 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2688a-194e-4fc1-8b49-ca065842080a admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:24.687936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2688a-194e-4fc1-8b49-ca065842080a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:24.688212 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2688a-194e-4fc1-8b49-ca065842080a admin admin] PATH_INFO: `/v3/projects/4f513fbb00a1495782e48de7ab0c8061/users/92606adbbaa946c0a32978316afb380f/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:24.703483 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2688a-194e-4fc1-8b49-ca065842080a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f513fbb00a1495782e48de7ab0c8061, user_id=92606adbbaa946c0a32978316afb380f, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:24.706283 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2688a-194e-4fc1-8b49-ca065842080a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:24.710382 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-545019b5-84e1-46b3-8b5a-89953c48e4ac None None] MFA Rules not processed for user `01cbcd59d95f497ea9071ee7be5e3f5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:24.711836 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-545019b5-84e1-46b3-8b5a-89953c48e4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:24.719727 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 798/1586] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:27:24 2022] PUT /identity/v3/projects/4f513fbb00a1495782e48de7ab0c8061/users/92606adbbaa946c0a32978316afb380f/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:24.720611 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2688a-194e-4fc1-8b49-ca065842080a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:24.781640 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 789/1587] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:24.782677 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545019b5-84e1-46b3-8b5a-89953c48e4ac None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:24.786944 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2688a-194e-4fc1-8b49-ca065842080a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:24.792897 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8ab6f-8f2b-4207-aa96-02d7dc66c29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:24.793602 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545019b5-84e1-46b3-8b5a-89953c48e4ac None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:24.794137 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8ab6f-8f2b-4207-aa96-02d7dc66c29a admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:24.794816 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8ab6f-8f2b-4207-aa96-02d7dc66c29a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:24.795253 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8ab6f-8f2b-4207-aa96-02d7dc66c29a admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:24.796311 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8ab6f-8f2b-4207-aa96-02d7dc66c29a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:24.798269 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8ab6f-8f2b-4207-aa96-02d7dc66c29a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:24.798651 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ecda0f-c349-4892-ad85-733248d323d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:24.799515 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecda0f-c349-4892-ad85-733248d323d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:24.799864 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecda0f-c349-4892-ad85-733248d323d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:24.800068 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecda0f-c349-4892-ad85-733248d323d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:24.801271 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ecda0f-c349-4892-ad85-733248d323d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:24.802552 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ecda0f-c349-4892-ad85-733248d323d9 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:24.816145 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 799/1588] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:24.816145 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8ab6f-8f2b-4207-aa96-02d7dc66c29a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:24.816523 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 790/1589] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:24.816523 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ecda0f-c349-4892-ad85-733248d323d9 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:24.827243 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ecda0f-c349-4892-ad85-733248d323d9 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:24.829479 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8ab6f-8f2b-4207-aa96-02d7dc66c29a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:24.832747 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb25a8-dc6b-4569-ac3f-69cadfb4ac15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:24.833435 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb25a8-dc6b-4569-ac3f-69cadfb4ac15 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:24.833725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb25a8-dc6b-4569-ac3f-69cadfb4ac15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:24.834027 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb25a8-dc6b-4569-ac3f-69cadfb4ac15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:24.834190 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348306e-4f40-4afd-a37f-3cda9f7dca5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:24.834788 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bb25a8-dc6b-4569-ac3f-69cadfb4ac15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:24.834895 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348306e-4f40-4afd-a37f-3cda9f7dca5a admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:24.835137 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348306e-4f40-4afd-a37f-3cda9f7dca5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:24.835412 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348306e-4f40-4afd-a37f-3cda9f7dca5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:24.836246 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c348306e-4f40-4afd-a37f-3cda9f7dca5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:24.836481 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bb25a8-dc6b-4569-ac3f-69cadfb4ac15 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:24.837890 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c348306e-4f40-4afd-a37f-3cda9f7dca5a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:24.847010 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 791/1590] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:24.847838 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb25a8-dc6b-4569-ac3f-69cadfb4ac15 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:24.851642 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 800/1591] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:24.851642 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348306e-4f40-4afd-a37f-3cda9f7dca5a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:24.860015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348306e-4f40-4afd-a37f-3cda9f7dca5a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:24.860467 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb25a8-dc6b-4569-ac3f-69cadfb4ac15 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:24.864884 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a97ca7-f7e2-4821-aede-6a443a244ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:24.865160 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d2bc5-9b7b-4b4a-8742-5ace319bf673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:24.865524 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a97ca7-f7e2-4821-aede-6a443a244ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:24.865806 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a97ca7-f7e2-4821-aede-6a443a244ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:24.865910 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d2bc5-9b7b-4b4a-8742-5ace319bf673 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:24.866117 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a97ca7-f7e2-4821-aede-6a443a244ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:24.866222 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d2bc5-9b7b-4b4a-8742-5ace319bf673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:24.866396 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d2bc5-9b7b-4b4a-8742-5ace319bf673 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:24.866828 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a97ca7-f7e2-4821-aede-6a443a244ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:24.867114 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d2bc5-9b7b-4b4a-8742-5ace319bf673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:24.868554 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a97ca7-f7e2-4821-aede-6a443a244ef8 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:24.868670 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d2bc5-9b7b-4b4a-8742-5ace319bf673 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:24.879384 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 801/1592] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:24.880679 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77f7be-7026-4498-aca3-5f7e6a76c530 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:24.880976 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77f7be-7026-4498-aca3-5f7e6a76c530 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:24.881289 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77f7be-7026-4498-aca3-5f7e6a76c530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:24.882795 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 792/1593] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:24.884396 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1fd16-b752-4f33-8cf4-03372a6f3975 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:24.884838 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1fd16-b752-4f33-8cf4-03372a6f3975 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:24.885122 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1fd16-b752-4f33-8cf4-03372a6f3975 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:24.886506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 793/1594] 10.222.0.32 () {54 vars in 961 bytes} [Wed Jun 1 04:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:27:24.889920 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1fd16-b752-4f33-8cf4-03372a6f3975 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:24.899801 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7f77f7be-7026-4498-aca3-5f7e6a76c530 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:24.900941 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7f77f7be-7026-4498-aca3-5f7e6a76c530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:24.905515 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1fd16-b752-4f33-8cf4-03372a6f3975 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:24.909251 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 802/1595] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:24.910066 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77f7be-7026-4498-aca3-5f7e6a76c530 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:24.910166 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc51289-3b49-431f-a47a-25b8c0850a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:24.910784 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc51289-3b49-431f-a47a-25b8c0850a52 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:24.911067 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc51289-3b49-431f-a47a-25b8c0850a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:24.911339 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc51289-3b49-431f-a47a-25b8c0850a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:24.912077 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc51289-3b49-431f-a47a-25b8c0850a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:24.913788 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc51289-3b49-431f-a47a-25b8c0850a52 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:24.920368 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77f7be-7026-4498-aca3-5f7e6a76c530 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:24.925854 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b37ec-8179-401d-9914-5da24cab6223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:24.926054 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 794/1596] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:24.926661 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b37ec-8179-401d-9914-5da24cab6223 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:24.927047 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b37ec-8179-401d-9914-5da24cab6223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:24.927420 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b37ec-8179-401d-9914-5da24cab6223 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:24.928153 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b37ec-8179-401d-9914-5da24cab6223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:24.929745 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b37ec-8179-401d-9914-5da24cab6223 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:24.929881 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc51289-3b49-431f-a47a-25b8c0850a52 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:24.939540 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc51289-3b49-431f-a47a-25b8c0850a52 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:24.946973 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 803/1597] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:24.948167 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b37ec-8179-401d-9914-5da24cab6223 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:24.948652 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122f2ce-be68-4a14-a9cb-7bbdbacf72e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:24.949503 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122f2ce-be68-4a14-a9cb-7bbdbacf72e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:24.949847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122f2ce-be68-4a14-a9cb-7bbdbacf72e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:24.950743 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122f2ce-be68-4a14-a9cb-7bbdbacf72e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:24.951681 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122f2ce-be68-4a14-a9cb-7bbdbacf72e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:24.953339 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122f2ce-be68-4a14-a9cb-7bbdbacf72e9 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:24.958867 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b37ec-8179-401d-9914-5da24cab6223 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:24.963806 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392edf89-d613-426d-b722-df75b351c4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:24.964466 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392edf89-d613-426d-b722-df75b351c4b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:24.964759 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392edf89-d613-426d-b722-df75b351c4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:24.964966 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 795/1598] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:24.965741 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392edf89-d613-426d-b722-df75b351c4b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:24.965840 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392edf89-d613-426d-b722-df75b351c4b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:24.965919 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122f2ce-be68-4a14-a9cb-7bbdbacf72e9 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:24.967949 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392edf89-d613-426d-b722-df75b351c4b9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:24.976193 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122f2ce-be68-4a14-a9cb-7bbdbacf72e9 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:24.978569 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 804/1599] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:24.979380 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392edf89-d613-426d-b722-df75b351c4b9 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:24.984102 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b22bd3-2ce0-4536-b8ec-e5c1543abd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:24.984999 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b22bd3-2ce0-4536-b8ec-e5c1543abd8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:24.985284 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b22bd3-2ce0-4536-b8ec-e5c1543abd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:24.985566 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b22bd3-2ce0-4536-b8ec-e5c1543abd8d admin admin] PATH_INFO: `/v3/projects/9469139af1f14595beb38c162ad8258c/users/5f6ff29803c74b45bc9ed026b22bc6e9/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:24.991173 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392edf89-d613-426d-b722-df75b351c4b9 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:24.995896 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637fa79-b116-433b-9ddc-1a45a0dc9456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:24.996834 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637fa79-b116-433b-9ddc-1a45a0dc9456 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:24.997257 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637fa79-b116-433b-9ddc-1a45a0dc9456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:24.997497 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637fa79-b116-433b-9ddc-1a45a0dc9456 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:24.998305 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637fa79-b116-433b-9ddc-1a45a0dc9456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:24.999902 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637fa79-b116-433b-9ddc-1a45a0dc9456 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:25.001793 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b22bd3-2ce0-4536-b8ec-e5c1543abd8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9469139af1f14595beb38c162ad8258c, user_id=5f6ff29803c74b45bc9ed026b22bc6e9, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:25.004524 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b22bd3-2ce0-4536-b8ec-e5c1543abd8d admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:25.010989 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 805/1600] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:25.013027 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641e86e-184a-408d-a7c1-c4723299a3b2 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:25.013182 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641e86e-184a-408d-a7c1-c4723299a3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:25.013463 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641e86e-184a-408d-a7c1-c4723299a3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:25.017061 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:25.023819 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 796/1601] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:27:24 2022] PUT /identity/v3/projects/9469139af1f14595beb38c162ad8258c/users/5f6ff29803c74b45bc9ed026b22bc6e9/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:25.031099 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b22bd3-2ce0-4536-b8ec-e5c1543abd8d admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:25.031794 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d641e86e-184a-408d-a7c1-c4723299a3b2 None None] MFA Rules not processed for user `79d614f85f5541d3babbb41468cbf55c`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:25.033035 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d641e86e-184a-408d-a7c1-c4723299a3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:25.037917 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:25.095866 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b22bd3-2ce0-4536-b8ec-e5c1543abd8d admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:25.099964 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba3d44-62f3-4846-94a8-2876b79d66bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:25.100649 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba3d44-62f3-4846-94a8-2876b79d66bd service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:25.101004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba3d44-62f3-4846-94a8-2876b79d66bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:25.101351 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba3d44-62f3-4846-94a8-2876b79d66bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:25.103250 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 806/1602] 10.222.0.32 () {58 vars in 1058 bytes} [Wed Jun 1 04:27:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:25.106984 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641e86e-184a-408d-a7c1-c4723299a3b2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:25.176310 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba3d44-62f3-4846-94a8-2876b79d66bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:25.177750 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba3d44-62f3-4846-94a8-2876b79d66bd service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:25.186373 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641e86e-184a-408d-a7c1-c4723299a3b2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:25.188156 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 797/1603] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:27:25.191657 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab98ece1-8215-4bfc-8deb-9cc9f4547f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:25.192550 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98ece1-8215-4bfc-8deb-9cc9f4547f52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:25.192832 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98ece1-8215-4bfc-8deb-9cc9f4547f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:25.193121 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98ece1-8215-4bfc-8deb-9cc9f4547f52 admin admin] PATH_INFO: `/v3/projects/42cd86feb1264918ad5faa15c3d140b9/users/4156a6ff075847769c0d35cfeb1b3af0/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:25.198213 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba3d44-62f3-4846-94a8-2876b79d66bd service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:25.210228 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba3d44-62f3-4846-94a8-2876b79d66bd service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:25.210425 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab98ece1-8215-4bfc-8deb-9cc9f4547f52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42cd86feb1264918ad5faa15c3d140b9, user_id=4156a6ff075847769c0d35cfeb1b3af0, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:25.213370 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab98ece1-8215-4bfc-8deb-9cc9f4547f52 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:25.217879 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e99d8-d404-44fe-8198-3f7caa109443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:25.219066 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e99d8-d404-44fe-8198-3f7caa109443 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:25.219380 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e99d8-d404-44fe-8198-3f7caa109443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:25.219807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e99d8-d404-44fe-8198-3f7caa109443 admin admin] PATH_INFO: `/v3/projects/d1310f73739a487cbf4c069f29735b0d/users/b1728ec5b52c406a873a3b670f8086dc/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:25.233561 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 807/1604] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:27:25 2022] PUT /identity/v3/projects/42cd86feb1264918ad5faa15c3d140b9/users/4156a6ff075847769c0d35cfeb1b3af0/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:25.234459 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab98ece1-8215-4bfc-8deb-9cc9f4547f52 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:25.238141 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e99d8-d404-44fe-8198-3f7caa109443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1310f73739a487cbf4c069f29735b0d, user_id=b1728ec5b52c406a873a3b670f8086dc, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:25.241106 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e99d8-d404-44fe-8198-3f7caa109443 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:25.258036 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 798/1605] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:27:25 2022] PUT /identity/v3/projects/d1310f73739a487cbf4c069f29735b0d/users/b1728ec5b52c406a873a3b670f8086dc/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:25.259271 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e99d8-d404-44fe-8198-3f7caa109443 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:25.318974 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab98ece1-8215-4bfc-8deb-9cc9f4547f52 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:25.346462 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e99d8-d404-44fe-8198-3f7caa109443 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:25.351888 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193d57f-da37-4a05-ae36-20697b88ae1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:25.352776 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:25.352998 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193d57f-da37-4a05-ae36-20697b88ae1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:25.353320 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193d57f-da37-4a05-ae36-20697b88ae1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:25.353606 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193d57f-da37-4a05-ae36-20697b88ae1b admin admin] PATH_INFO: `/v3/projects/31b3ce17acd3407f991c7daf91671f48/users/aaf8896606044cbc9a17f9e639885157/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:25.374382 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193d57f-da37-4a05-ae36-20697b88ae1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=31b3ce17acd3407f991c7daf91671f48, user_id=aaf8896606044cbc9a17f9e639885157, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:25.377384 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193d57f-da37-4a05-ae36-20697b88ae1b admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:25.390678 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a730a6-a023-415c-9c1e-d4aa74cc0b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:25.391584 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a730a6-a023-415c-9c1e-d4aa74cc0b18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:25.391869 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a730a6-a023-415c-9c1e-d4aa74cc0b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:25.392148 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a730a6-a023-415c-9c1e-d4aa74cc0b18 admin admin] PATH_INFO: `/v3/projects/36184dd2a0a74fa3bbb38107f7863f3f/users/df8135d434a6499db18f03e1ec293a05/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:25.397306 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 799/1606] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:27:25 2022] PUT /identity/v3/projects/31b3ce17acd3407f991c7daf91671f48/users/aaf8896606044cbc9a17f9e639885157/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:25.397676 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193d57f-da37-4a05-ae36-20697b88ae1b admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:25.408447 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:25.411687 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a730a6-a023-415c-9c1e-d4aa74cc0b18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36184dd2a0a74fa3bbb38107f7863f3f, user_id=df8135d434a6499db18f03e1ec293a05, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:25.414444 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a730a6-a023-415c-9c1e-d4aa74cc0b18 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:25.432922 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 808/1607] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:27:25 2022] PUT /identity/v3/projects/36184dd2a0a74fa3bbb38107f7863f3f/users/df8135d434a6499db18f03e1ec293a05/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:25.433926 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c769c27-27b0-4930-a055-3a86211260fa None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:25.434795 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c769c27-27b0-4930-a055-3a86211260fa None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:25.435087 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c769c27-27b0-4930-a055-3a86211260fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:25.463473 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-9c769c27-27b0-4930-a055-3a86211260fa None None] MFA Rules not processed for user `5f6ff29803c74b45bc9ed026b22bc6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:25.465195 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9c769c27-27b0-4930-a055-3a86211260fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:25.476599 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193d57f-da37-4a05-ae36-20697b88ae1b admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:25.539160 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e63a5-b7ba-4339-8611-b8cf0e36fd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:25.540052 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e63a5-b7ba-4339-8611-b8cf0e36fd3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:25.540332 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e63a5-b7ba-4339-8611-b8cf0e36fd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:25.540605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e63a5-b7ba-4339-8611-b8cf0e36fd3d admin admin] PATH_INFO: `/v3/projects/f274461557084b898c8150c79a2edbfd/users/1da57d521cae42ffb93ed0c182d784cf/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:25.545841 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 809/1608] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:25 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:25.545841 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c769c27-27b0-4930-a055-3a86211260fa None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:25.561221 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e63a5-b7ba-4339-8611-b8cf0e36fd3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f274461557084b898c8150c79a2edbfd, user_id=1da57d521cae42ffb93ed0c182d784cf, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:25.563957 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e63a5-b7ba-4339-8611-b8cf0e36fd3d admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:25.582140 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 800/1609] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:27:25 2022] PUT /identity/v3/projects/f274461557084b898c8150c79a2edbfd/users/1da57d521cae42ffb93ed0c182d784cf/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:25.584550 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e222898-5fac-4ef3-b970-53ef8f78e0d8 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:25.584947 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e222898-5fac-4ef3-b970-53ef8f78e0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:25.585400 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e222898-5fac-4ef3-b970-53ef8f78e0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:25.610440 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-5e222898-5fac-4ef3-b970-53ef8f78e0d8 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:25.611865 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-5e222898-5fac-4ef3-b970-53ef8f78e0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:25.628615 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c769c27-27b0-4930-a055-3a86211260fa None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:25.673743 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:25.695074 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 801/1610] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:25.696733 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53cc99-4cef-49ce-ad66-9142efafa054 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:25.696966 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53cc99-4cef-49ce-ad66-9142efafa054 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:25.698162 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53cc99-4cef-49ce-ad66-9142efafa054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:25.720991 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aabced-d5fa-4e0f-a789-21874cc5d366 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:25.722096 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aabced-d5fa-4e0f-a789-21874cc5d366 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:25.722827 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aabced-d5fa-4e0f-a789-21874cc5d366 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:25.723446 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aabced-d5fa-4e0f-a789-21874cc5d366 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:25.735962 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-dd53cc99-4cef-49ce-ad66-9142efafa054 None None] MFA Rules not processed for user `b1728ec5b52c406a873a3b670f8086dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:25.738028 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-dd53cc99-4cef-49ce-ad66-9142efafa054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:25.776861 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:25.810440 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aabced-d5fa-4e0f-a789-21874cc5d366 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:25.812041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aabced-d5fa-4e0f-a789-21874cc5d366 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:25.823120 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 810/1611] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:27:25.824582 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054c8eb-a919-446b-b94e-9f98a0880399 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:25.824895 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054c8eb-a919-446b-b94e-9f98a0880399 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:25.825687 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054c8eb-a919-446b-b94e-9f98a0880399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:25.826037 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 802/1612] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:25.831978 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165ee49-6a01-4fa6-b180-439cab3f3ce4 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:25.832335 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165ee49-6a01-4fa6-b180-439cab3f3ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:25.832623 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165ee49-6a01-4fa6-b180-439cab3f3ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:25.858559 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-d165ee49-6a01-4fa6-b180-439cab3f3ce4 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:25.859982 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d165ee49-6a01-4fa6-b180-439cab3f3ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:25.869502 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 803/1613] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:25.871434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165ee49-6a01-4fa6-b180-439cab3f3ce4 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:25.897028 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2054c8eb-a919-446b-b94e-9f98a0880399 None None] MFA Rules not processed for user `aaf8896606044cbc9a17f9e639885157`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:25.898836 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2054c8eb-a919-446b-b94e-9f98a0880399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:25.958269 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165ee49-6a01-4fa6-b180-439cab3f3ce4 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:25.964134 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ba0b2-64bb-4013-9425-c76e0b07fd5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:25.964974 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ba0b2-64bb-4013-9425-c76e0b07fd5e service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:25.965342 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ba0b2-64bb-4013-9425-c76e0b07fd5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:25.966373 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ba0b2-64bb-4013-9425-c76e0b07fd5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:26.005535 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 811/1614] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:26.014314 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d1e4a-9a1b-441e-a76d-20de50679824 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:26.014616 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d1e4a-9a1b-441e-a76d-20de50679824 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:26.014903 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d1e4a-9a1b-441e-a76d-20de50679824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:26.038462 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54ba0b2-64bb-4013-9425-c76e0b07fd5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:26.040081 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54ba0b2-64bb-4013-9425-c76e0b07fd5e service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:26.052410 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 804/1615] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:25 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:27:26.053510 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ba0b2-64bb-4013-9425-c76e0b07fd5e service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:26.064634 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d98d1e4a-9a1b-441e-a76d-20de50679824 None None] MFA Rules not processed for user `1da57d521cae42ffb93ed0c182d784cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:26.066236 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d98d1e4a-9a1b-441e-a76d-20de50679824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:26.141399 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ba0b2-64bb-4013-9425-c76e0b07fd5e service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:26.146106 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277996c-a0f2-4396-8664-cb7bf817158f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:26.146767 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277996c-a0f2-4396-8664-cb7bf817158f service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:26.147052 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277996c-a0f2-4396-8664-cb7bf817158f service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:26.147336 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277996c-a0f2-4396-8664-cb7bf817158f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:26.159721 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1277996c-a0f2-4396-8664-cb7bf817158f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:26.161594 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1277996c-a0f2-4396-8664-cb7bf817158f service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:26.173000 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:26.176911 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 805/1616] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:27:26.177675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277996c-a0f2-4396-8664-cb7bf817158f service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:26.186906 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277996c-a0f2-4396-8664-cb7bf817158f service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:26.191648 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7c452-df40-4f6b-81ad-61ffc1b68cd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:26.192298 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7c452-df40-4f6b-81ad-61ffc1b68cd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:26.192587 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7c452-df40-4f6b-81ad-61ffc1b68cd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:26.192867 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7c452-df40-4f6b-81ad-61ffc1b68cd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:26.193028 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 812/1617] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:26.194957 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97882822-43c6-4ffd-99c3-670162f7f463 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:26.195352 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97882822-43c6-4ffd-99c3-670162f7f463 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:26.195932 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97882822-43c6-4ffd-99c3-670162f7f463 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:26.197881 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 813/1618] 10.222.0.32 () {54 vars in 961 bytes} [Wed Jun 1 04:27:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:27:26.198834 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97882822-43c6-4ffd-99c3-670162f7f463 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:26.207873 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7c452-df40-4f6b-81ad-61ffc1b68cd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:26.209293 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7c452-df40-4f6b-81ad-61ffc1b68cd3 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:26.218656 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97882822-43c6-4ffd-99c3-670162f7f463 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:26.223003 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 806/1619] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:27:26.225046 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43b605-1cca-4a5c-8e6f-9a7b6608b768 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:26.225353 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43b605-1cca-4a5c-8e6f-9a7b6608b768 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:26.225751 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43b605-1cca-4a5c-8e6f-9a7b6608b768 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:26.226788 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793868f-af5d-4e26-849c-3de9f73d869b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:26.227553 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793868f-af5d-4e26-849c-3de9f73d869b admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:26.227881 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 807/1620] 10.222.0.32 () {54 vars in 912 bytes} [Wed Jun 1 04:27:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:27:26.229222 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f369f2-f53b-4313-b5ee-80ec565c16c7 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:26.229733 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f369f2-f53b-4313-b5ee-80ec565c16c7 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:26.230139 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f369f2-f53b-4313-b5ee-80ec565c16c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:26.234204 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793868f-af5d-4e26-849c-3de9f73d869b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:26.234699 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793868f-af5d-4e26-849c-3de9f73d869b admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:26.236287 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5793868f-af5d-4e26-849c-3de9f73d869b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:26.238821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5793868f-af5d-4e26-849c-3de9f73d869b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:26.248598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:26.272874 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-99f369f2-f53b-4313-b5ee-80ec565c16c7 None None] MFA Rules not processed for user `92606adbbaa946c0a32978316afb380f`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:26.274173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-99f369f2-f53b-4313-b5ee-80ec565c16c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:26.286957 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 814/1621] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:27:26 2022] POST /identity/v3/projects => generated 367 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:26.288038 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793868f-af5d-4e26-849c-3de9f73d869b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:26.384516 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 808/1622] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:26.384732 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793868f-af5d-4e26-849c-3de9f73d869b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:26.391000 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a45032-6a8b-4323-8ef4-d3d5656566c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:26.391770 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a45032-6a8b-4323-8ef4-d3d5656566c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:26.392111 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a45032-6a8b-4323-8ef4-d3d5656566c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:26.392479 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a45032-6a8b-4323-8ef4-d3d5656566c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:26.393240 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a45032-6a8b-4323-8ef4-d3d5656566c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:26.395893 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46450f4-851e-4776-9b76-1daba0967121 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:26.396248 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46450f4-851e-4776-9b76-1daba0967121 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:26.396536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46450f4-851e-4776-9b76-1daba0967121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:26.397624 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a45032-6a8b-4323-8ef4-d3d5656566c5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:26.421709 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-f46450f4-851e-4776-9b76-1daba0967121 None None] MFA Rules not processed for user `79d614f85f5541d3babbb41468cbf55c`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:26.423103 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f46450f4-851e-4776-9b76-1daba0967121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:26.463881 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 815/1623] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:27:26 2022] POST /identity/v3/projects => generated 373 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:26.465337 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548995ee-6419-402c-b024-237043dac3a8 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:26.466306 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548995ee-6419-402c-b024-237043dac3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:26.466633 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548995ee-6419-402c-b024-237043dac3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:26.506554 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-548995ee-6419-402c-b024-237043dac3a8 None None] MFA Rules not processed for user `79d614f85f5541d3babbb41468cbf55c`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:26.509444 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-548995ee-6419-402c-b024-237043dac3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:26.533777 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 809/1624] 10.222.0.32 () {58 vars in 1058 bytes} [Wed Jun 1 04:27:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:26.534827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46450f4-851e-4776-9b76-1daba0967121 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:26.546598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46450f4-851e-4776-9b76-1daba0967121 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:26.622943 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aeb884-2b8e-477f-b9e9-d879669ba7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:26.622943 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aeb884-2b8e-477f-b9e9-d879669ba7af admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:26.622943 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aeb884-2b8e-477f-b9e9-d879669ba7af admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:26.622943 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aeb884-2b8e-477f-b9e9-d879669ba7af admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:26.623481 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aeb884-2b8e-477f-b9e9-d879669ba7af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:26.624529 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aeb884-2b8e-477f-b9e9-d879669ba7af admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:26.627971 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 816/1625] 10.222.0.32 () {58 vars in 1009 bytes} [Wed Jun 1 04:27:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:26.631101 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca1464-2a70-4027-8049-5e872e5ff465 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:26.631259 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca1464-2a70-4027-8049-5e872e5ff465 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:26.631535 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca1464-2a70-4027-8049-5e872e5ff465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:26.659195 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 810/1626] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:27:26 2022] POST /identity/v3/users => generated 290 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:26.659195 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aeb884-2b8e-477f-b9e9-d879669ba7af admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:26.670904 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-99ca1464-2a70-4027-8049-5e872e5ff465 None None] MFA Rules not processed for user `92606adbbaa946c0a32978316afb380f`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:26.671170 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-99ca1464-2a70-4027-8049-5e872e5ff465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:26.684219 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aeb884-2b8e-477f-b9e9-d879669ba7af admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:26.702747 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a3b70-6010-49fd-bac5-a04e8ae8fb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:26.703450 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a3b70-6010-49fd-bac5-a04e8ae8fb92 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:26.704400 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a3b70-6010-49fd-bac5-a04e8ae8fb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:26.704400 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a3b70-6010-49fd-bac5-a04e8ae8fb92 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:26.705504 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a3b70-6010-49fd-bac5-a04e8ae8fb92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:26.707428 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a3b70-6010-49fd-bac5-a04e8ae8fb92 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:26.747143 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:26.755724 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 811/1627] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:27:26 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:26.756615 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a3b70-6010-49fd-bac5-a04e8ae8fb92 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:26.766193 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:26.788525 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a3b70-6010-49fd-bac5-a04e8ae8fb92 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:26.795524 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 817/1628] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:26.796455 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca1464-2a70-4027-8049-5e872e5ff465 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:26.805448 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2375d1-2e8f-4c9d-8e62-95454bf24b78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:26.806266 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2375d1-2e8f-4c9d-8e62-95454bf24b78 service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:26.806576 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2375d1-2e8f-4c9d-8e62-95454bf24b78 service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:26.806858 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2375d1-2e8f-4c9d-8e62-95454bf24b78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:26.934818 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2375d1-2e8f-4c9d-8e62-95454bf24b78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:26.936486 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2375d1-2e8f-4c9d-8e62-95454bf24b78 service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:26.943869 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca1464-2a70-4027-8049-5e872e5ff465 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:26.948453 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 812/1629] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:27:26.949337 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2375d1-2e8f-4c9d-8e62-95454bf24b78 service nova] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:26.954543 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e3066-0aff-4570-9449-5a8e2665c228 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:26.956509 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e3066-0aff-4570-9449-5a8e2665c228 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:26.956892 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e3066-0aff-4570-9449-5a8e2665c228 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:26.957250 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e3066-0aff-4570-9449-5a8e2665c228 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:26.960054 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2375d1-2e8f-4c9d-8e62-95454bf24b78 service nova] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:26.964922 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6196f3-c527-4a39-8aca-2b2fa8f5b54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:26.966077 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6196f3-c527-4a39-8aca-2b2fa8f5b54a admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:26.966366 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6196f3-c527-4a39-8aca-2b2fa8f5b54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:26.966647 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6196f3-c527-4a39-8aca-2b2fa8f5b54a admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:26.967379 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6196f3-c527-4a39-8aca-2b2fa8f5b54a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:26.969285 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6196f3-c527-4a39-8aca-2b2fa8f5b54a admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:26.980675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 813/1630] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:26.982252 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6196f3-c527-4a39-8aca-2b2fa8f5b54a admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:26.989509 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e3066-0aff-4570-9449-5a8e2665c228 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:26.991117 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e3066-0aff-4570-9449-5a8e2665c228 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:26.994105 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6196f3-c527-4a39-8aca-2b2fa8f5b54a admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:27.000752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c14f32-5fde-4df4-8d72-4c82d3ba5870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:27.001460 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c14f32-5fde-4df4-8d72-4c82d3ba5870 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:27.001751 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c14f32-5fde-4df4-8d72-4c82d3ba5870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:27.002075 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c14f32-5fde-4df4-8d72-4c82d3ba5870 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:27.002849 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c14f32-5fde-4df4-8d72-4c82d3ba5870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:27.004973 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c14f32-5fde-4df4-8d72-4c82d3ba5870 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:27.015871 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 814/1631] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:27.016503 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 818/1632] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:27:27.017058 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c14f32-5fde-4df4-8d72-4c82d3ba5870 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:27.019848 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e3066-0aff-4570-9449-5a8e2665c228 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:27.036211 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c14f32-5fde-4df4-8d72-4c82d3ba5870 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:27.044504 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e3066-0aff-4570-9449-5a8e2665c228 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:27.049782 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2dc138-f491-451e-ad44-0e797f1980c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:27.050812 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dc138-f491-451e-ad44-0e797f1980c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:27.051224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dc138-f491-451e-ad44-0e797f1980c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:27.051572 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dc138-f491-451e-ad44-0e797f1980c4 admin admin] PATH_INFO: `/v3/projects/914017987d8447fcb14baf46bbf1febb/users/74a22a3a24fa4f9db2571a56c6da513e/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:27.057549 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0671f9-7b51-4849-b07e-39ba60735d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:27.058897 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0671f9-7b51-4849-b07e-39ba60735d56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:27.061455 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0671f9-7b51-4849-b07e-39ba60735d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:27.061821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0671f9-7b51-4849-b07e-39ba60735d56 admin admin] PATH_INFO: `/v3/projects/733ff40753b743a3b6af371f4780c652/users/0d1f71b8880c41018c7de4a8925c557a/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:27.086988 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2dc138-f491-451e-ad44-0e797f1980c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=914017987d8447fcb14baf46bbf1febb, user_id=74a22a3a24fa4f9db2571a56c6da513e, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:27.089722 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2dc138-f491-451e-ad44-0e797f1980c4 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:27.107923 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0671f9-7b51-4849-b07e-39ba60735d56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=733ff40753b743a3b6af371f4780c652, user_id=0d1f71b8880c41018c7de4a8925c557a, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:27.111126 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0671f9-7b51-4849-b07e-39ba60735d56 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:27.119172 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 815/1633] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:27:27 2022] PUT /identity/v3/projects/914017987d8447fcb14baf46bbf1febb/users/74a22a3a24fa4f9db2571a56c6da513e/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:27.123766 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2dc138-f491-451e-ad44-0e797f1980c4 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:27.146065 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 819/1634] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:27:27 2022] PUT /identity/v3/projects/733ff40753b743a3b6af371f4780c652/users/0d1f71b8880c41018c7de4a8925c557a/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:27.153573 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0671f9-7b51-4849-b07e-39ba60735d56 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:27.240284 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0671f9-7b51-4849-b07e-39ba60735d56 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:27.247466 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e55457-41a3-4424-a91d-a84902b6b8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:27.248542 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e55457-41a3-4424-a91d-a84902b6b8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:27.249868 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e55457-41a3-4424-a91d-a84902b6b8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:27.250440 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e55457-41a3-4424-a91d-a84902b6b8b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:27.251680 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e55457-41a3-4424-a91d-a84902b6b8b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:27.253841 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e55457-41a3-4424-a91d-a84902b6b8b0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:27.268811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 820/1635] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:27.272819 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e55457-41a3-4424-a91d-a84902b6b8b0 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:27.286663 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2dc138-f491-451e-ad44-0e797f1980c4 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:27.296516 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e55457-41a3-4424-a91d-a84902b6b8b0 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:27.307711 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59eebd9-bf06-4614-a606-6aee221dc295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:27.307711 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59eebd9-bf06-4614-a606-6aee221dc295 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:27.307711 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59eebd9-bf06-4614-a606-6aee221dc295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:27.307711 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59eebd9-bf06-4614-a606-6aee221dc295 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:27.308840 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59eebd9-bf06-4614-a606-6aee221dc295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:27.309601 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075362c-3898-44d6-9c21-17326c86d5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:27.310761 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59eebd9-bf06-4614-a606-6aee221dc295 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:27.311526 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075362c-3898-44d6-9c21-17326c86d5a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:27.313135 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075362c-3898-44d6-9c21-17326c86d5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:27.313508 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075362c-3898-44d6-9c21-17326c86d5a6 admin admin] PATH_INFO: `/v3/projects/733ff40753b743a3b6af371f4780c652/users/0d1f71b8880c41018c7de4a8925c557a/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:27.319781 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075362c-3898-44d6-9c21-17326c86d5a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=733ff40753b743a3b6af371f4780c652, user_id=0d1f71b8880c41018c7de4a8925c557a, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:27.329115 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075362c-3898-44d6-9c21-17326c86d5a6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:27.342439 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 816/1636] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:27.349203 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59eebd9-bf06-4614-a606-6aee221dc295 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:27.357493 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 821/1637] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:27:27 2022] PUT /identity/v3/projects/733ff40753b743a3b6af371f4780c652/users/0d1f71b8880c41018c7de4a8925c557a/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:27:27.365322 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59eebd9-bf06-4614-a606-6aee221dc295 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:27.367488 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa613f-6084-4ae5-8df5-b59defe46f45 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:27.367792 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa613f-6084-4ae5-8df5-b59defe46f45 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:27.368107 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa613f-6084-4ae5-8df5-b59defe46f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:27.426633 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-34fa613f-6084-4ae5-8df5-b59defe46f45 None None] MFA Rules not processed for user `0d1f71b8880c41018c7de4a8925c557a`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:27.427840 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-34fa613f-6084-4ae5-8df5-b59defe46f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:27.483710 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:27.510290 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5240b7-3dd6-40ea-bb47-8a27b2a89240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:27.514307 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5240b7-3dd6-40ea-bb47-8a27b2a89240 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:27.514499 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5240b7-3dd6-40ea-bb47-8a27b2a89240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:27.514692 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5240b7-3dd6-40ea-bb47-8a27b2a89240 admin admin] PATH_INFO: `/v3/projects/914017987d8447fcb14baf46bbf1febb/users/74a22a3a24fa4f9db2571a56c6da513e/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:27.517340 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5240b7-3dd6-40ea-bb47-8a27b2a89240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=914017987d8447fcb14baf46bbf1febb, user_id=74a22a3a24fa4f9db2571a56c6da513e, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:27.520383 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5240b7-3dd6-40ea-bb47-8a27b2a89240 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:27.541922 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 817/1638] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:27:27 2022] PUT /identity/v3/projects/914017987d8447fcb14baf46bbf1febb/users/74a22a3a24fa4f9db2571a56c6da513e/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:27.541922 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5240b7-3dd6-40ea-bb47-8a27b2a89240 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:27.551888 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:27.591792 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 822/1639] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:27 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:27:27.594340 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb9492-5cfa-418a-b060-c41d226a046e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:27.594877 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb9492-5cfa-418a-b060-c41d226a046e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:27.595364 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb9492-5cfa-418a-b060-c41d226a046e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:27.657710 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-edfb9492-5cfa-418a-b060-c41d226a046e None None] MFA Rules not processed for user `74a22a3a24fa4f9db2571a56c6da513e`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:27.660650 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-edfb9492-5cfa-418a-b060-c41d226a046e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:27.727454 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5240b7-3dd6-40ea-bb47-8a27b2a89240 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:27.737655 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246927a0-bb16-4ff7-8274-f438ee6f634e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:27.743311 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246927a0-bb16-4ff7-8274-f438ee6f634e service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:27.743849 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246927a0-bb16-4ff7-8274-f438ee6f634e service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:27.744202 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246927a0-bb16-4ff7-8274-f438ee6f634e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:27.843297 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 823/1640] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:27 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:27.845140 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb9492-5cfa-418a-b060-c41d226a046e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:27.858523 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246927a0-bb16-4ff7-8274-f438ee6f634e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:27.860503 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246927a0-bb16-4ff7-8274-f438ee6f634e service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:27.888565 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 818/1641] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:27:27.977796 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb9492-5cfa-418a-b060-c41d226a046e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:27.989195 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e484b6d-27c4-4b0d-b914-545bd2932f47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:27.989874 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e484b6d-27c4-4b0d-b914-545bd2932f47 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:27.990180 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e484b6d-27c4-4b0d-b914-545bd2932f47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:27.990456 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e484b6d-27c4-4b0d-b914-545bd2932f47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:28.012692 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09ce6d-1656-4c77-aad6-925d2376b285 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:28.013625 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09ce6d-1656-4c77-aad6-925d2376b285 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:28.014287 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09ce6d-1656-4c77-aad6-925d2376b285 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:28.016315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 819/1642] 10.222.0.32 () {54 vars in 912 bytes} [Wed Jun 1 04:27:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:27:28.021962 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de8364-769a-4f08-9203-b6c7dd65ee02 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:28.022675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de8364-769a-4f08-9203-b6c7dd65ee02 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:28.023176 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de8364-769a-4f08-9203-b6c7dd65ee02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:28.063103 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-65de8364-769a-4f08-9203-b6c7dd65ee02 None None] MFA Rules not processed for user `79d614f85f5541d3babbb41468cbf55c`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:28.065948 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-65de8364-769a-4f08-9203-b6c7dd65ee02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:28.074030 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e484b6d-27c4-4b0d-b914-545bd2932f47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:28.075878 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e484b6d-27c4-4b0d-b914-545bd2932f47 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:28.087559 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 824/1643] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:27:28.088607 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e484b6d-27c4-4b0d-b914-545bd2932f47 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:28.096632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e484b6d-27c4-4b0d-b914-545bd2932f47 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:28.100492 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e588923-c59f-4930-b398-28318ec923b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:28.101132 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e588923-c59f-4930-b398-28318ec923b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:28.101418 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e588923-c59f-4930-b398-28318ec923b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:28.101692 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e588923-c59f-4930-b398-28318ec923b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:28.102411 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 820/1644] 10.222.0.32 () {58 vars in 1009 bytes} [Wed Jun 1 04:27:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:28.116359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de8364-769a-4f08-9203-b6c7dd65ee02 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:28.117573 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e588923-c59f-4930-b398-28318ec923b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:28.118676 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-65de8364-769a-4f08-9203-b6c7dd65ee02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:28.119260 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e588923-c59f-4930-b398-28318ec923b3 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:28.133556 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 825/1645] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:28 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:27:28.256302 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de8364-769a-4f08-9203-b6c7dd65ee02 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:28.268257 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc599e04-a33d-405a-9669-077ad68e490d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac83171b9284163a71cc729cef076f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:28.269410 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc599e04-a33d-405a-9669-077ad68e490d service glance] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:28.270145 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc599e04-a33d-405a-9669-077ad68e490d service glance] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:28.270567 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc599e04-a33d-405a-9669-077ad68e490d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:28.314236 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc599e04-a33d-405a-9669-077ad68e490d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:28.315710 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc599e04-a33d-405a-9669-077ad68e490d service glance] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:28.343695 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e588923-c59f-4930-b398-28318ec923b3 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:28.346010 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 821/1646] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:27:28.362404 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e588923-c59f-4930-b398-28318ec923b3 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:28.376770 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045e79a-217d-4179-9ad6-ad6ad13b5059 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:28.377927 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045e79a-217d-4179-9ad6-ad6ad13b5059 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:28.378275 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045e79a-217d-4179-9ad6-ad6ad13b5059 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:28.378563 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045e79a-217d-4179-9ad6-ad6ad13b5059 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:28.398405 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:28.500069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045e79a-217d-4179-9ad6-ad6ad13b5059 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:28.501535 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045e79a-217d-4179-9ad6-ad6ad13b5059 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:28.523315 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 826/1647] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:28 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:27:28.801118 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4aa76-a572-49d1-9787-7a0f1cb1088d None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:28.801853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4aa76-a572-49d1-9787-7a0f1cb1088d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:28.802375 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4aa76-a572-49d1-9787-7a0f1cb1088d None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:28.804019 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 822/1648] 10.222.0.32 () {54 vars in 912 bytes} [Wed Jun 1 04:27:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:27:28.810328 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5304d-652f-4de1-b2ee-6e3e4246796f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:28.810938 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5304d-652f-4de1-b2ee-6e3e4246796f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:28.811431 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5304d-652f-4de1-b2ee-6e3e4246796f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:28.905577 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-87a5304d-652f-4de1-b2ee-6e3e4246796f None None] MFA Rules not processed for user `dca5f9455ef349738adf4569fe5ed165`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:28.910620 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-87a5304d-652f-4de1-b2ee-6e3e4246796f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:29.053511 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 827/1649] 10.222.0.32 () {58 vars in 1009 bytes} [Wed Jun 1 04:27:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:29.109031 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4aa76-a572-49d1-9787-7a0f1cb1088d None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:29.134007 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4aa76-a572-49d1-9787-7a0f1cb1088d None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:29.141852 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42f46f-3d0f-48e2-a912-4049454a76bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:29.144197 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42f46f-3d0f-48e2-a912-4049454a76bd service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:29.144493 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42f46f-3d0f-48e2-a912-4049454a76bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:29.145131 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42f46f-3d0f-48e2-a912-4049454a76bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:29.164086 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42f46f-3d0f-48e2-a912-4049454a76bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:29.167668 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42f46f-3d0f-48e2-a912-4049454a76bd service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:29.190737 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 823/1650] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:27:29.854103 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5304d-652f-4de1-b2ee-6e3e4246796f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:29.992157 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5304d-652f-4de1-b2ee-6e3e4246796f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:30.008927 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3604a76-b4b7-489f-8f7b-e3a69d0619d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:30.010447 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3604a76-b4b7-489f-8f7b-e3a69d0619d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:30.011102 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3604a76-b4b7-489f-8f7b-e3a69d0619d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:30.011690 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3604a76-b4b7-489f-8f7b-e3a69d0619d0 admin admin] PATH_INFO: `/v3/users/1da57d521cae42ffb93ed0c182d784cf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:30.014134 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3604a76-b4b7-489f-8f7b-e3a69d0619d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1da57d521cae42ffb93ed0c182d784cf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:30.016741 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3604a76-b4b7-489f-8f7b-e3a69d0619d0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:30.180378 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42f46f-3d0f-48e2-a912-4049454a76bd service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:30.193476 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:30.202143 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42f46f-3d0f-48e2-a912-4049454a76bd service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:30.208945 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:30.214428 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613244d5-4d1c-42f6-97b0-d0e2d330294c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:30.216145 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c3604a76-b4b7-489f-8f7b-e3a69d0619d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1da57d521cae42ffb93ed0c182d784cf'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:30.217191 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613244d5-4d1c-42f6-97b0-d0e2d330294c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:30.217678 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613244d5-4d1c-42f6-97b0-d0e2d330294c admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:30.217827 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c3604a76-b4b7-489f-8f7b-e3a69d0619d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1da57d521cae42ffb93ed0c182d784cf'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:30.219122 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613244d5-4d1c-42f6-97b0-d0e2d330294c admin admin] PATH_INFO: `/v3/users/b1728ec5b52c406a873a3b670f8086dc` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:30.224226 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613244d5-4d1c-42f6-97b0-d0e2d330294c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1728ec5b52c406a873a3b670f8086dc)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:30.227049 dv-cinder-667108-37-smb devstack@keystone.service[80232]: WARNING py.warnings [None req-613244d5-4d1c-42f6-97b0-d0e2d330294c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 01 04:27:30.227049 dv-cinder-667108-37-smb devstack@keystone.service[80232]: warnings.warn(msg) Jun 01 04:27:30.227049 dv-cinder-667108-37-smb devstack@keystone.service[80232]: Jun 01 04:27:30.229602 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613244d5-4d1c-42f6-97b0-d0e2d330294c admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:30.235410 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c3604a76-b4b7-489f-8f7b-e3a69d0619d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1da57d521cae42ffb93ed0c182d784cf'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:30.250731 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c3604a76-b4b7-489f-8f7b-e3a69d0619d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1da57d521cae42ffb93ed0c182d784cf'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:30.251532 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c3604a76-b4b7-489f-8f7b-e3a69d0619d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1da57d521cae42ffb93ed0c182d784cf'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:30.310563 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 828/1651] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:27:29 2022] DELETE /identity/v3/users/1da57d521cae42ffb93ed0c182d784cf => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:30.316700 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03b7f3-0337-4740-9897-82c76bb2368d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:30.317196 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03b7f3-0337-4740-9897-82c76bb2368d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:30.321378 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03b7f3-0337-4740-9897-82c76bb2368d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:30.393053 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-fd03b7f3-0337-4740-9897-82c76bb2368d None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:30.394371 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-fd03b7f3-0337-4740-9897-82c76bb2368d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:30.464692 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-613244d5-4d1c-42f6-97b0-d0e2d330294c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1728ec5b52c406a873a3b670f8086dc'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:30.483571 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-613244d5-4d1c-42f6-97b0-d0e2d330294c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1728ec5b52c406a873a3b670f8086dc'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:30.526984 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-613244d5-4d1c-42f6-97b0-d0e2d330294c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1728ec5b52c406a873a3b670f8086dc'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:30.562767 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 829/1652] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:30.562952 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-613244d5-4d1c-42f6-97b0-d0e2d330294c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1728ec5b52c406a873a3b670f8086dc'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:30.589418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-613244d5-4d1c-42f6-97b0-d0e2d330294c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1728ec5b52c406a873a3b670f8086dc'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:30.611370 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 824/1653] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:27:30 2022] DELETE /identity/v3/users/b1728ec5b52c406a873a3b670f8086dc => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:30.617482 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a5743-f18e-40c3-92e1-0bdf16ee4bf6 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:30.617776 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a5743-f18e-40c3-92e1-0bdf16ee4bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:30.618114 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a5743-f18e-40c3-92e1-0bdf16ee4bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:30.654978 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a91a5743-f18e-40c3-92e1-0bdf16ee4bf6 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:30.657450 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613244d5-4d1c-42f6-97b0-d0e2d330294c admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:30.661047 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-613244d5-4d1c-42f6-97b0-d0e2d330294c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:30.666900 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a91a5743-f18e-40c3-92e1-0bdf16ee4bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:30.821602 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613244d5-4d1c-42f6-97b0-d0e2d330294c admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:30.832878 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115f0f6-b92f-4fb0-b7dd-a3117b675a1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:30.833550 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115f0f6-b92f-4fb0-b7dd-a3117b675a1b service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:30.833837 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115f0f6-b92f-4fb0-b7dd-a3117b675a1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:30.834572 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115f0f6-b92f-4fb0-b7dd-a3117b675a1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:30.849293 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 830/1654] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:30.850851 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e9d52-d621-4a3e-b4c5-192948f01bf4 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:30.851144 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e9d52-d621-4a3e-b4c5-192948f01bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:30.851425 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e9d52-d621-4a3e-b4c5-192948f01bf4 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:30.856991 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 831/1655] 10.222.0.32 () {54 vars in 960 bytes} [Wed Jun 1 04:27:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:27:30.857929 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5115f0f6-b92f-4fb0-b7dd-a3117b675a1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:30.859417 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5115f0f6-b92f-4fb0-b7dd-a3117b675a1b service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:30.865150 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83f899-781a-4833-9969-5a51d6a65493 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:30.865657 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83f899-781a-4833-9969-5a51d6a65493 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:30.866130 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83f899-781a-4833-9969-5a51d6a65493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:30.890053 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 825/1656] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:27:30.890952 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115f0f6-b92f-4fb0-b7dd-a3117b675a1b service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:30.894701 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-5115f0f6-b92f-4fb0-b7dd-a3117b675a1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:30.900972 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-6b83f899-781a-4833-9969-5a51d6a65493 None None] MFA Rules not processed for user `0433f6219478476286ea27c5c82d41a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:30.907821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6b83f899-781a-4833-9969-5a51d6a65493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:30.915934 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115f0f6-b92f-4fb0-b7dd-a3117b675a1b service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:30.928442 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56836c86-f3b1-401c-832d-5bb6aa02269f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:30.929305 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56836c86-f3b1-401c-832d-5bb6aa02269f service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:30.930031 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56836c86-f3b1-401c-832d-5bb6aa02269f service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:30.930340 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56836c86-f3b1-401c-832d-5bb6aa02269f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:30.968742 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56836c86-f3b1-401c-832d-5bb6aa02269f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:30.968742 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56836c86-f3b1-401c-832d-5bb6aa02269f service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:30.986313 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 826/1657] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:27:31.014813 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:31.032751 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 832/1658] 10.222.0.32 () {58 vars in 1057 bytes} [Wed Jun 1 04:27:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:31.041468 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56836c86-f3b1-401c-832d-5bb6aa02269f service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:31.059609 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56836c86-f3b1-401c-832d-5bb6aa02269f service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:31.067949 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97ee11-1c8f-4434-847d-4382e6c5dd0e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0433f6219478476286ea27c5c82d41a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:31.069164 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97ee11-1c8f-4434-847d-4382e6c5dd0e service placement] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:31.069601 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97ee11-1c8f-4434-847d-4382e6c5dd0e service placement] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:31.070149 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97ee11-1c8f-4434-847d-4382e6c5dd0e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:31.073724 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3d97ee11-1c8f-4434-847d-4382e6c5dd0e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:31.116677 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97ee11-1c8f-4434-847d-4382e6c5dd0e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:31.122921 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97ee11-1c8f-4434-847d-4382e6c5dd0e service placement] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:31.158402 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 827/1659] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:27:31.949065 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83f899-781a-4833-9969-5a51d6a65493 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:31.951026 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6b83f899-781a-4833-9969-5a51d6a65493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:31.979149 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83f899-781a-4833-9969-5a51d6a65493 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:31.991678 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c259d874-3571-46a0-8e73-b5e3f3857bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:31.992675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259d874-3571-46a0-8e73-b5e3f3857bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:31.993884 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259d874-3571-46a0-8e73-b5e3f3857bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:31.994747 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259d874-3571-46a0-8e73-b5e3f3857bfb admin admin] PATH_INFO: `/v3/projects/d1310f73739a487cbf4c069f29735b0d` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:32.000574 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c259d874-3571-46a0-8e73-b5e3f3857bfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1310f73739a487cbf4c069f29735b0d)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:32.004122 dv-cinder-667108-37-smb devstack@keystone.service[80231]: WARNING py.warnings [None req-c259d874-3571-46a0-8e73-b5e3f3857bfb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 01 04:27:32.004122 dv-cinder-667108-37-smb devstack@keystone.service[80231]: warnings.warn(msg) Jun 01 04:27:32.004122 dv-cinder-667108-37-smb devstack@keystone.service[80231]: Jun 01 04:27:32.006985 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c259d874-3571-46a0-8e73-b5e3f3857bfb admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:32.208882 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c259d874-3571-46a0-8e73-b5e3f3857bfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1310f73739a487cbf4c069f29735b0d', 'request_id': 'req-c259d874-3571-46a0-8e73-b5e3f3857bfb'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:32.226680 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c259d874-3571-46a0-8e73-b5e3f3857bfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1310f73739a487cbf4c069f29735b0d', 'request_id': 'req-c259d874-3571-46a0-8e73-b5e3f3857bfb'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:32.240709 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c259d874-3571-46a0-8e73-b5e3f3857bfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1310f73739a487cbf4c069f29735b0d', 'request_id': 'req-c259d874-3571-46a0-8e73-b5e3f3857bfb'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:32.275279 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97ee11-1c8f-4434-847d-4382e6c5dd0e service placement] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:32.275979 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c259d874-3571-46a0-8e73-b5e3f3857bfb admin admin] The token cache is being invalidate because project d1310f73739a487cbf4c069f29735b0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:27:32.276555 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c259d874-3571-46a0-8e73-b5e3f3857bfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:32.277208 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3d97ee11-1c8f-4434-847d-4382e6c5dd0e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:32.277389 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c259d874-3571-46a0-8e73-b5e3f3857bfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:32.280295 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 833/1660] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:27:31 2022] DELETE /identity/v3/projects/d1310f73739a487cbf4c069f29735b0d => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:32.285100 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3c7ec-28f3-46aa-9d5d-d3a90cfa8c92 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:32.285834 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3c7ec-28f3-46aa-9d5d-d3a90cfa8c92 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:32.286340 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3c7ec-28f3-46aa-9d5d-d3a90cfa8c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:32.311417 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97ee11-1c8f-4434-847d-4382e6c5dd0e service placement] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:32.320484 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-4ef3c7ec-28f3-46aa-9d5d-d3a90cfa8c92 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:32.322755 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4ef3c7ec-28f3-46aa-9d5d-d3a90cfa8c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:32.445012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:32.477195 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de18ec3-9098-45f8-b594-81d006a59be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:32.478120 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de18ec3-9098-45f8-b594-81d006a59be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:32.478407 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de18ec3-9098-45f8-b594-81d006a59be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:32.479581 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de18ec3-9098-45f8-b594-81d006a59be4 admin admin] PATH_INFO: `/v3/projects/f274461557084b898c8150c79a2edbfd` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:32.482273 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de18ec3-9098-45f8-b594-81d006a59be4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f274461557084b898c8150c79a2edbfd)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:32.486063 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de18ec3-9098-45f8-b594-81d006a59be4 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:32.595268 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 834/1661] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:27:32.603242 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c5ad7-054e-473b-9618-17a612a0d4bc None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:32.603242 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c5ad7-054e-473b-9618-17a612a0d4bc None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:32.603500 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c5ad7-054e-473b-9618-17a612a0d4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:32.615842 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7de18ec3-9098-45f8-b594-81d006a59be4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f274461557084b898c8150c79a2edbfd', 'request_id': 'req-7de18ec3-9098-45f8-b594-81d006a59be4'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:32.637941 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7de18ec3-9098-45f8-b594-81d006a59be4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f274461557084b898c8150c79a2edbfd', 'request_id': 'req-7de18ec3-9098-45f8-b594-81d006a59be4'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:32.652646 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7de18ec3-9098-45f8-b594-81d006a59be4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f274461557084b898c8150c79a2edbfd', 'request_id': 'req-7de18ec3-9098-45f8-b594-81d006a59be4'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:32.679902 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-254c5ad7-054e-473b-9618-17a612a0d4bc None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:32.683453 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-254c5ad7-054e-473b-9618-17a612a0d4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:32.695936 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7de18ec3-9098-45f8-b594-81d006a59be4 admin admin] The token cache is being invalidate because project f274461557084b898c8150c79a2edbfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:27:32.697652 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7de18ec3-9098-45f8-b594-81d006a59be4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:32.701782 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7de18ec3-9098-45f8-b594-81d006a59be4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:32.710851 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 828/1662] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:27:32 2022] DELETE /identity/v3/projects/f274461557084b898c8150c79a2edbfd => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:32.715587 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de18ec3-9098-45f8-b594-81d006a59be4 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:32.721180 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7de18ec3-9098-45f8-b594-81d006a59be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:32.987042 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 835/1663] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:32.991344 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c5ad7-054e-473b-9618-17a612a0d4bc None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:33.034916 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c5ad7-054e-473b-9618-17a612a0d4bc None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:33.045649 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de18ec3-9098-45f8-b594-81d006a59be4 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:33.056035 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444478d-0889-4002-a246-f532a7a9929c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:33.059374 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444478d-0889-4002-a246-f532a7a9929c admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:33.059972 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444478d-0889-4002-a246-f532a7a9929c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:33.060431 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444478d-0889-4002-a246-f532a7a9929c admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:33.062653 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444478d-0889-4002-a246-f532a7a9929c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:27:33.063503 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3476d36-bde7-4517-8e62-898413bb4d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:33.064054 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444478d-0889-4002-a246-f532a7a9929c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:33.064452 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3476d36-bde7-4517-8e62-898413bb4d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:33.065930 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3476d36-bde7-4517-8e62-898413bb4d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:33.067061 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3476d36-bde7-4517-8e62-898413bb4d96 admin admin] PATH_INFO: `/v3/users/0d1f71b8880c41018c7de4a8925c557a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:33.070877 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3476d36-bde7-4517-8e62-898413bb4d96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d1f71b8880c41018c7de4a8925c557a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:33.071605 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444478d-0889-4002-a246-f532a7a9929c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:33.078267 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3476d36-bde7-4517-8e62-898413bb4d96 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:33.122953 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 836/1664] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:27:33.124278 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444478d-0889-4002-a246-f532a7a9929c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:33.158133 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444478d-0889-4002-a246-f532a7a9929c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:33.184537 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd0f8d-7884-4ebe-9c41-aaf0361b6f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:33.189134 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd0f8d-7884-4ebe-9c41-aaf0361b6f15 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:33.189894 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd0f8d-7884-4ebe-9c41-aaf0361b6f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:33.191295 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd0f8d-7884-4ebe-9c41-aaf0361b6f15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:33.194660 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd0f8d-7884-4ebe-9c41-aaf0361b6f15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:33.200398 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd0f8d-7884-4ebe-9c41-aaf0361b6f15 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:33.212498 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d3476d36-bde7-4517-8e62-898413bb4d96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d1f71b8880c41018c7de4a8925c557a'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:33.214116 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d3476d36-bde7-4517-8e62-898413bb4d96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d1f71b8880c41018c7de4a8925c557a'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:33.220719 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:33.253752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d3476d36-bde7-4517-8e62-898413bb4d96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d1f71b8880c41018c7de4a8925c557a'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:33.280865 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d3476d36-bde7-4517-8e62-898413bb4d96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d1f71b8880c41018c7de4a8925c557a'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:33.303788 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d3476d36-bde7-4517-8e62-898413bb4d96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d1f71b8880c41018c7de4a8925c557a'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:33.307220 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:33.314664 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 837/1665] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:27:33 2022] POST /identity/v3/projects => generated 393 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:33.317166 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd0f8d-7884-4ebe-9c41-aaf0361b6f15 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:33.322302 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-02bd0f8d-7884-4ebe-9c41-aaf0361b6f15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:33.336769 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 829/1666] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:27:32 2022] DELETE /identity/v3/users/0d1f71b8880c41018c7de4a8925c557a => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:33.552238 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd0f8d-7884-4ebe-9c41-aaf0361b6f15 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:33.710928 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311c2df-0321-4ced-ad79-1b45175231f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:33.711638 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311c2df-0321-4ced-ad79-1b45175231f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:33.713864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311c2df-0321-4ced-ad79-1b45175231f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:33.714261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311c2df-0321-4ced-ad79-1b45175231f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:33.716422 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311c2df-0321-4ced-ad79-1b45175231f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:33.721798 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311c2df-0321-4ced-ad79-1b45175231f7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:33.778127 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3476d36-bde7-4517-8e62-898413bb4d96 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:33.792058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 838/1667] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:27:33 2022] POST /identity/v3/users => generated 297 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:33.803419 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3476d36-bde7-4517-8e62-898413bb4d96 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:33.829938 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82701b89-1fad-484f-8fcd-2bb026855210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:33.835283 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82701b89-1fad-484f-8fcd-2bb026855210 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:33.836565 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82701b89-1fad-484f-8fcd-2bb026855210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:33.844237 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82701b89-1fad-484f-8fcd-2bb026855210 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:33.845857 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82701b89-1fad-484f-8fcd-2bb026855210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:33.849309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82701b89-1fad-484f-8fcd-2bb026855210 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:33.883449 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 830/1668] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:33.886560 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311c2df-0321-4ced-ad79-1b45175231f7 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:33.926926 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311c2df-0321-4ced-ad79-1b45175231f7 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:33.957014 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f82ee9-9b66-4d08-880e-9c0b338d69bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:33.957901 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f82ee9-9b66-4d08-880e-9c0b338d69bb admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:33.958247 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f82ee9-9b66-4d08-880e-9c0b338d69bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:33.958525 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f82ee9-9b66-4d08-880e-9c0b338d69bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:33.959527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f82ee9-9b66-4d08-880e-9c0b338d69bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:33.966307 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f82ee9-9b66-4d08-880e-9c0b338d69bb admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:34.005158 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82701b89-1fad-484f-8fcd-2bb026855210 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:34.007729 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 839/1669] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:34.030765 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82701b89-1fad-484f-8fcd-2bb026855210 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:34.045749 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd750f-305c-4bc4-a781-2510142a4009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:34.046174 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd750f-305c-4bc4-a781-2510142a4009 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:34.046456 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd750f-305c-4bc4-a781-2510142a4009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:34.046735 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd750f-305c-4bc4-a781-2510142a4009 admin admin] PATH_INFO: `/v3/projects/bfa22034c9de4c7694b21f2f741a5db3/users/a288a0126c624b5daa4e8422e8a5df21/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:34.082907 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd750f-305c-4bc4-a781-2510142a4009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfa22034c9de4c7694b21f2f741a5db3, user_id=a288a0126c624b5daa4e8422e8a5df21, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:34.085903 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd750f-305c-4bc4-a781-2510142a4009 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:34.124390 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f82ee9-9b66-4d08-880e-9c0b338d69bb admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:34.127868 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f6f82ee9-9b66-4d08-880e-9c0b338d69bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:34.141575 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 831/1670] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:27:34 2022] PUT /identity/v3/projects/bfa22034c9de4c7694b21f2f741a5db3/users/a288a0126c624b5daa4e8422e8a5df21/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:34.154768 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f82ee9-9b66-4d08-880e-9c0b338d69bb admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:34.161588 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50598e0-006c-4192-8752-9036a5a60144 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:34.161880 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50598e0-006c-4192-8752-9036a5a60144 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:34.162189 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50598e0-006c-4192-8752-9036a5a60144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:34.224178 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-e50598e0-006c-4192-8752-9036a5a60144 None None] MFA Rules not processed for user `a288a0126c624b5daa4e8422e8a5df21`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:34.225723 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e50598e0-006c-4192-8752-9036a5a60144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:34.288609 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec84a38-efaa-4d2a-b889-675faf92c6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:34.290004 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec84a38-efaa-4d2a-b889-675faf92c6f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:34.292731 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec84a38-efaa-4d2a-b889-675faf92c6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:34.293226 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec84a38-efaa-4d2a-b889-675faf92c6f5 admin admin] PATH_INFO: `/v3/users/01cbcd59d95f497ea9071ee7be5e3f5c` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:34.296548 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec84a38-efaa-4d2a-b889-675faf92c6f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01cbcd59d95f497ea9071ee7be5e3f5c)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:34.299253 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec84a38-efaa-4d2a-b889-675faf92c6f5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:34.337497 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:34.419971 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2ec84a38-efaa-4d2a-b889-675faf92c6f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01cbcd59d95f497ea9071ee7be5e3f5c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:34.421049 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2ec84a38-efaa-4d2a-b889-675faf92c6f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01cbcd59d95f497ea9071ee7be5e3f5c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:34.452828 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 832/1671] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:34.454102 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50598e0-006c-4192-8752-9036a5a60144 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:34.456744 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e50598e0-006c-4192-8752-9036a5a60144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:34.457605 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2ec84a38-efaa-4d2a-b889-675faf92c6f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01cbcd59d95f497ea9071ee7be5e3f5c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:34.475193 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2ec84a38-efaa-4d2a-b889-675faf92c6f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01cbcd59d95f497ea9071ee7be5e3f5c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:34.476172 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2ec84a38-efaa-4d2a-b889-675faf92c6f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01cbcd59d95f497ea9071ee7be5e3f5c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:34.482824 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50598e0-006c-4192-8752-9036a5a60144 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:34.494480 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79e9e7-9788-4e93-8e2d-807d4efd51a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:34.496055 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79e9e7-9788-4e93-8e2d-807d4efd51a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:34.497167 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79e9e7-9788-4e93-8e2d-807d4efd51a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:34.497719 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79e9e7-9788-4e93-8e2d-807d4efd51a4 admin admin] PATH_INFO: `/v3/users/aaf8896606044cbc9a17f9e639885157` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:34.500322 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79e9e7-9788-4e93-8e2d-807d4efd51a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaf8896606044cbc9a17f9e639885157)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:34.504511 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79e9e7-9788-4e93-8e2d-807d4efd51a4 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:34.510287 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 840/1672] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:27:34 2022] DELETE /identity/v3/users/01cbcd59d95f497ea9071ee7be5e3f5c => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:34.513582 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec84a38-efaa-4d2a-b889-675faf92c6f5 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:34.516063 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2ec84a38-efaa-4d2a-b889-675faf92c6f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:34.634627 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ab79e9e7-9788-4e93-8e2d-807d4efd51a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaf8896606044cbc9a17f9e639885157'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:34.638237 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ab79e9e7-9788-4e93-8e2d-807d4efd51a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaf8896606044cbc9a17f9e639885157'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:34.675079 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ab79e9e7-9788-4e93-8e2d-807d4efd51a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaf8896606044cbc9a17f9e639885157'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:34.695344 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ab79e9e7-9788-4e93-8e2d-807d4efd51a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaf8896606044cbc9a17f9e639885157'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:34.715212 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec84a38-efaa-4d2a-b889-675faf92c6f5 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:34.723157 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ab79e9e7-9788-4e93-8e2d-807d4efd51a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaf8896606044cbc9a17f9e639885157'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:34.743340 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 833/1673] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:27:34 2022] DELETE /identity/v3/users/aaf8896606044cbc9a17f9e639885157 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:34.744045 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d6070-bfa2-459f-bcf6-5a42a3609800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:34.745245 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d6070-bfa2-459f-bcf6-5a42a3609800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:34.745830 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d6070-bfa2-459f-bcf6-5a42a3609800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:34.746466 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d6070-bfa2-459f-bcf6-5a42a3609800 admin admin] PATH_INFO: `/v3/projects/733ff40753b743a3b6af371f4780c652` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:34.748131 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79e9e7-9788-4e93-8e2d-807d4efd51a4 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:34.749022 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d6070-bfa2-459f-bcf6-5a42a3609800 admin admin] RBAC: Authorizing `identity:delete_project(project_id=733ff40753b743a3b6af371f4780c652)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:34.751573 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-ab79e9e7-9788-4e93-8e2d-807d4efd51a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:34.763620 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d6070-bfa2-459f-bcf6-5a42a3609800 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:34.841513 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:34.968057 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79e9e7-9788-4e93-8e2d-807d4efd51a4 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:34.974636 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-168d6070-bfa2-459f-bcf6-5a42a3609800 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '733ff40753b743a3b6af371f4780c652', 'request_id': 'req-168d6070-bfa2-459f-bcf6-5a42a3609800'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:34.989241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-168d6070-bfa2-459f-bcf6-5a42a3609800 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '733ff40753b743a3b6af371f4780c652', 'request_id': 'req-168d6070-bfa2-459f-bcf6-5a42a3609800'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:35.007841 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-168d6070-bfa2-459f-bcf6-5a42a3609800 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '733ff40753b743a3b6af371f4780c652', 'request_id': 'req-168d6070-bfa2-459f-bcf6-5a42a3609800'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:35.066992 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-168d6070-bfa2-459f-bcf6-5a42a3609800 admin admin] The token cache is being invalidate because project 733ff40753b743a3b6af371f4780c652 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:27:35.067315 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-168d6070-bfa2-459f-bcf6-5a42a3609800 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:35.068003 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-168d6070-bfa2-459f-bcf6-5a42a3609800 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:35.069860 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 841/1674] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:27:34 2022] DELETE /identity/v3/projects/733ff40753b743a3b6af371f4780c652 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:35.071178 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb0f60-030f-4cef-bf91-b5583a7f29b9 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:35.071471 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb0f60-030f-4cef-bf91-b5583a7f29b9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:35.071752 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb0f60-030f-4cef-bf91-b5583a7f29b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:35.108178 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-8cbb0f60-030f-4cef-bf91-b5583a7f29b9 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:35.109455 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8cbb0f60-030f-4cef-bf91-b5583a7f29b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:35.145501 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6790ac-ef3f-416c-b575-afb97e559cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:35.146645 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6790ac-ef3f-416c-b575-afb97e559cdd admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:35.147122 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6790ac-ef3f-416c-b575-afb97e559cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:35.147813 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6790ac-ef3f-416c-b575-afb97e559cdd admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:35.150230 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6790ac-ef3f-416c-b575-afb97e559cdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:35.160750 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6790ac-ef3f-416c-b575-afb97e559cdd admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:35.162439 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:35.260745 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 834/1675] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:27:34 2022] POST /identity/v3/projects => generated 389 bytes in 517 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:35.262808 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220de87-a3f9-484a-af63-1deb06776769 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:35.263101 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220de87-a3f9-484a-af63-1deb06776769 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:35.263378 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220de87-a3f9-484a-af63-1deb06776769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:35.287023 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-e220de87-a3f9-484a-af63-1deb06776769 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:35.287212 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 842/1676] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:35.288514 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b87ff-59c1-449e-822d-2167bdf95cf0 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:35.288811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b87ff-59c1-449e-822d-2167bdf95cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:35.289092 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b87ff-59c1-449e-822d-2167bdf95cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:35.291712 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e220de87-a3f9-484a-af63-1deb06776769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:35.314401 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c66b87ff-59c1-449e-822d-2167bdf95cf0 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:35.315655 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c66b87ff-59c1-449e-822d-2167bdf95cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:35.452828 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 843/1677] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:35.454496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073c573-0ff5-45d3-ae73-65dca45d8082 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:35.454781 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073c573-0ff5-45d3-ae73-65dca45d8082 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:35.455065 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073c573-0ff5-45d3-ae73-65dca45d8082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:35.469224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 835/1678] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:35.471795 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220de87-a3f9-484a-af63-1deb06776769 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:35.476803 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e220de87-a3f9-484a-af63-1deb06776769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:35.487389 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d073c573-0ff5-45d3-ae73-65dca45d8082 None None] MFA Rules not processed for user `3fa2ad34164a4631adf76fbd042679ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:35.488620 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d073c573-0ff5-45d3-ae73-65dca45d8082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:35.495755 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220de87-a3f9-484a-af63-1deb06776769 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:35.515378 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b63a00-d260-46cc-8c39-f1df8fe12493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:35.517493 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b63a00-d260-46cc-8c39-f1df8fe12493 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:35.518160 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b63a00-d260-46cc-8c39-f1df8fe12493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:35.518809 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b63a00-d260-46cc-8c39-f1df8fe12493 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:35.519830 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b63a00-d260-46cc-8c39-f1df8fe12493 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:35.525593 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b63a00-d260-46cc-8c39-f1df8fe12493 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:35.576616 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 844/1679] 10.222.0.32 () {58 vars in 1009 bytes} [Wed Jun 1 04:27:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:35.577548 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d073c573-0ff5-45d3-ae73-65dca45d8082 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:35.580844 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 836/1680] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:27:35 2022] POST /identity/v3/users => generated 301 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:35.583174 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d073c573-0ff5-45d3-ae73-65dca45d8082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:35.584561 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d27414-d2b9-46a4-98bc-84459aa63847 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:35.584889 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d27414-d2b9-46a4-98bc-84459aa63847 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:35.585180 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d27414-d2b9-46a4-98bc-84459aa63847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:35.627795 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-07d27414-d2b9-46a4-98bc-84459aa63847 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:35.628715 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-07d27414-d2b9-46a4-98bc-84459aa63847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:35.650667 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 837/1681] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:35.654671 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d27414-d2b9-46a4-98bc-84459aa63847 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:35.667499 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d27414-d2b9-46a4-98bc-84459aa63847 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:35.678686 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f2235-9a8a-4fa1-a8c4-4e565b2bfb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:35.680504 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f2235-9a8a-4fa1-a8c4-4e565b2bfb6b admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:35.680804 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f2235-9a8a-4fa1-a8c4-4e565b2bfb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:35.681090 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f2235-9a8a-4fa1-a8c4-4e565b2bfb6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:35.681842 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f2235-9a8a-4fa1-a8c4-4e565b2bfb6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:35.685317 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f2235-9a8a-4fa1-a8c4-4e565b2bfb6b admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:35.700534 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 838/1682] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:35.701395 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f2235-9a8a-4fa1-a8c4-4e565b2bfb6b admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:35.710297 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d073c573-0ff5-45d3-ae73-65dca45d8082 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:35.716113 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a33917-b17f-4e98-9251-40ca27406df2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:35.717069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a33917-b17f-4e98-9251-40ca27406df2 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:35.717497 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a33917-b17f-4e98-9251-40ca27406df2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:35.718329 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a33917-b17f-4e98-9251-40ca27406df2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:35.722834 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f2235-9a8a-4fa1-a8c4-4e565b2bfb6b admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:35.731336 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4ee8f-e829-41fb-8003-0199c6b92201 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:35.732018 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4ee8f-e829-41fb-8003-0199c6b92201 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:35.732305 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4ee8f-e829-41fb-8003-0199c6b92201 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:35.732584 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4ee8f-e829-41fb-8003-0199c6b92201 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:35.733995 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a33917-b17f-4e98-9251-40ca27406df2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:35.736131 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a33917-b17f-4e98-9251-40ca27406df2 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:35.749461 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 845/1683] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:27:35.750488 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a33917-b17f-4e98-9251-40ca27406df2 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:35.757913 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f4ee8f-e829-41fb-8003-0199c6b92201 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:35.759460 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f4ee8f-e829-41fb-8003-0199c6b92201 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:35.761800 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a33917-b17f-4e98-9251-40ca27406df2 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:35.772111 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f96e71-c49c-46eb-a8a2-0cfc939c80a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:35.773365 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f96e71-c49c-46eb-a8a2-0cfc939c80a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:35.773658 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f96e71-c49c-46eb-a8a2-0cfc939c80a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:35.773938 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f96e71-c49c-46eb-a8a2-0cfc939c80a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:35.774710 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f96e71-c49c-46eb-a8a2-0cfc939c80a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:27:35.775490 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f96e71-c49c-46eb-a8a2-0cfc939c80a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:35.778225 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f96e71-c49c-46eb-a8a2-0cfc939c80a5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:35.781082 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 839/1684] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:27:35.781930 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4ee8f-e829-41fb-8003-0199c6b92201 service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:35.786602 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:35.794015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 846/1685] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:27:35.795346 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f96e71-c49c-46eb-a8a2-0cfc939c80a5 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:35.803642 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e6f96e71-c49c-46eb-a8a2-0cfc939c80a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:35.812083 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4ee8f-e829-41fb-8003-0199c6b92201 service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:35.855612 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abda75-2375-4d03-a4c3-830be2849a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:35.857090 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abda75-2375-4d03-a4c3-830be2849a74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:35.857456 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abda75-2375-4d03-a4c3-830be2849a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:35.857652 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abda75-2375-4d03-a4c3-830be2849a74 admin admin] PATH_INFO: `/v3/projects/d4745b4aca274ff596622d7cfaa5cb2c/users/01e06890c8af4925bbc9ce0f6e6d4310/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:35.886257 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:35.898397 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5abda75-2375-4d03-a4c3-830be2849a74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4745b4aca274ff596622d7cfaa5cb2c, user_id=01e06890c8af4925bbc9ce0f6e6d4310, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:35.901083 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5abda75-2375-4d03-a4c3-830be2849a74 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:35.934018 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 840/1686] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:27:35 2022] PUT /identity/v3/projects/d4745b4aca274ff596622d7cfaa5cb2c/users/01e06890c8af4925bbc9ce0f6e6d4310/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:35.934018 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abda75-2375-4d03-a4c3-830be2849a74 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:35.971665 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f96e71-c49c-46eb-a8a2-0cfc939c80a5 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:36.065248 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abda75-2375-4d03-a4c3-830be2849a74 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:36.075342 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f554b8e-d713-4e5d-90d0-5e3dcb6d3d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:36.076022 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f554b8e-d713-4e5d-90d0-5e3dcb6d3d17 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:36.076309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f554b8e-d713-4e5d-90d0-5e3dcb6d3d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:36.077661 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f554b8e-d713-4e5d-90d0-5e3dcb6d3d17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:36.077661 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f554b8e-d713-4e5d-90d0-5e3dcb6d3d17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:36.079231 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f554b8e-d713-4e5d-90d0-5e3dcb6d3d17 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:36.118143 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181c668-2d2c-462c-86e6-a0686e594344 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413c6613b4ec4e53aeeaf6828c807273', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:36.118803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181c668-2d2c-462c-86e6-a0686e594344 service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:36.118803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181c668-2d2c-462c-86e6-a0686e594344 service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:36.120642 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181c668-2d2c-462c-86e6-a0686e594344 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:36.146319 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 841/1687] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:27:35 2022] POST /identity/v3/projects => generated 377 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:36.147813 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f554b8e-d713-4e5d-90d0-5e3dcb6d3d17 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:36.248830 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181c668-2d2c-462c-86e6-a0686e594344 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:36.250447 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181c668-2d2c-462c-86e6-a0686e594344 service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:36.271570 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 847/1688] 10.222.0.32 () {60 vars in 1384 bytes} [Wed Jun 1 04:27:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 01 04:27:36.285067 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181c668-2d2c-462c-86e6-a0686e594344 service swift] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:36.336319 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181c668-2d2c-462c-86e6-a0686e594344 service swift] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:36.363467 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb143e1-9a46-4bcc-a4c8-2e25350af4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:36.364670 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb143e1-9a46-4bcc-a4c8-2e25350af4a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:36.368075 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb143e1-9a46-4bcc-a4c8-2e25350af4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:36.368382 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb143e1-9a46-4bcc-a4c8-2e25350af4a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:36.369187 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb143e1-9a46-4bcc-a4c8-2e25350af4a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:36.372393 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb143e1-9a46-4bcc-a4c8-2e25350af4a6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:36.380967 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f554b8e-d713-4e5d-90d0-5e3dcb6d3d17 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:36.395479 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695dc4b8-7f1a-441f-b31c-d476f7d4eef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:36.396179 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695dc4b8-7f1a-441f-b31c-d476f7d4eef3 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:36.396470 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695dc4b8-7f1a-441f-b31c-d476f7d4eef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:36.396815 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695dc4b8-7f1a-441f-b31c-d476f7d4eef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:36.397592 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695dc4b8-7f1a-441f-b31c-d476f7d4eef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:36.411280 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695dc4b8-7f1a-441f-b31c-d476f7d4eef3 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:36.443512 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 848/1689] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:27:36 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:36.445709 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb143e1-9a46-4bcc-a4c8-2e25350af4a6 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:36.452426 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 842/1690] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:36.460498 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695dc4b8-7f1a-441f-b31c-d476f7d4eef3 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:36.491973 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb143e1-9a46-4bcc-a4c8-2e25350af4a6 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:36.509489 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695dc4b8-7f1a-441f-b31c-d476f7d4eef3 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:36.520922 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99097064-ac01-4360-94ab-63ba9fcadd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:36.522722 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99097064-ac01-4360-94ab-63ba9fcadd09 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:36.525750 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99097064-ac01-4360-94ab-63ba9fcadd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:36.526089 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99097064-ac01-4360-94ab-63ba9fcadd09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:36.526822 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99097064-ac01-4360-94ab-63ba9fcadd09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:36.527255 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee5b7a-9ad8-48b1-bbbb-ecd9e7cb8dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:36.528909 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee5b7a-9ad8-48b1-bbbb-ecd9e7cb8dba admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:36.529304 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee5b7a-9ad8-48b1-bbbb-ecd9e7cb8dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:36.529472 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee5b7a-9ad8-48b1-bbbb-ecd9e7cb8dba admin admin] PATH_INFO: `/v3/projects/d4745b4aca274ff596622d7cfaa5cb2c/users/01e06890c8af4925bbc9ce0f6e6d4310/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:36.541394 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99097064-ac01-4360-94ab-63ba9fcadd09 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:36.547752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee5b7a-9ad8-48b1-bbbb-ecd9e7cb8dba admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4745b4aca274ff596622d7cfaa5cb2c, user_id=01e06890c8af4925bbc9ce0f6e6d4310, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:36.566401 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee5b7a-9ad8-48b1-bbbb-ecd9e7cb8dba admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:36.616635 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 843/1691] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:27:36 2022] PUT /identity/v3/projects/d4745b4aca274ff596622d7cfaa5cb2c/users/01e06890c8af4925bbc9ce0f6e6d4310/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:36.630951 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 849/1692] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:36.631134 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c83ad1-a99a-4e2f-8d29-8ad1ff0e89e1 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:36.631134 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c83ad1-a99a-4e2f-8d29-8ad1ff0e89e1 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:36.631134 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c83ad1-a99a-4e2f-8d29-8ad1ff0e89e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:36.635259 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99097064-ac01-4360-94ab-63ba9fcadd09 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:36.673418 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99097064-ac01-4360-94ab-63ba9fcadd09 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:36.698474 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:36.717469 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-39c83ad1-a99a-4e2f-8d29-8ad1ff0e89e1 None None] MFA Rules not processed for user `01e06890c8af4925bbc9ce0f6e6d4310`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:36.718763 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-39c83ad1-a99a-4e2f-8d29-8ad1ff0e89e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:36.827539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:36.833414 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e74cd-41a2-46de-b285-72393938fc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:36.835472 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e74cd-41a2-46de-b285-72393938fc46 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:36.837191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e74cd-41a2-46de-b285-72393938fc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:36.837619 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e74cd-41a2-46de-b285-72393938fc46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:36.838546 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e74cd-41a2-46de-b285-72393938fc46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:36.845682 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e74cd-41a2-46de-b285-72393938fc46 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:36.876699 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 850/1693] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:36.877604 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e74cd-41a2-46de-b285-72393938fc46 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:36.889536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 844/1694] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:36 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:36.903856 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c83ad1-a99a-4e2f-8d29-8ad1ff0e89e1 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:36.905506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-39c83ad1-a99a-4e2f-8d29-8ad1ff0e89e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:36.911247 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e74cd-41a2-46de-b285-72393938fc46 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:36.926816 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155165d-be6d-4753-802b-668ae628eab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:36.928373 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155165d-be6d-4753-802b-668ae628eab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:36.928872 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155165d-be6d-4753-802b-668ae628eab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:36.929331 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155165d-be6d-4753-802b-668ae628eab8 admin admin] PATH_INFO: `/v3/projects/771e901107914969b4e47a811973715e/users/5815dd28f01c44658aa56f3110f9e03d/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:36.973820 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155165d-be6d-4753-802b-668ae628eab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=771e901107914969b4e47a811973715e, user_id=5815dd28f01c44658aa56f3110f9e03d, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:36.977274 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155165d-be6d-4753-802b-668ae628eab8 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:37.017369 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 851/1695] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:27:36 2022] PUT /identity/v3/projects/771e901107914969b4e47a811973715e/users/5815dd28f01c44658aa56f3110f9e03d/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:37.020859 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e578264-5c85-4d8e-a0fe-ac4ce9e29c1c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:37.021880 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e578264-5c85-4d8e-a0fe-ac4ce9e29c1c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:37.022334 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e578264-5c85-4d8e-a0fe-ac4ce9e29c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:37.101839 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2e578264-5c85-4d8e-a0fe-ac4ce9e29c1c None None] MFA Rules not processed for user `5815dd28f01c44658aa56f3110f9e03d`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:37.103504 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2e578264-5c85-4d8e-a0fe-ac4ce9e29c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:37.152567 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c83ad1-a99a-4e2f-8d29-8ad1ff0e89e1 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:37.290913 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 852/1696] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:37.296974 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e578264-5c85-4d8e-a0fe-ac4ce9e29c1c None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:37.352540 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0818a-1e6f-4778-a7ad-166581d5445a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:37.353440 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0818a-1e6f-4778-a7ad-166581d5445a service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:37.353866 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0818a-1e6f-4778-a7ad-166581d5445a service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:37.354473 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0818a-1e6f-4778-a7ad-166581d5445a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:37.468917 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e578264-5c85-4d8e-a0fe-ac4ce9e29c1c None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:37.484080 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c822925-d027-41ca-8a7e-f1395f8e1cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:37.485103 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c822925-d027-41ca-8a7e-f1395f8e1cc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:37.485103 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c822925-d027-41ca-8a7e-f1395f8e1cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:37.485334 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c822925-d027-41ca-8a7e-f1395f8e1cc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:37.490179 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c822925-d027-41ca-8a7e-f1395f8e1cc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:37.493214 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c822925-d027-41ca-8a7e-f1395f8e1cc2 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:37.541782 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf0818a-1e6f-4778-a7ad-166581d5445a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:37.545307 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf0818a-1e6f-4778-a7ad-166581d5445a service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:37.549049 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:37.577892 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 845/1697] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:36 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:27:37.604717 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 853/1698] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:27:37 2022] POST /identity/v3/projects => generated 379 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:37.606562 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0818a-1e6f-4778-a7ad-166581d5445a service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:37.630783 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0818a-1e6f-4778-a7ad-166581d5445a service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:37.686920 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c822925-d027-41ca-8a7e-f1395f8e1cc2 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:37.688799 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0c822925-d027-41ca-8a7e-f1395f8e1cc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:37.843415 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:37.921185 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396aed7-ff68-47cc-91a8-78389cc59bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:37.922034 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396aed7-ff68-47cc-91a8-78389cc59bde admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:37.922413 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396aed7-ff68-47cc-91a8-78389cc59bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:37.922686 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396aed7-ff68-47cc-91a8-78389cc59bde admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:37.923525 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396aed7-ff68-47cc-91a8-78389cc59bde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:37.925916 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396aed7-ff68-47cc-91a8-78389cc59bde admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:37.944698 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c822925-d027-41ca-8a7e-f1395f8e1cc2 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:37.973197 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68988e1-9cb1-4c55-ac98-371c2873af98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:37.973959 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68988e1-9cb1-4c55-ac98-371c2873af98 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:37.974342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68988e1-9cb1-4c55-ac98-371c2873af98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:37.974624 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68988e1-9cb1-4c55-ac98-371c2873af98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:37.983307 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a68988e1-9cb1-4c55-ac98-371c2873af98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:38.024652 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 846/1699] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:27:37 2022] POST /identity/v3/users => generated 296 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:38.025709 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396aed7-ff68-47cc-91a8-78389cc59bde admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:38.079568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396aed7-ff68-47cc-91a8-78389cc59bde admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:38.113858 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d07410-9166-4b36-8e04-71c5da9e6607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:38.124786 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d07410-9166-4b36-8e04-71c5da9e6607 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:38.125255 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d07410-9166-4b36-8e04-71c5da9e6607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:38.125547 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d07410-9166-4b36-8e04-71c5da9e6607 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:38.131502 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d07410-9166-4b36-8e04-71c5da9e6607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:38.133271 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d07410-9166-4b36-8e04-71c5da9e6607 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:38.191555 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 847/1700] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:38.192639 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d07410-9166-4b36-8e04-71c5da9e6607 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:38.223569 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d07410-9166-4b36-8e04-71c5da9e6607 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:38.238999 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d5ecc-1d39-4460-9da4-33f984e95465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:38.240317 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d5ecc-1d39-4460-9da4-33f984e95465 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:38.240871 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d5ecc-1d39-4460-9da4-33f984e95465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:38.241225 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d5ecc-1d39-4460-9da4-33f984e95465 admin admin] PATH_INFO: `/v3/projects/e0375fc0bec74a4e9ea421b6168a1ec7/users/e4e4cd94703f48398fd531d860838743/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:38.285901 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d5ecc-1d39-4460-9da4-33f984e95465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0375fc0bec74a4e9ea421b6168a1ec7, user_id=e4e4cd94703f48398fd531d860838743, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:38.294307 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d5ecc-1d39-4460-9da4-33f984e95465 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:38.311666 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68988e1-9cb1-4c55-ac98-371c2873af98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:38.318814 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68988e1-9cb1-4c55-ac98-371c2873af98 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:38.326146 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 848/1701] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:27:38 2022] PUT /identity/v3/projects/e0375fc0bec74a4e9ea421b6168a1ec7/users/e4e4cd94703f48398fd531d860838743/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:38.327366 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d5ecc-1d39-4460-9da4-33f984e95465 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:38.360588 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 854/1702] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:27:38.534355 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec679353-f101-4fc6-8a59-c948a947e393 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:38.534829 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec679353-f101-4fc6-8a59-c948a947e393 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:38.535235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec679353-f101-4fc6-8a59-c948a947e393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:38.600801 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-ec679353-f101-4fc6-8a59-c948a947e393 None None] MFA Rules not processed for user `dca5f9455ef349738adf4569fe5ed165`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:38.602149 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d5ecc-1d39-4460-9da4-33f984e95465 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:38.611289 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ec679353-f101-4fc6-8a59-c948a947e393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:38.632370 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105cb5e-86cc-458b-83e8-2eac91421c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:38.633203 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105cb5e-86cc-458b-83e8-2eac91421c51 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:38.636576 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105cb5e-86cc-458b-83e8-2eac91421c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:38.637927 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105cb5e-86cc-458b-83e8-2eac91421c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:38.640018 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105cb5e-86cc-458b-83e8-2eac91421c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:38.649274 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105cb5e-86cc-458b-83e8-2eac91421c51 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:38.703152 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 849/1703] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:38.704309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105cb5e-86cc-458b-83e8-2eac91421c51 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:38.712728 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a105cb5e-86cc-458b-83e8-2eac91421c51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:38.749958 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105cb5e-86cc-458b-83e8-2eac91421c51 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:38.764978 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b1a41-fda1-4732-82e5-54d5c670f805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:38.766068 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b1a41-fda1-4732-82e5-54d5c670f805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:38.766467 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b1a41-fda1-4732-82e5-54d5c670f805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:38.766921 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b1a41-fda1-4732-82e5-54d5c670f805 admin admin] PATH_INFO: `/v3/projects/31b3ce17acd3407f991c7daf91671f48` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:38.769184 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b1a41-fda1-4732-82e5-54d5c670f805 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31b3ce17acd3407f991c7daf91671f48)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:38.777193 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b1a41-fda1-4732-82e5-54d5c670f805 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:38.799539 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 855/1704] 10.222.0.50 () {58 vars in 1015 bytes} [Wed Jun 1 04:27:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:38.801265 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec679353-f101-4fc6-8a59-c948a947e393 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:38.834525 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec679353-f101-4fc6-8a59-c948a947e393 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:38.849021 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3defbdf-ba58-44be-bdb1-69716c939dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:38.850690 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3defbdf-ba58-44be-bdb1-69716c939dfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:38.851135 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3defbdf-ba58-44be-bdb1-69716c939dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:38.851829 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3defbdf-ba58-44be-bdb1-69716c939dfb admin admin] PATH_INFO: `/v3/projects/e0375fc0bec74a4e9ea421b6168a1ec7/users/e4e4cd94703f48398fd531d860838743/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:38.863989 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3defbdf-ba58-44be-bdb1-69716c939dfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0375fc0bec74a4e9ea421b6168a1ec7, user_id=e4e4cd94703f48398fd531d860838743, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:38.871532 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3defbdf-ba58-44be-bdb1-69716c939dfb admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:38.911930 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 856/1705] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:27:38 2022] PUT /identity/v3/projects/e0375fc0bec74a4e9ea421b6168a1ec7/users/e4e4cd94703f48398fd531d860838743/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:38.924019 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3defbdf-ba58-44be-bdb1-69716c939dfb admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:38.929172 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d71b1a41-fda1-4732-82e5-54d5c670f805 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31b3ce17acd3407f991c7daf91671f48', 'request_id': 'req-d71b1a41-fda1-4732-82e5-54d5c670f805'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:38.950357 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d71b1a41-fda1-4732-82e5-54d5c670f805 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31b3ce17acd3407f991c7daf91671f48', 'request_id': 'req-d71b1a41-fda1-4732-82e5-54d5c670f805'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:38.970252 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d71b1a41-fda1-4732-82e5-54d5c670f805 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31b3ce17acd3407f991c7daf91671f48', 'request_id': 'req-d71b1a41-fda1-4732-82e5-54d5c670f805'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:39.025611 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d71b1a41-fda1-4732-82e5-54d5c670f805 admin admin] The token cache is being invalidate because project 31b3ce17acd3407f991c7daf91671f48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:27:39.026142 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d71b1a41-fda1-4732-82e5-54d5c670f805 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:39.029524 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d71b1a41-fda1-4732-82e5-54d5c670f805 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:39.031776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 850/1706] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:27:38 2022] DELETE /identity/v3/projects/31b3ce17acd3407f991c7daf91671f48 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:39.034017 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b1a41-fda1-4732-82e5-54d5c670f805 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:39.037877 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d71b1a41-fda1-4732-82e5-54d5c670f805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:39.093190 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:39.100093 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3defbdf-ba58-44be-bdb1-69716c939dfb admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:39.117491 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeea9e7-f414-4af3-8273-e2cdd792ea34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:39.121246 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeea9e7-f414-4af3-8273-e2cdd792ea34 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:39.121949 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeea9e7-f414-4af3-8273-e2cdd792ea34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:39.122513 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeea9e7-f414-4af3-8273-e2cdd792ea34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:39.128883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4eeea9e7-f414-4af3-8273-e2cdd792ea34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:39.149659 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:39.160473 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeea9e7-f414-4af3-8273-e2cdd792ea34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:39.163424 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeea9e7-f414-4af3-8273-e2cdd792ea34 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:39.181578 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 857/1707] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:27:39.189581 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598e397-33cd-4fb0-ab3d-8396f4637817 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:39.192647 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598e397-33cd-4fb0-ab3d-8396f4637817 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:39.193294 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598e397-33cd-4fb0-ab3d-8396f4637817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:39.219430 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b1a41-fda1-4732-82e5-54d5c670f805 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:39.292070 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-1598e397-33cd-4fb0-ab3d-8396f4637817 None None] MFA Rules not processed for user `e4e4cd94703f48398fd531d860838743`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:39.301254 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1598e397-33cd-4fb0-ab3d-8396f4637817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:39.435441 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7183b20-8063-4897-99db-46e9ab90dd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:39.439766 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7183b20-8063-4897-99db-46e9ab90dd27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:39.441019 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7183b20-8063-4897-99db-46e9ab90dd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:39.442279 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7183b20-8063-4897-99db-46e9ab90dd27 admin admin] PATH_INFO: `/v3/projects/10aba496031d459896c5b5caef19dc77` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:39.448762 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7183b20-8063-4897-99db-46e9ab90dd27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10aba496031d459896c5b5caef19dc77)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:39.454550 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7183b20-8063-4897-99db-46e9ab90dd27 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:39.466648 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 858/1708] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:39 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:39.467605 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598e397-33cd-4fb0-ab3d-8396f4637817 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:39.468918 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1598e397-33cd-4fb0-ab3d-8396f4637817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:39.505783 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598e397-33cd-4fb0-ab3d-8396f4637817 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:39.518862 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cce3c8-1650-495d-849f-8562c6ef45cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:39.519521 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cce3c8-1650-495d-849f-8562c6ef45cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:39.519784 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cce3c8-1650-495d-849f-8562c6ef45cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:39.520200 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cce3c8-1650-495d-849f-8562c6ef45cd admin admin] PATH_INFO: `/v3/users/74a22a3a24fa4f9db2571a56c6da513e` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:39.521556 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cce3c8-1650-495d-849f-8562c6ef45cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=74a22a3a24fa4f9db2571a56c6da513e)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:39.526314 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cce3c8-1650-495d-849f-8562c6ef45cd admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:39.634810 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b7183b20-8063-4897-99db-46e9ab90dd27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10aba496031d459896c5b5caef19dc77', 'request_id': 'req-b7183b20-8063-4897-99db-46e9ab90dd27'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:39.657403 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-65cce3c8-1650-495d-849f-8562c6ef45cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74a22a3a24fa4f9db2571a56c6da513e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:39.658350 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-65cce3c8-1650-495d-849f-8562c6ef45cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74a22a3a24fa4f9db2571a56c6da513e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:39.675746 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b7183b20-8063-4897-99db-46e9ab90dd27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10aba496031d459896c5b5caef19dc77', 'request_id': 'req-b7183b20-8063-4897-99db-46e9ab90dd27'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:39.703689 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b7183b20-8063-4897-99db-46e9ab90dd27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10aba496031d459896c5b5caef19dc77', 'request_id': 'req-b7183b20-8063-4897-99db-46e9ab90dd27'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:39.728588 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-65cce3c8-1650-495d-849f-8562c6ef45cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74a22a3a24fa4f9db2571a56c6da513e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:39.745726 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-65cce3c8-1650-495d-849f-8562c6ef45cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74a22a3a24fa4f9db2571a56c6da513e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:39.750232 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-65cce3c8-1650-495d-849f-8562c6ef45cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74a22a3a24fa4f9db2571a56c6da513e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:39.760988 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b7183b20-8063-4897-99db-46e9ab90dd27 admin admin] The token cache is being invalidate because project 10aba496031d459896c5b5caef19dc77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:27:39.762799 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b7183b20-8063-4897-99db-46e9ab90dd27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:39.764599 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b7183b20-8063-4897-99db-46e9ab90dd27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:39.766770 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 851/1709] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:27:39 2022] DELETE /identity/v3/projects/10aba496031d459896c5b5caef19dc77 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:39.768142 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7183b20-8063-4897-99db-46e9ab90dd27 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:39.771041 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-b7183b20-8063-4897-99db-46e9ab90dd27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:39.790965 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 859/1710] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:27:39 2022] DELETE /identity/v3/users/74a22a3a24fa4f9db2571a56c6da513e => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:39.796346 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cce3c8-1650-495d-849f-8562c6ef45cd admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:39.799002 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-65cce3c8-1650-495d-849f-8562c6ef45cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:39.992835 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:40.000288 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7183b20-8063-4897-99db-46e9ab90dd27 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:40.035477 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cce3c8-1650-495d-849f-8562c6ef45cd admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:40.041033 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a137c-4f3e-4df8-b778-280d696ad3b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:40.041926 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a137c-4f3e-4df8-b778-280d696ad3b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:40.042407 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a137c-4f3e-4df8-b778-280d696ad3b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:40.042836 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a137c-4f3e-4df8-b778-280d696ad3b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:40.047138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7d9a137c-4f3e-4df8-b778-280d696ad3b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:40.060638 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:40.279387 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a137c-4f3e-4df8-b778-280d696ad3b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:40.281203 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a137c-4f3e-4df8-b778-280d696ad3b8 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:40.316690 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f9b2e-fc93-4118-9135-643dfdcd4ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:40.318237 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f9b2e-fc93-4118-9135-643dfdcd4ca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:40.318524 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f9b2e-fc93-4118-9135-643dfdcd4ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:40.318805 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f9b2e-fc93-4118-9135-643dfdcd4ca6 admin admin] PATH_INFO: `/v3/users/5f6ff29803c74b45bc9ed026b22bc6e9` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:40.324328 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 860/1711] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:27:40.328431 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f9b2e-fc93-4118-9135-643dfdcd4ca6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f6ff29803c74b45bc9ed026b22bc6e9)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:40.329542 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec8a07-782c-4238-a22c-fd0655d66a65 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:40.329848 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec8a07-782c-4238-a22c-fd0655d66a65 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:40.330553 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f9b2e-fc93-4118-9135-643dfdcd4ca6 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:40.334336 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec8a07-782c-4238-a22c-fd0655d66a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:40.414196 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-94ec8a07-782c-4238-a22c-fd0655d66a65 None None] MFA Rules not processed for user `4156a6ff075847769c0d35cfeb1b3af0`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:40.417543 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-94ec8a07-782c-4238-a22c-fd0655d66a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:40.528103 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-0b0f9b2e-fc93-4118-9135-643dfdcd4ca6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f6ff29803c74b45bc9ed026b22bc6e9'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:40.532563 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-0b0f9b2e-fc93-4118-9135-643dfdcd4ca6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f6ff29803c74b45bc9ed026b22bc6e9'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:40.585320 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-0b0f9b2e-fc93-4118-9135-643dfdcd4ca6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f6ff29803c74b45bc9ed026b22bc6e9'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:40.610716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-0b0f9b2e-fc93-4118-9135-643dfdcd4ca6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f6ff29803c74b45bc9ed026b22bc6e9'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:40.629581 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-0b0f9b2e-fc93-4118-9135-643dfdcd4ca6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f6ff29803c74b45bc9ed026b22bc6e9'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:40.649433 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 852/1712] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:27:39 2022] DELETE /identity/v3/users/5f6ff29803c74b45bc9ed026b22bc6e9 => generated 0 bytes in 881 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:40.652804 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ef410-179b-49d9-a720-0f1f47074b66 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:40.653094 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ef410-179b-49d9-a720-0f1f47074b66 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:40.653380 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ef410-179b-49d9-a720-0f1f47074b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:40.721690 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-048ef410-179b-49d9-a720-0f1f47074b66 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:40.723655 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-048ef410-179b-49d9-a720-0f1f47074b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:40.837137 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 861/1713] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 512 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:40.854892 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fd31d-2408-4f73-8378-4e39d5535324 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:40.855243 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fd31d-2408-4f73-8378-4e39d5535324 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:40.855462 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fd31d-2408-4f73-8378-4e39d5535324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:40.933239 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-432fd31d-2408-4f73-8378-4e39d5535324 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:40.935886 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-432fd31d-2408-4f73-8378-4e39d5535324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:40.968254 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 853/1714] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:40.971275 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a2d92-4ce2-4692-8b22-2941e49e4240 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:40.971569 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a2d92-4ce2-4692-8b22-2941e49e4240 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:40.971850 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a2d92-4ce2-4692-8b22-2941e49e4240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:40.987911 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 862/1715] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:40.991979 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbf828-f330-404d-80aa-c555b1fa6ddd None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:40.992340 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbf828-f330-404d-80aa-c555b1fa6ddd None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:40.992681 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbf828-f330-404d-80aa-c555b1fa6ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:41.027522 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-5c8a2d92-4ce2-4692-8b22-2941e49e4240 None None] MFA Rules not processed for user `4156a6ff075847769c0d35cfeb1b3af0`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:41.030573 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-5c8a2d92-4ce2-4692-8b22-2941e49e4240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:41.040518 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-8acbf828-f330-404d-80aa-c555b1fa6ddd None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:41.041888 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8acbf828-f330-404d-80aa-c555b1fa6ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:41.079935 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 863/1716] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:41.081264 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbf828-f330-404d-80aa-c555b1fa6ddd None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:41.097404 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8acbf828-f330-404d-80aa-c555b1fa6ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:41.104121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:41.245362 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 854/1717] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:41.246333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a2d92-4ce2-4692-8b22-2941e49e4240 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:41.283772 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a2d92-4ce2-4692-8b22-2941e49e4240 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:41.300576 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729bfd4-7b4b-4a4d-865b-97993ea4bfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:41.310024 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729bfd4-7b4b-4a4d-865b-97993ea4bfd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:41.310024 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729bfd4-7b4b-4a4d-865b-97993ea4bfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:41.310024 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729bfd4-7b4b-4a4d-865b-97993ea4bfd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:41.310024 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729bfd4-7b4b-4a4d-865b-97993ea4bfd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:27:41.310024 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729bfd4-7b4b-4a4d-865b-97993ea4bfd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:41.319692 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729bfd4-7b4b-4a4d-865b-97993ea4bfd7 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:41.336411 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbf828-f330-404d-80aa-c555b1fa6ddd None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:41.359813 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 855/1718] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:27:41.361104 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729bfd4-7b4b-4a4d-865b-97993ea4bfd7 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:41.364667 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-5729bfd4-7b4b-4a4d-865b-97993ea4bfd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:41.367595 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a552f-8572-4f5b-b077-6c92cad774e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:41.383091 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a552f-8572-4f5b-b077-6c92cad774e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:41.383432 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a552f-8572-4f5b-b077-6c92cad774e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:41.385130 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a552f-8572-4f5b-b077-6c92cad774e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:41.471198 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a552f-8572-4f5b-b077-6c92cad774e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:41.489426 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a552f-8572-4f5b-b077-6c92cad774e1 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:41.558352 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 864/1719] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:27:41.562744 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a552f-8572-4f5b-b077-6c92cad774e1 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:41.622558 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a552f-8572-4f5b-b077-6c92cad774e1 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:41.663587 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea750bef-0c8f-4adc-bab6-f413f571d154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:41.667172 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea750bef-0c8f-4adc-bab6-f413f571d154 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:41.670807 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea750bef-0c8f-4adc-bab6-f413f571d154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:41.684402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea750bef-0c8f-4adc-bab6-f413f571d154 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:41.688513 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea750bef-0c8f-4adc-bab6-f413f571d154 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:41.707030 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea750bef-0c8f-4adc-bab6-f413f571d154 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:41.767405 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729bfd4-7b4b-4a4d-865b-97993ea4bfd7 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:41.803852 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef8c07-73ba-4dd8-817d-031270d29a54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:41.804557 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef8c07-73ba-4dd8-817d-031270d29a54 service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:41.804844 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef8c07-73ba-4dd8-817d-031270d29a54 service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:41.805129 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef8c07-73ba-4dd8-817d-031270d29a54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:41.841765 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef8c07-73ba-4dd8-817d-031270d29a54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:41.848123 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef8c07-73ba-4dd8-817d-031270d29a54 service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:41.862333 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 865/1720] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:27:41 2022] POST /identity/v3/projects => generated 403 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:41.867187 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea750bef-0c8f-4adc-bab6-f413f571d154 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:41.890045 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:41.895924 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 856/1721] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:27:42.158888 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea750bef-0c8f-4adc-bab6-f413f571d154 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:42.187490 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43617411-4a61-469f-a5b6-fb0db69252ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:42.193612 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43617411-4a61-469f-a5b6-fb0db69252ec admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:42.193612 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43617411-4a61-469f-a5b6-fb0db69252ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:42.199482 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43617411-4a61-469f-a5b6-fb0db69252ec admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:42.203950 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43617411-4a61-469f-a5b6-fb0db69252ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:42.212285 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43617411-4a61-469f-a5b6-fb0db69252ec admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:42.329294 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef8c07-73ba-4dd8-817d-031270d29a54 service nova] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:42.330072 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 866/1722] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:27:41 2022] POST /identity/v3/users => generated 302 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:42.345766 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef8c07-73ba-4dd8-817d-031270d29a54 service nova] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:42.360408 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c71189-2747-4b77-9ad0-068bffb82b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:42.365870 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c71189-2747-4b77-9ad0-068bffb82b3d admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:42.366778 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c71189-2747-4b77-9ad0-068bffb82b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:42.367306 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c71189-2747-4b77-9ad0-068bffb82b3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:42.368352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c71189-2747-4b77-9ad0-068bffb82b3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:42.371938 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c71189-2747-4b77-9ad0-068bffb82b3d admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:42.389376 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43617411-4a61-469f-a5b6-fb0db69252ec admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:42.392064 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-43617411-4a61-469f-a5b6-fb0db69252ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:42.403391 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 857/1723] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:42.408617 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c71189-2747-4b77-9ad0-068bffb82b3d admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:42.427782 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43617411-4a61-469f-a5b6-fb0db69252ec admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:42.440620 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c71189-2747-4b77-9ad0-068bffb82b3d admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:42.446296 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13cba6-964c-47db-ab82-6153b9315ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:42.448312 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13cba6-964c-47db-ab82-6153b9315ffb admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:42.448918 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13cba6-964c-47db-ab82-6153b9315ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:42.450043 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13cba6-964c-47db-ab82-6153b9315ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:42.451151 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13cba6-964c-47db-ab82-6153b9315ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:42.455675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13cba6-964c-47db-ab82-6153b9315ffb admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:42.457722 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57353168-91da-4dcf-b7b9-11b0e6345708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:42.460339 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57353168-91da-4dcf-b7b9-11b0e6345708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:42.460626 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57353168-91da-4dcf-b7b9-11b0e6345708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:42.470254 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57353168-91da-4dcf-b7b9-11b0e6345708 admin admin] PATH_INFO: `/v3/projects/914017987d8447fcb14baf46bbf1febb` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:42.476194 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57353168-91da-4dcf-b7b9-11b0e6345708 admin admin] RBAC: Authorizing `identity:delete_project(project_id=914017987d8447fcb14baf46bbf1febb)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:42.483596 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 858/1724] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:42.491893 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57353168-91da-4dcf-b7b9-11b0e6345708 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:42.502362 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13cba6-964c-47db-ab82-6153b9315ffb admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:42.540703 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13cba6-964c-47db-ab82-6153b9315ffb admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:42.563353 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ded24-28fc-4860-8bb4-022d3ff34ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:42.564705 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ded24-28fc-4860-8bb4-022d3ff34ed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:42.565255 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ded24-28fc-4860-8bb4-022d3ff34ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:42.566993 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ded24-28fc-4860-8bb4-022d3ff34ed5 admin admin] PATH_INFO: `/v3/projects/2512e0f3f1884783beef0c271058eee5/users/675307898fe04214b1c5d568625e9ec3/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:42.639815 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ded24-28fc-4860-8bb4-022d3ff34ed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2512e0f3f1884783beef0c271058eee5, user_id=675307898fe04214b1c5d568625e9ec3, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:42.645839 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ded24-28fc-4860-8bb4-022d3ff34ed5 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:42.692554 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-57353168-91da-4dcf-b7b9-11b0e6345708 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '914017987d8447fcb14baf46bbf1febb', 'request_id': 'req-57353168-91da-4dcf-b7b9-11b0e6345708'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:42.701827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 859/1725] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:27:42 2022] PUT /identity/v3/projects/2512e0f3f1884783beef0c271058eee5/users/675307898fe04214b1c5d568625e9ec3/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:42.707036 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1cb4f8-b2b1-4308-82f8-e5e3494833b9 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:42.709194 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1cb4f8-b2b1-4308-82f8-e5e3494833b9 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:42.709418 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-57353168-91da-4dcf-b7b9-11b0e6345708 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '914017987d8447fcb14baf46bbf1febb', 'request_id': 'req-57353168-91da-4dcf-b7b9-11b0e6345708'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:42.710623 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1cb4f8-b2b1-4308-82f8-e5e3494833b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:42.724756 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-57353168-91da-4dcf-b7b9-11b0e6345708 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '914017987d8447fcb14baf46bbf1febb', 'request_id': 'req-57353168-91da-4dcf-b7b9-11b0e6345708'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:42.777659 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-57353168-91da-4dcf-b7b9-11b0e6345708 admin admin] The token cache is being invalidate because project 914017987d8447fcb14baf46bbf1febb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:27:42.778038 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-57353168-91da-4dcf-b7b9-11b0e6345708 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:42.782467 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-57353168-91da-4dcf-b7b9-11b0e6345708 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:42.791161 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 867/1726] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:27:42 2022] DELETE /identity/v3/projects/914017987d8447fcb14baf46bbf1febb => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:42.798971 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c48807-b1ce-4a89-b1f0-faa1f45c542f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:42.799266 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c48807-b1ce-4a89-b1f0-faa1f45c542f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:42.799617 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c48807-b1ce-4a89-b1f0-faa1f45c542f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:42.800903 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-6b1cb4f8-b2b1-4308-82f8-e5e3494833b9 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:42.819226 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6b1cb4f8-b2b1-4308-82f8-e5e3494833b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:42.901423 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a3c48807-b1ce-4a89-b1f0-faa1f45c542f None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:42.904863 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a3c48807-b1ce-4a89-b1f0-faa1f45c542f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:43.005262 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:43.045863 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 860/1727] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:43.046903 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1cb4f8-b2b1-4308-82f8-e5e3494833b9 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:43.048498 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6b1cb4f8-b2b1-4308-82f8-e5e3494833b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:43.208328 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 868/1728] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:43.208665 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1cb4f8-b2b1-4308-82f8-e5e3494833b9 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:43.210377 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c48807-b1ce-4a89-b1f0-faa1f45c542f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:43.214843 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a3c48807-b1ce-4a89-b1f0-faa1f45c542f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:43.216026 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d853e-4a02-4cc5-8e23-1db2b08d9174 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:43.219266 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d853e-4a02-4cc5-8e23-1db2b08d9174 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:43.219729 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d853e-4a02-4cc5-8e23-1db2b08d9174 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:43.220100 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d853e-4a02-4cc5-8e23-1db2b08d9174 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:43.224835 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-780d853e-4a02-4cc5-8e23-1db2b08d9174 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:43.292318 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:43.398934 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d853e-4a02-4cc5-8e23-1db2b08d9174 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:43.400756 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d853e-4a02-4cc5-8e23-1db2b08d9174 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:43.433168 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 861/1729] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:27:43.437132 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4218e-1c85-4ca0-983e-99a9b5360faa None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:43.437875 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4218e-1c85-4ca0-983e-99a9b5360faa None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:43.442491 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4218e-1c85-4ca0-983e-99a9b5360faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:43.474133 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c48807-b1ce-4a89-b1f0-faa1f45c542f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:43.479282 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc94d6-b687-4078-ac6c-e3e6a4942f0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:43.480140 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc94d6-b687-4078-ac6c-e3e6a4942f0c service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:43.480505 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc94d6-b687-4078-ac6c-e3e6a4942f0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:43.481328 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc94d6-b687-4078-ac6c-e3e6a4942f0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:43.493882 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc94d6-b687-4078-ac6c-e3e6a4942f0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:43.495637 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-9cc4218e-1c85-4ca0-983e-99a9b5360faa None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:43.495764 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc94d6-b687-4078-ac6c-e3e6a4942f0c service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:43.497764 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-9cc4218e-1c85-4ca0-983e-99a9b5360faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:43.508901 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 869/1730] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:27:43.536880 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 862/1731] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:43.540833 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc94d6-b687-4078-ac6c-e3e6a4942f0c service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:43.555054 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc94d6-b687-4078-ac6c-e3e6a4942f0c service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:43.568915 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c91d3-46c7-4049-ada2-1adae8439f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:43.569865 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c91d3-46c7-4049-ada2-1adae8439f0c admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:43.570140 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c91d3-46c7-4049-ada2-1adae8439f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:43.570424 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c91d3-46c7-4049-ada2-1adae8439f0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:43.571161 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c91d3-46c7-4049-ada2-1adae8439f0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:27:43.571526 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c91d3-46c7-4049-ada2-1adae8439f0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:43.578155 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c91d3-46c7-4049-ada2-1adae8439f0c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:43.614739 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381c105-75d1-408d-b813-e2f3a9b90f97 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:43.615027 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381c105-75d1-408d-b813-e2f3a9b90f97 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:43.615307 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381c105-75d1-408d-b813-e2f3a9b90f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:43.672770 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 870/1732] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:27:43.678865 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c91d3-46c7-4049-ada2-1adae8439f0c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:43.723474 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c91d3-46c7-4049-ada2-1adae8439f0c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:43.734651 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-4381c105-75d1-408d-b813-e2f3a9b90f97 None None] MFA Rules not processed for user `df8135d434a6499db18f03e1ec293a05`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:43.736584 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-4381c105-75d1-408d-b813-e2f3a9b90f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:43.737350 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ba656-0207-46bf-8385-fdc3289f745e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:43.741954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ba656-0207-46bf-8385-fdc3289f745e admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:43.742403 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ba656-0207-46bf-8385-fdc3289f745e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:43.742694 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ba656-0207-46bf-8385-fdc3289f745e admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:43.748303 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ba656-0207-46bf-8385-fdc3289f745e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:43.760219 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ba656-0207-46bf-8385-fdc3289f745e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:43.837114 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 871/1733] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:27:43 2022] POST /identity/v3/projects => generated 387 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:43.845931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ba656-0207-46bf-8385-fdc3289f745e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:43.993058 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 863/1734] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:27:44.021900 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381c105-75d1-408d-b813-e2f3a9b90f97 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:44.023409 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-4381c105-75d1-408d-b813-e2f3a9b90f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:44.101853 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ba656-0207-46bf-8385-fdc3289f745e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:44.116807 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6efd7-0d53-44f8-ac3a-bf00301f23f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:44.119600 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6efd7-0d53-44f8-ac3a-bf00301f23f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:44.119927 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6efd7-0d53-44f8-ac3a-bf00301f23f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:44.121785 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6efd7-0d53-44f8-ac3a-bf00301f23f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:44.126773 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6efd7-0d53-44f8-ac3a-bf00301f23f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:44.136838 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6efd7-0d53-44f8-ac3a-bf00301f23f6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:44.142618 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:44.205350 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 872/1735] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:27:43 2022] POST /identity/v3/users => generated 294 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:44.210272 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ceb42-61ae-427c-bfd5-ff52b5fa5919 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:44.210622 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ceb42-61ae-427c-bfd5-ff52b5fa5919 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:44.210910 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ceb42-61ae-427c-bfd5-ff52b5fa5919 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:44.216851 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 873/1736] 10.222.0.32 () {54 vars in 912 bytes} [Wed Jun 1 04:27:44 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:27:44.218399 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ceb42-61ae-427c-bfd5-ff52b5fa5919 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:44.248501 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ceb42-61ae-427c-bfd5-ff52b5fa5919 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:44.254610 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ee085-7b9d-4da1-84d9-93d026152362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:44.255305 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ee085-7b9d-4da1-84d9-93d026152362 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:44.255594 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ee085-7b9d-4da1-84d9-93d026152362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:44.256029 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ee085-7b9d-4da1-84d9-93d026152362 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:44.257101 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ee085-7b9d-4da1-84d9-93d026152362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:44.259636 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ee085-7b9d-4da1-84d9-93d026152362 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:44.279067 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 874/1737] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:44.281835 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a8589-4d85-4dae-8cd1-e0008562cb41 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:44.282457 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a8589-4d85-4dae-8cd1-e0008562cb41 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:44.282805 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a8589-4d85-4dae-8cd1-e0008562cb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:44.320278 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-527a8589-4d85-4dae-8cd1-e0008562cb41 None None] MFA Rules not processed for user `dca5f9455ef349738adf4569fe5ed165`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:44.322008 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-527a8589-4d85-4dae-8cd1-e0008562cb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:44.387231 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381c105-75d1-408d-b813-e2f3a9b90f97 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:44.417447 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 875/1738] 10.222.0.32 () {58 vars in 1009 bytes} [Wed Jun 1 04:27:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:44.419169 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a8589-4d85-4dae-8cd1-e0008562cb41 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:44.421214 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-527a8589-4d85-4dae-8cd1-e0008562cb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:44.453807 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a8589-4d85-4dae-8cd1-e0008562cb41 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:44.470780 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97770081-31de-4cba-b7da-b8f0c378c38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:44.473897 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97770081-31de-4cba-b7da-b8f0c378c38a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:44.474076 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97770081-31de-4cba-b7da-b8f0c378c38a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:44.475900 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97770081-31de-4cba-b7da-b8f0c378c38a admin admin] PATH_INFO: `/v3/projects/9469139af1f14595beb38c162ad8258c` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:44.477629 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97770081-31de-4cba-b7da-b8f0c378c38a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9469139af1f14595beb38c162ad8258c)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:44.482885 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97770081-31de-4cba-b7da-b8f0c378c38a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:44.508392 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:44.616831 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41727d4-4bf3-4f02-a0b1-f3d30e22cc19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:44.619097 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41727d4-4bf3-4f02-a0b1-f3d30e22cc19 service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:44.620353 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41727d4-4bf3-4f02-a0b1-f3d30e22cc19 service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:44.620754 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41727d4-4bf3-4f02-a0b1-f3d30e22cc19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:44.637566 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-97770081-31de-4cba-b7da-b8f0c378c38a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9469139af1f14595beb38c162ad8258c', 'request_id': 'req-97770081-31de-4cba-b7da-b8f0c378c38a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:44.652145 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-97770081-31de-4cba-b7da-b8f0c378c38a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9469139af1f14595beb38c162ad8258c', 'request_id': 'req-97770081-31de-4cba-b7da-b8f0c378c38a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:44.666905 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-97770081-31de-4cba-b7da-b8f0c378c38a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9469139af1f14595beb38c162ad8258c', 'request_id': 'req-97770081-31de-4cba-b7da-b8f0c378c38a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:44.691566 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-97770081-31de-4cba-b7da-b8f0c378c38a admin admin] The token cache is being invalidate because project 9469139af1f14595beb38c162ad8258c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:27:44.693004 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-97770081-31de-4cba-b7da-b8f0c378c38a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:44.696161 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-97770081-31de-4cba-b7da-b8f0c378c38a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:44.703890 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 876/1739] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:27:44 2022] DELETE /identity/v3/projects/9469139af1f14595beb38c162ad8258c => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:44.705759 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97770081-31de-4cba-b7da-b8f0c378c38a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:44.709583 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-97770081-31de-4cba-b7da-b8f0c378c38a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:44.751886 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41727d4-4bf3-4f02-a0b1-f3d30e22cc19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:44.754718 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41727d4-4bf3-4f02-a0b1-f3d30e22cc19 service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:44.786853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 864/1740] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 766 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:27:44.790212 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729564e2-f4c0-4395-8d9c-04b4808d0b97 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:44.791672 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729564e2-f4c0-4395-8d9c-04b4808d0b97 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:44.800030 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729564e2-f4c0-4395-8d9c-04b4808d0b97 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:44.803906 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 865/1741] 10.222.0.32 () {54 vars in 921 bytes} [Wed Jun 1 04:27:44 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:27:44.804843 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729564e2-f4c0-4395-8d9c-04b4808d0b97 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:44.810532 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-729564e2-f4c0-4395-8d9c-04b4808d0b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:44.900900 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97770081-31de-4cba-b7da-b8f0c378c38a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:44.915024 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0592d12-bd90-491d-a05b-392a114c00a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:44.915985 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0592d12-bd90-491d-a05b-392a114c00a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:44.919390 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0592d12-bd90-491d-a05b-392a114c00a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:44.919390 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0592d12-bd90-491d-a05b-392a114c00a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:44.920268 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0592d12-bd90-491d-a05b-392a114c00a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:44.925529 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0592d12-bd90-491d-a05b-392a114c00a9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:44.935969 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729564e2-f4c0-4395-8d9c-04b4808d0b97 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:44.943949 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926aa00d-81e7-4f48-989e-3248159f8efe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:44.946118 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926aa00d-81e7-4f48-989e-3248159f8efe service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:44.947053 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926aa00d-81e7-4f48-989e-3248159f8efe service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:44.948524 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926aa00d-81e7-4f48-989e-3248159f8efe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:44.953658 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-926aa00d-81e7-4f48-989e-3248159f8efe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:44.953898 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 877/1742] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:44.954947 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0592d12-bd90-491d-a05b-392a114c00a9 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:44.961080 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d0592d12-bd90-491d-a05b-392a114c00a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:44.975036 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926aa00d-81e7-4f48-989e-3248159f8efe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:44.977244 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926aa00d-81e7-4f48-989e-3248159f8efe service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:45.003253 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 866/1743] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:27:45.004989 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40626c1-2e1a-4a68-8c30-7151ac38a9e2 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:45.005281 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40626c1-2e1a-4a68-8c30-7151ac38a9e2 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:45.005645 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40626c1-2e1a-4a68-8c30-7151ac38a9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:45.007399 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0592d12-bd90-491d-a05b-392a114c00a9 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:45.021032 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc5446-4d83-490f-a4ca-79884829e756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:45.022090 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc5446-4d83-490f-a4ca-79884829e756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:45.022682 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc5446-4d83-490f-a4ca-79884829e756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:45.023121 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc5446-4d83-490f-a4ca-79884829e756 admin admin] PATH_INFO: `/v3/users/a288a0126c624b5daa4e8422e8a5df21` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:45.026258 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:45.033134 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbc5446-4d83-490f-a4ca-79884829e756 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a288a0126c624b5daa4e8422e8a5df21)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:45.041068 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbc5446-4d83-490f-a4ca-79884829e756 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:45.041350 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-c40626c1-2e1a-4a68-8c30-7151ac38a9e2 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:45.042765 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c40626c1-2e1a-4a68-8c30-7151ac38a9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:45.066743 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 867/1744] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:45.068518 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540a96f-af71-498a-b747-25b9c13f86dd None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:45.069066 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540a96f-af71-498a-b747-25b9c13f86dd None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:45.069363 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540a96f-af71-498a-b747-25b9c13f86dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:45.132694 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-4540a96f-af71-498a-b747-25b9c13f86dd None None] MFA Rules not processed for user `79d614f85f5541d3babbb41468cbf55c`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:45.134293 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-4540a96f-af71-498a-b747-25b9c13f86dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:45.184847 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7fbc5446-4d83-490f-a4ca-79884829e756 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a288a0126c624b5daa4e8422e8a5df21'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:45.187845 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7fbc5446-4d83-490f-a4ca-79884829e756 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a288a0126c624b5daa4e8422e8a5df21'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:45.221481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7fbc5446-4d83-490f-a4ca-79884829e756 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a288a0126c624b5daa4e8422e8a5df21'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:45.235404 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7fbc5446-4d83-490f-a4ca-79884829e756 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a288a0126c624b5daa4e8422e8a5df21'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:45.236311 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7fbc5446-4d83-490f-a4ca-79884829e756 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a288a0126c624b5daa4e8422e8a5df21'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:45.262752 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 878/1745] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:27:44 2022] DELETE /identity/v3/users/a288a0126c624b5daa4e8422e8a5df21 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:45.264049 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc5446-4d83-490f-a4ca-79884829e756 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:45.267855 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7fbc5446-4d83-490f-a4ca-79884829e756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:45.284636 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:45.288655 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 868/1746] 10.222.0.32 () {58 vars in 1018 bytes} [Wed Jun 1 04:27:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:45.290636 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2dd10-7e51-481a-a93a-b920ca6ed6f3 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:45.294517 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2dd10-7e51-481a-a93a-b920ca6ed6f3 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:45.294707 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2dd10-7e51-481a-a93a-b920ca6ed6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:45.328359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-64c2dd10-7e51-481a-a93a-b920ca6ed6f3 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:45.330490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-64c2dd10-7e51-481a-a93a-b920ca6ed6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:45.472562 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 869/1747] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:45.474321 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef77aa-1b89-4f4b-a560-7cb9698e6ddb None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:45.474585 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef77aa-1b89-4f4b-a560-7cb9698e6ddb None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:45.474978 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef77aa-1b89-4f4b-a560-7cb9698e6ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:45.506248 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-c9ef77aa-1b89-4f4b-a560-7cb9698e6ddb None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:45.507870 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c9ef77aa-1b89-4f4b-a560-7cb9698e6ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:45.511496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc5446-4d83-490f-a4ca-79884829e756 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:45.519869 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 870/1748] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:45.521999 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef77aa-1b89-4f4b-a560-7cb9698e6ddb None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:45.536384 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef77aa-1b89-4f4b-a560-7cb9698e6ddb None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:45.541602 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534e503-2f2e-477e-bec4-6e95cc139e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:45.542998 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534e503-2f2e-477e-bec4-6e95cc139e7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:45.543527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534e503-2f2e-477e-bec4-6e95cc139e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:45.543956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534e503-2f2e-477e-bec4-6e95cc139e7f admin admin] PATH_INFO: `/v3/projects/d5a6fcda97a74b51af5325725a81f2a4/users/50830a88cf104cbb83aab0f0c5767e9d/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:45.544146 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3720a-2f1d-49fe-903d-71c80c4b52ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:45.544953 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3720a-2f1d-49fe-903d-71c80c4b52ab admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:45.545403 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3720a-2f1d-49fe-903d-71c80c4b52ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:45.545904 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3720a-2f1d-49fe-903d-71c80c4b52ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:45.547109 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3720a-2f1d-49fe-903d-71c80c4b52ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:27:45.547537 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3720a-2f1d-49fe-903d-71c80c4b52ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:45.549464 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3720a-2f1d-49fe-903d-71c80c4b52ab admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:45.575990 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 871/1749] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:27:45.576954 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3720a-2f1d-49fe-903d-71c80c4b52ab admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:45.603324 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3720a-2f1d-49fe-903d-71c80c4b52ab admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:45.609359 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534e503-2f2e-477e-bec4-6e95cc139e7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5a6fcda97a74b51af5325725a81f2a4, user_id=50830a88cf104cbb83aab0f0c5767e9d, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:45.612522 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534e503-2f2e-477e-bec4-6e95cc139e7f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:45.633438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d636426-185f-4fc1-89ee-fbf041148131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:45.634158 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d636426-185f-4fc1-89ee-fbf041148131 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:45.634545 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d636426-185f-4fc1-89ee-fbf041148131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:45.637782 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d636426-185f-4fc1-89ee-fbf041148131 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:45.640562 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d636426-185f-4fc1-89ee-fbf041148131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:45.652905 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d636426-185f-4fc1-89ee-fbf041148131 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:45.654314 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 879/1750] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:27:45 2022] PUT /identity/v3/projects/d5a6fcda97a74b51af5325725a81f2a4/users/50830a88cf104cbb83aab0f0c5767e9d/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:45.671559 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f19866-a400-4bd7-80b7-2073ab56ef98 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:45.672295 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f19866-a400-4bd7-80b7-2073ab56ef98 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:45.672724 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f19866-a400-4bd7-80b7-2073ab56ef98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:45.751126 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-91f19866-a400-4bd7-80b7-2073ab56ef98 None None] MFA Rules not processed for user `50830a88cf104cbb83aab0f0c5767e9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:45.752648 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-91f19866-a400-4bd7-80b7-2073ab56ef98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:45.762040 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 872/1751] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:27:45 2022] POST /identity/v3/projects => generated 403 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:45.763731 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d636426-185f-4fc1-89ee-fbf041148131 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:45.769469 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-9d636426-185f-4fc1-89ee-fbf041148131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:46.019719 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d636426-185f-4fc1-89ee-fbf041148131 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:46.021547 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 880/1752] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:27:46.022783 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f19866-a400-4bd7-80b7-2073ab56ef98 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:46.046778 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a37f8-1488-4d0c-b459-24e3c2203a9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:46.048446 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a37f8-1488-4d0c-b459-24e3c2203a9d service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:46.048983 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a37f8-1488-4d0c-b459-24e3c2203a9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:46.050492 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a37f8-1488-4d0c-b459-24e3c2203a9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:46.060616 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:46.289376 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f19866-a400-4bd7-80b7-2073ab56ef98 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:46.300098 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7200032-c77d-4a85-b939-96160d2dd915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:46.301124 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7200032-c77d-4a85-b939-96160d2dd915 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:46.301493 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7200032-c77d-4a85-b939-96160d2dd915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:46.302125 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7200032-c77d-4a85-b939-96160d2dd915 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:46.302733 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7200032-c77d-4a85-b939-96160d2dd915 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:46.305693 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7200032-c77d-4a85-b939-96160d2dd915 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:46.315372 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a37f8-1488-4d0c-b459-24e3c2203a9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:46.338908 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a37f8-1488-4d0c-b459-24e3c2203a9d service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:46.354320 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 881/1753] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:27:46 2022] POST /identity/v3/users => generated 302 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:46.355295 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7200032-c77d-4a85-b939-96160d2dd915 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:46.373258 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:46.374004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 873/1754] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:27:46.378482 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a37f8-1488-4d0c-b459-24e3c2203a9d service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:46.385752 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7200032-c77d-4a85-b939-96160d2dd915 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:46.402999 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca272c-69ae-47cc-97aa-4ca74e859b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:46.403883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca272c-69ae-47cc-97aa-4ca74e859b13 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:46.404185 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca272c-69ae-47cc-97aa-4ca74e859b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:46.404469 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca272c-69ae-47cc-97aa-4ca74e859b13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:46.405198 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca272c-69ae-47cc-97aa-4ca74e859b13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:46.409552 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a37f8-1488-4d0c-b459-24e3c2203a9d service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:46.410919 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca272c-69ae-47cc-97aa-4ca74e859b13 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:46.417478 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb70f9c-f494-4ae2-bc8e-1b9bb0df3439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:46.418968 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb70f9c-f494-4ae2-bc8e-1b9bb0df3439 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:46.419664 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb70f9c-f494-4ae2-bc8e-1b9bb0df3439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:46.420102 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb70f9c-f494-4ae2-bc8e-1b9bb0df3439 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:46.421016 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb70f9c-f494-4ae2-bc8e-1b9bb0df3439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:46.433202 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb70f9c-f494-4ae2-bc8e-1b9bb0df3439 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:46.455627 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 874/1755] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:46.457010 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb70f9c-f494-4ae2-bc8e-1b9bb0df3439 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:46.483637 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb70f9c-f494-4ae2-bc8e-1b9bb0df3439 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:46.490845 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a04c9-9ef9-43f6-8585-f270cd362ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:46.492161 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a04c9-9ef9-43f6-8585-f270cd362ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:46.492690 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a04c9-9ef9-43f6-8585-f270cd362ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:46.493255 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a04c9-9ef9-43f6-8585-f270cd362ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:46.494955 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a04c9-9ef9-43f6-8585-f270cd362ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:46.499005 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 882/1756] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:27:46 2022] POST /identity/v3/projects => generated 387 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:46.499427 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a04c9-9ef9-43f6-8585-f270cd362ff6 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:46.501043 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca272c-69ae-47cc-97aa-4ca74e859b13 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:46.520176 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 875/1757] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:46.522600 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a04c9-9ef9-43f6-8585-f270cd362ff6 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:46.547167 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a04c9-9ef9-43f6-8585-f270cd362ff6 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:46.672381 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9ca80-0a50-4a83-90d5-63ab00d6c363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:46.673893 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9ca80-0a50-4a83-90d5-63ab00d6c363 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:46.674312 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9ca80-0a50-4a83-90d5-63ab00d6c363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:46.675070 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9ca80-0a50-4a83-90d5-63ab00d6c363 admin admin] PATH_INFO: `/v3/projects/39b1dd2ba55a49d9bc3ac82e8b89413b/users/b46ced40b8d54ebfb47d633b4a6df23c/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:46.698914 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9ca80-0a50-4a83-90d5-63ab00d6c363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39b1dd2ba55a49d9bc3ac82e8b89413b, user_id=b46ced40b8d54ebfb47d633b4a6df23c, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:46.702824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca272c-69ae-47cc-97aa-4ca74e859b13 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:46.707412 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9ca80-0a50-4a83-90d5-63ab00d6c363 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:46.753180 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1897c-3c67-4688-8162-b43fadbfcb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:46.756806 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1897c-3c67-4688-8162-b43fadbfcb8f admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:46.760641 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1897c-3c67-4688-8162-b43fadbfcb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:46.761141 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1897c-3c67-4688-8162-b43fadbfcb8f admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:46.762208 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c1897c-3c67-4688-8162-b43fadbfcb8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:46.764520 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c1897c-3c67-4688-8162-b43fadbfcb8f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:46.765848 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 876/1758] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:27:46 2022] PUT /identity/v3/projects/39b1dd2ba55a49d9bc3ac82e8b89413b/users/b46ced40b8d54ebfb47d633b4a6df23c/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:46.776910 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c384c94-6931-405a-988f-18bc939fa45c None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:46.777281 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c384c94-6931-405a-988f-18bc939fa45c None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:46.786988 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c384c94-6931-405a-988f-18bc939fa45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:46.811561 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 883/1759] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:27:46 2022] POST /identity/v3/users => generated 300 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:46.817954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1897c-3c67-4688-8162-b43fadbfcb8f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:46.845283 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1897c-3c67-4688-8162-b43fadbfcb8f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:46.908937 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-7c384c94-6931-405a-988f-18bc939fa45c None None] MFA Rules not processed for user `b46ced40b8d54ebfb47d633b4a6df23c`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:46.917536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7c384c94-6931-405a-988f-18bc939fa45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:47.098155 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:47.128363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc803e0-3725-484f-8cab-017187a9147a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:47.132678 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc803e0-3725-484f-8cab-017187a9147a admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:47.134146 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc803e0-3725-484f-8cab-017187a9147a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:47.135643 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc803e0-3725-484f-8cab-017187a9147a admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:47.142017 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 877/1760] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:27:47.150976 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c384c94-6931-405a-988f-18bc939fa45c None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:47.153228 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc803e0-3725-484f-8cab-017187a9147a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:47.160208 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc803e0-3725-484f-8cab-017187a9147a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:47.175147 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c384c94-6931-405a-988f-18bc939fa45c None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:47.192676 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 884/1761] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:47.196472 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc803e0-3725-484f-8cab-017187a9147a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:47.207264 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad503ca-9308-40dd-8259-a28ed4243b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:47.208016 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad503ca-9308-40dd-8259-a28ed4243b90 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:47.208309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad503ca-9308-40dd-8259-a28ed4243b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:47.208582 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad503ca-9308-40dd-8259-a28ed4243b90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:47.209287 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad503ca-9308-40dd-8259-a28ed4243b90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:47.211276 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad503ca-9308-40dd-8259-a28ed4243b90 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:47.244206 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc803e0-3725-484f-8cab-017187a9147a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:47.254187 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58eceb6-d349-4f39-81fa-6a19aad963b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:47.256187 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58eceb6-d349-4f39-81fa-6a19aad963b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:47.256543 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58eceb6-d349-4f39-81fa-6a19aad963b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:47.256785 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58eceb6-d349-4f39-81fa-6a19aad963b9 admin admin] PATH_INFO: `/v3/projects/80aae41e6afc4719b491ac95564b901f/users/6e423ca6af7342a0801b4c51596c2995/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:47.279071 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 878/1762] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:27:47 2022] POST /identity/v3/projects => generated 405 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:47.282527 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad503ca-9308-40dd-8259-a28ed4243b90 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:47.286883 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-cad503ca-9308-40dd-8259-a28ed4243b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:47.320549 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58eceb6-d349-4f39-81fa-6a19aad963b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80aae41e6afc4719b491ac95564b901f, user_id=6e423ca6af7342a0801b4c51596c2995, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:47.337772 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58eceb6-d349-4f39-81fa-6a19aad963b9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:47.387854 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 885/1763] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:27:47 2022] PUT /identity/v3/projects/80aae41e6afc4719b491ac95564b901f/users/6e423ca6af7342a0801b4c51596c2995/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:47.388982 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58eceb6-d349-4f39-81fa-6a19aad963b9 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:47.533121 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:47.536743 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad503ca-9308-40dd-8259-a28ed4243b90 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:47.564089 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58eceb6-d349-4f39-81fa-6a19aad963b9 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:47.570789 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf66dc-2470-4b2a-842d-34f7f61d7f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:47.571782 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf66dc-2470-4b2a-842d-34f7f61d7f19 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:47.572177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf66dc-2470-4b2a-842d-34f7f61d7f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:47.572848 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf66dc-2470-4b2a-842d-34f7f61d7f19 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:47.573704 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf66dc-2470-4b2a-842d-34f7f61d7f19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:47.575937 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf66dc-2470-4b2a-842d-34f7f61d7f19 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:47.615672 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 886/1764] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:27:47 2022] POST /identity/v3/users => generated 309 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:47.615672 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf66dc-2470-4b2a-842d-34f7f61d7f19 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:47.656343 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf66dc-2470-4b2a-842d-34f7f61d7f19 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:47.673161 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24cd52-4002-48de-a0ef-5976a66902e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:47.674520 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24cd52-4002-48de-a0ef-5976a66902e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:47.674981 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24cd52-4002-48de-a0ef-5976a66902e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:47.675380 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24cd52-4002-48de-a0ef-5976a66902e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:47.676339 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24cd52-4002-48de-a0ef-5976a66902e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:47.682671 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24cd52-4002-48de-a0ef-5976a66902e4 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:47.722726 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 887/1765] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:47.730289 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24cd52-4002-48de-a0ef-5976a66902e4 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:47.752460 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24cd52-4002-48de-a0ef-5976a66902e4 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:47.760051 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a08eaa-72bf-4e7c-8bee-097c9a29e975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:47.760936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a08eaa-72bf-4e7c-8bee-097c9a29e975 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:47.761456 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a08eaa-72bf-4e7c-8bee-097c9a29e975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:47.761963 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a08eaa-72bf-4e7c-8bee-097c9a29e975 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:47.763099 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a08eaa-72bf-4e7c-8bee-097c9a29e975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:47.765223 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a08eaa-72bf-4e7c-8bee-097c9a29e975 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:47.792235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 888/1766] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:47.793950 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a08eaa-72bf-4e7c-8bee-097c9a29e975 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:47.819630 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a08eaa-72bf-4e7c-8bee-097c9a29e975 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:47.830433 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80b3f6-c747-4d32-9500-c52c5dad0916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:47.831579 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80b3f6-c747-4d32-9500-c52c5dad0916 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:47.831964 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80b3f6-c747-4d32-9500-c52c5dad0916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:47.834197 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80b3f6-c747-4d32-9500-c52c5dad0916 admin admin] PATH_INFO: `/v3/projects/80aae41e6afc4719b491ac95564b901f/users/6e423ca6af7342a0801b4c51596c2995/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:47.839202 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c80b3f6-c747-4d32-9500-c52c5dad0916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80aae41e6afc4719b491ac95564b901f, user_id=6e423ca6af7342a0801b4c51596c2995, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:47.844852 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c80b3f6-c747-4d32-9500-c52c5dad0916 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:47.868324 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49d9d2-a70f-4205-9cc6-09f3751109f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:47.869025 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49d9d2-a70f-4205-9cc6-09f3751109f0 service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:47.869319 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49d9d2-a70f-4205-9cc6-09f3751109f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:47.869660 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49d9d2-a70f-4205-9cc6-09f3751109f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:47.915705 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 889/1767] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:27:47 2022] PUT /identity/v3/projects/80aae41e6afc4719b491ac95564b901f/users/6e423ca6af7342a0801b4c51596c2995/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:47.919384 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80b3f6-c747-4d32-9500-c52c5dad0916 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:47.937850 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49d9d2-a70f-4205-9cc6-09f3751109f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:47.939894 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49d9d2-a70f-4205-9cc6-09f3751109f0 service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:47.995832 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 879/1768] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 716 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:27:47.997811 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833fae6-3937-46cc-aad9-4f1c95ceb2cf None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:47.998271 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833fae6-3937-46cc-aad9-4f1c95ceb2cf None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:47.998459 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833fae6-3937-46cc-aad9-4f1c95ceb2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:48.078318 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80b3f6-c747-4d32-9500-c52c5dad0916 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:48.090463 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e23ca-2297-450d-bb0b-2df12a5f7c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:48.093432 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e23ca-2297-450d-bb0b-2df12a5f7c3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:48.095079 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e23ca-2297-450d-bb0b-2df12a5f7c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:48.095540 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e23ca-2297-450d-bb0b-2df12a5f7c3d admin admin] PATH_INFO: `/v3/projects/163da5b66926496e92d08817f712e0eb/users/79f6d963ee514d4182d7abaf0c22e154/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:48.176664 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e23ca-2297-450d-bb0b-2df12a5f7c3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=163da5b66926496e92d08817f712e0eb, user_id=79f6d963ee514d4182d7abaf0c22e154, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:48.184044 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e23ca-2297-450d-bb0b-2df12a5f7c3d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:48.189269 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-7833fae6-3937-46cc-aad9-4f1c95ceb2cf None None] MFA Rules not processed for user `6e423ca6af7342a0801b4c51596c2995`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:48.190722 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7833fae6-3937-46cc-aad9-4f1c95ceb2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:48.220151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 890/1769] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:27:47 2022] PUT /identity/v3/projects/163da5b66926496e92d08817f712e0eb/users/79f6d963ee514d4182d7abaf0c22e154/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:48.223444 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8a6a5-e69f-4b6e-b7a3-d9c399164353 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:48.223743 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8a6a5-e69f-4b6e-b7a3-d9c399164353 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:48.224064 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8a6a5-e69f-4b6e-b7a3-d9c399164353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:48.288932 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-12d8a6a5-e69f-4b6e-b7a3-d9c399164353 None None] MFA Rules not processed for user `675307898fe04214b1c5d568625e9ec3`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:48.290918 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-12d8a6a5-e69f-4b6e-b7a3-d9c399164353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:48.377601 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:48.496146 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 891/1770] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:48.498084 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8a6a5-e69f-4b6e-b7a3-d9c399164353 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:48.503278 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-12d8a6a5-e69f-4b6e-b7a3-d9c399164353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:48.503595 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 880/1771] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 507 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:48.504390 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833fae6-3937-46cc-aad9-4f1c95ceb2cf None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:48.529672 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833fae6-3937-46cc-aad9-4f1c95ceb2cf None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:48.537063 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:48.680438 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8a6a5-e69f-4b6e-b7a3-d9c399164353 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:48.700828 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc76110-644e-436e-92b1-65d545fcee9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:48.702093 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc76110-644e-436e-92b1-65d545fcee9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:48.702422 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc76110-644e-436e-92b1-65d545fcee9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:48.702649 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc76110-644e-436e-92b1-65d545fcee9c admin admin] PATH_INFO: `/v3/projects/bfa22034c9de4c7694b21f2f741a5db3` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:48.706422 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc76110-644e-436e-92b1-65d545fcee9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfa22034c9de4c7694b21f2f741a5db3)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:48.708638 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc76110-644e-436e-92b1-65d545fcee9c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:48.745273 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3734da-cc98-4a90-a634-abda45e161d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:48.746006 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3734da-cc98-4a90-a634-abda45e161d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:48.746301 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3734da-cc98-4a90-a634-abda45e161d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:48.746577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3734da-cc98-4a90-a634-abda45e161d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:48.747317 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3734da-cc98-4a90-a634-abda45e161d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:48.748959 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3734da-cc98-4a90-a634-abda45e161d2 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:48.796088 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 881/1772] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:48.797688 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cd1f3-9aa5-4c76-8510-3a432096bc7a None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:48.797997 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cd1f3-9aa5-4c76-8510-3a432096bc7a None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:48.798291 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cd1f3-9aa5-4c76-8510-3a432096bc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:48.848611 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-7c4cd1f3-9aa5-4c76-8510-3a432096bc7a None None] MFA Rules not processed for user `4156a6ff075847769c0d35cfeb1b3af0`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:48.850433 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7c4cd1f3-9aa5-4c76-8510-3a432096bc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:48.859445 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-abc76110-644e-436e-92b1-65d545fcee9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfa22034c9de4c7694b21f2f741a5db3', 'request_id': 'req-abc76110-644e-436e-92b1-65d545fcee9c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:48.872798 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-abc76110-644e-436e-92b1-65d545fcee9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfa22034c9de4c7694b21f2f741a5db3', 'request_id': 'req-abc76110-644e-436e-92b1-65d545fcee9c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:48.890373 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-abc76110-644e-436e-92b1-65d545fcee9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfa22034c9de4c7694b21f2f741a5db3', 'request_id': 'req-abc76110-644e-436e-92b1-65d545fcee9c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:48.946100 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-abc76110-644e-436e-92b1-65d545fcee9c admin admin] The token cache is being invalidate because project bfa22034c9de4c7694b21f2f741a5db3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:27:48.946919 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-abc76110-644e-436e-92b1-65d545fcee9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:48.952244 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-abc76110-644e-436e-92b1-65d545fcee9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:48.960158 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 892/1773] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:27:48 2022] DELETE /identity/v3/projects/bfa22034c9de4c7694b21f2f741a5db3 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:48.961210 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc76110-644e-436e-92b1-65d545fcee9c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:48.965504 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-abc76110-644e-436e-92b1-65d545fcee9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:49.105224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 882/1774] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:49.118303 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cd1f3-9aa5-4c76-8510-3a432096bc7a None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:49.127277 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7c4cd1f3-9aa5-4c76-8510-3a432096bc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:49.174122 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc76110-644e-436e-92b1-65d545fcee9c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:49.198879 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b07db-08c5-474d-a9a5-bc6e5070fa7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:49.199847 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b07db-08c5-474d-a9a5-bc6e5070fa7e admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:49.200153 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b07db-08c5-474d-a9a5-bc6e5070fa7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:49.200494 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b07db-08c5-474d-a9a5-bc6e5070fa7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:49.203574 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3b07db-08c5-474d-a9a5-bc6e5070fa7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:49.205695 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3b07db-08c5-474d-a9a5-bc6e5070fa7e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:49.296091 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cd1f3-9aa5-4c76-8510-3a432096bc7a None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:49.303990 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd019d37-5b18-43b4-9dd1-c6c5c64a1b4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:49.304697 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd019d37-5b18-43b4-9dd1-c6c5c64a1b4a service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:49.305103 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd019d37-5b18-43b4-9dd1-c6c5c64a1b4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:49.305532 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd019d37-5b18-43b4-9dd1-c6c5c64a1b4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:49.312263 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-bd019d37-5b18-43b4-9dd1-c6c5c64a1b4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:49.331317 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 893/1775] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:27:48 2022] POST /identity/v3/projects => generated 403 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:49.335467 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b07db-08c5-474d-a9a5-bc6e5070fa7e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:49.341830 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-bc3b07db-08c5-474d-a9a5-bc6e5070fa7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:49.400037 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:49.430051 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:49.495642 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd019d37-5b18-43b4-9dd1-c6c5c64a1b4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:49.505751 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd019d37-5b18-43b4-9dd1-c6c5c64a1b4a service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:49.557853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 883/1776] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:27:49.559475 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd019d37-5b18-43b4-9dd1-c6c5c64a1b4a service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:49.575977 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-bd019d37-5b18-43b4-9dd1-c6c5c64a1b4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:49.590416 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b07db-08c5-474d-a9a5-bc6e5070fa7e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:49.614645 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d2c54d-278b-41fe-a5f1-e41d0b833a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:49.616955 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2c54d-278b-41fe-a5f1-e41d0b833a1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:49.617685 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2c54d-278b-41fe-a5f1-e41d0b833a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:49.619538 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2c54d-278b-41fe-a5f1-e41d0b833a1b admin admin] PATH_INFO: `/v3/projects/163da5b66926496e92d08817f712e0eb/users/79f6d963ee514d4182d7abaf0c22e154/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:49.625511 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd019d37-5b18-43b4-9dd1-c6c5c64a1b4a service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:49.630858 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d2c54d-278b-41fe-a5f1-e41d0b833a1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=163da5b66926496e92d08817f712e0eb, user_id=79f6d963ee514d4182d7abaf0c22e154, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:49.634616 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d0da1-1f0e-4632-926c-467c165730be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:49.636124 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d0da1-1f0e-4632-926c-467c165730be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:49.637294 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d0da1-1f0e-4632-926c-467c165730be admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:49.637806 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d0da1-1f0e-4632-926c-467c165730be admin admin] PATH_INFO: `/v3/users/01e06890c8af4925bbc9ce0f6e6d4310` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:49.640828 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d2c54d-278b-41fe-a5f1-e41d0b833a1b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:49.641369 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d0da1-1f0e-4632-926c-467c165730be admin admin] RBAC: Authorizing `identity:delete_user(user_id=01e06890c8af4925bbc9ce0f6e6d4310)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:49.646270 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d0da1-1f0e-4632-926c-467c165730be admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:49.684475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 894/1777] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:27:49 2022] PUT /identity/v3/projects/163da5b66926496e92d08817f712e0eb/users/79f6d963ee514d4182d7abaf0c22e154/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:49.685859 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d2c54d-278b-41fe-a5f1-e41d0b833a1b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:49.696333 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-22d2c54d-278b-41fe-a5f1-e41d0b833a1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:49.838120 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-bb0d0da1-1f0e-4632-926c-467c165730be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01e06890c8af4925bbc9ce0f6e6d4310'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:49.841573 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-bb0d0da1-1f0e-4632-926c-467c165730be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01e06890c8af4925bbc9ce0f6e6d4310'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:49.877451 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d2c54d-278b-41fe-a5f1-e41d0b833a1b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:49.897700 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-bb0d0da1-1f0e-4632-926c-467c165730be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01e06890c8af4925bbc9ce0f6e6d4310'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:49.902615 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c3c75-d051-4307-8dd5-7d6e9ef48e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:49.914267 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c3c75-d051-4307-8dd5-7d6e9ef48e73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:49.916177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c3c75-d051-4307-8dd5-7d6e9ef48e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:49.916660 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c3c75-d051-4307-8dd5-7d6e9ef48e73 admin admin] PATH_INFO: `/v3/users/5815dd28f01c44658aa56f3110f9e03d` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:49.920221 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c3c75-d051-4307-8dd5-7d6e9ef48e73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5815dd28f01c44658aa56f3110f9e03d)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:49.932432 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c3c75-d051-4307-8dd5-7d6e9ef48e73 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:49.948407 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-bb0d0da1-1f0e-4632-926c-467c165730be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01e06890c8af4925bbc9ce0f6e6d4310'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:49.987581 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-bb0d0da1-1f0e-4632-926c-467c165730be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01e06890c8af4925bbc9ce0f6e6d4310'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:50.010203 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 884/1778] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:27:49 2022] DELETE /identity/v3/users/01e06890c8af4925bbc9ce0f6e6d4310 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:50.011044 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d0da1-1f0e-4632-926c-467c165730be admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:50.017742 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-bb0d0da1-1f0e-4632-926c-467c165730be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:50.146835 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a18c3c75-d051-4307-8dd5-7d6e9ef48e73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5815dd28f01c44658aa56f3110f9e03d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:50.149272 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a18c3c75-d051-4307-8dd5-7d6e9ef48e73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5815dd28f01c44658aa56f3110f9e03d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:50.225326 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a18c3c75-d051-4307-8dd5-7d6e9ef48e73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5815dd28f01c44658aa56f3110f9e03d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:50.259401 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a18c3c75-d051-4307-8dd5-7d6e9ef48e73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5815dd28f01c44658aa56f3110f9e03d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:50.261804 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a18c3c75-d051-4307-8dd5-7d6e9ef48e73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5815dd28f01c44658aa56f3110f9e03d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:50.296046 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 895/1779] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:27:49 2022] DELETE /identity/v3/users/5815dd28f01c44658aa56f3110f9e03d => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:50.299002 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c3c75-d051-4307-8dd5-7d6e9ef48e73 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:50.305278 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a18c3c75-d051-4307-8dd5-7d6e9ef48e73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:50.305905 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d0da1-1f0e-4632-926c-467c165730be admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:50.412150 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:50.440717 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ced8ce-7fc0-48b0-b61a-3a79983bbc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:50.442029 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ced8ce-7fc0-48b0-b61a-3a79983bbc7c admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:50.444147 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ced8ce-7fc0-48b0-b61a-3a79983bbc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:50.445257 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ced8ce-7fc0-48b0-b61a-3a79983bbc7c admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:50.449542 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ced8ce-7fc0-48b0-b61a-3a79983bbc7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:50.456746 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ced8ce-7fc0-48b0-b61a-3a79983bbc7c admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:50.460831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:50.526052 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 885/1780] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:27:50 2022] POST /identity/v3/users => generated 308 bytes in 515 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:50.531790 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b935f40-8dad-4435-ab0c-b2e917e86a0c None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:50.532713 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b935f40-8dad-4435-ab0c-b2e917e86a0c None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:50.533996 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b935f40-8dad-4435-ab0c-b2e917e86a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:50.563395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c3c75-d051-4307-8dd5-7d6e9ef48e73 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:50.608484 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0461ac4-fbe4-4932-92d6-0c2d3cfbe464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:50.610379 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0461ac4-fbe4-4932-92d6-0c2d3cfbe464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:50.610887 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0461ac4-fbe4-4932-92d6-0c2d3cfbe464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:50.611405 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0461ac4-fbe4-4932-92d6-0c2d3cfbe464 admin admin] PATH_INFO: `/v3/users/50830a88cf104cbb83aab0f0c5767e9d` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:50.618674 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0461ac4-fbe4-4932-92d6-0c2d3cfbe464 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50830a88cf104cbb83aab0f0c5767e9d)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:50.623796 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-9b935f40-8dad-4435-ab0c-b2e917e86a0c None None] MFA Rules not processed for user `79f6d963ee514d4182d7abaf0c22e154`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:50.624988 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0461ac4-fbe4-4932-92d6-0c2d3cfbe464 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:50.627377 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-9b935f40-8dad-4435-ab0c-b2e917e86a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:50.766844 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f0461ac4-fbe4-4932-92d6-0c2d3cfbe464 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50830a88cf104cbb83aab0f0c5767e9d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:50.768906 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f0461ac4-fbe4-4932-92d6-0c2d3cfbe464 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50830a88cf104cbb83aab0f0c5767e9d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:50.799634 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f0461ac4-fbe4-4932-92d6-0c2d3cfbe464 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50830a88cf104cbb83aab0f0c5767e9d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:50.828124 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f0461ac4-fbe4-4932-92d6-0c2d3cfbe464 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50830a88cf104cbb83aab0f0c5767e9d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:50.828927 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f0461ac4-fbe4-4932-92d6-0c2d3cfbe464 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50830a88cf104cbb83aab0f0c5767e9d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:50.851736 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 886/1781] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:50 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:50.853259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c3693-acb5-4189-a465-b22ef99d36d2 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:50.853753 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c3693-acb5-4189-a465-b22ef99d36d2 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:50.854164 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c3693-acb5-4189-a465-b22ef99d36d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:50.899923 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 896/1782] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:27:50 2022] DELETE /identity/v3/users/50830a88cf104cbb83aab0f0c5767e9d => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:50.904813 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-d18c3693-acb5-4189-a465-b22ef99d36d2 None None] MFA Rules not processed for user `df8135d434a6499db18f03e1ec293a05`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:50.904960 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1625685-3361-4f51-9441-80d503733cc5 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:50.906312 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1625685-3361-4f51-9441-80d503733cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:50.906610 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1625685-3361-4f51-9441-80d503733cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:50.908540 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d18c3693-acb5-4189-a465-b22ef99d36d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:50.982940 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b1625685-3361-4f51-9441-80d503733cc5 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:50.984312 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b1625685-3361-4f51-9441-80d503733cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:51.102814 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 887/1783] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:51.103700 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c3693-acb5-4189-a465-b22ef99d36d2 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:51.105011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d18c3693-acb5-4189-a465-b22ef99d36d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:51.115393 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 897/1784] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:51.133655 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1625685-3361-4f51-9441-80d503733cc5 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:51.138918 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b1625685-3361-4f51-9441-80d503733cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:51.156643 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c3693-acb5-4189-a465-b22ef99d36d2 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:51.177276 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6aa020-ac41-4ad5-9212-fc575e40bf43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:51.177276 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6aa020-ac41-4ad5-9212-fc575e40bf43 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:51.177276 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6aa020-ac41-4ad5-9212-fc575e40bf43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:51.177276 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6aa020-ac41-4ad5-9212-fc575e40bf43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:51.177788 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6aa020-ac41-4ad5-9212-fc575e40bf43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:51.186716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6aa020-ac41-4ad5-9212-fc575e40bf43 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:51.221031 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 888/1785] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:51.236369 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2911d-47b0-492f-95fc-4684cc9fe8a8 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:51.237206 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2911d-47b0-492f-95fc-4684cc9fe8a8 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:51.237706 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2911d-47b0-492f-95fc-4684cc9fe8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:51.285107 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-c4f2911d-47b0-492f-95fc-4684cc9fe8a8 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:51.286867 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c4f2911d-47b0-492f-95fc-4684cc9fe8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:51.297786 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1625685-3361-4f51-9441-80d503733cc5 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:51.300899 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 889/1786] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:51.303059 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2911d-47b0-492f-95fc-4684cc9fe8a8 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:51.307398 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c4f2911d-47b0-492f-95fc-4684cc9fe8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:51.320393 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d1172-d930-48f5-a601-d062f8d3767f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:51.321313 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d1172-d930-48f5-a601-d062f8d3767f service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:51.321755 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d1172-d930-48f5-a601-d062f8d3767f service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:51.322239 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d1172-d930-48f5-a601-d062f8d3767f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:51.377838 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:51.392804 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2911d-47b0-492f-95fc-4684cc9fe8a8 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:51.416287 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce68e4-e51e-41fa-afa1-0bb861b2cd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:51.420569 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce68e4-e51e-41fa-afa1-0bb861b2cd49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:51.421224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce68e4-e51e-41fa-afa1-0bb861b2cd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:51.422457 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce68e4-e51e-41fa-afa1-0bb861b2cd49 admin admin] PATH_INFO: `/v3/projects/d4745b4aca274ff596622d7cfaa5cb2c` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:51.428749 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce68e4-e51e-41fa-afa1-0bb861b2cd49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4745b4aca274ff596622d7cfaa5cb2c)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:51.431296 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce68e4-e51e-41fa-afa1-0bb861b2cd49 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:51.578965 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d1172-d930-48f5-a601-d062f8d3767f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:51.581582 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d1172-d930-48f5-a601-d062f8d3767f service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:51.603250 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:51.610322 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-45ce68e4-e51e-41fa-afa1-0bb861b2cd49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4745b4aca274ff596622d7cfaa5cb2c', 'request_id': 'req-45ce68e4-e51e-41fa-afa1-0bb861b2cd49'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:51.615142 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 898/1787] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:51 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:27:51.616309 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d1172-d930-48f5-a601-d062f8d3767f service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:51.619134 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-738d1172-d930-48f5-a601-d062f8d3767f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:51.625841 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-45ce68e4-e51e-41fa-afa1-0bb861b2cd49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4745b4aca274ff596622d7cfaa5cb2c', 'request_id': 'req-45ce68e4-e51e-41fa-afa1-0bb861b2cd49'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:51.633091 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-45ce68e4-e51e-41fa-afa1-0bb861b2cd49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4745b4aca274ff596622d7cfaa5cb2c', 'request_id': 'req-45ce68e4-e51e-41fa-afa1-0bb861b2cd49'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:51.659478 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-45ce68e4-e51e-41fa-afa1-0bb861b2cd49 admin admin] The token cache is being invalidate because project d4745b4aca274ff596622d7cfaa5cb2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:27:51.659891 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-45ce68e4-e51e-41fa-afa1-0bb861b2cd49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:51.660508 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-45ce68e4-e51e-41fa-afa1-0bb861b2cd49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:51.662464 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 890/1788] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:27:51 2022] DELETE /identity/v3/projects/d4745b4aca274ff596622d7cfaa5cb2c => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:51.667318 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce68e4-e51e-41fa-afa1-0bb861b2cd49 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:51.669272 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-45ce68e4-e51e-41fa-afa1-0bb861b2cd49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:51.739883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d1172-d930-48f5-a601-d062f8d3767f service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:51.812168 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce68e4-e51e-41fa-afa1-0bb861b2cd49 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:51.846770 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b481d9-c612-431b-8e78-7c94fa334fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:51.847688 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b481d9-c612-431b-8e78-7c94fa334fc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:51.847975 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b481d9-c612-431b-8e78-7c94fa334fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:51.848253 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b481d9-c612-431b-8e78-7c94fa334fc3 admin admin] PATH_INFO: `/v3/projects/58adb5e5d28c4d3fa4e1f5e40f12f540/users/6b57b717a4c14bbea12c7ef1fee90e97/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:51.875102 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b481d9-c612-431b-8e78-7c94fa334fc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58adb5e5d28c4d3fa4e1f5e40f12f540, user_id=6b57b717a4c14bbea12c7ef1fee90e97, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:51.879458 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b481d9-c612-431b-8e78-7c94fa334fc3 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:51.903772 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 891/1789] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:27:51 2022] PUT /identity/v3/projects/58adb5e5d28c4d3fa4e1f5e40f12f540/users/6b57b717a4c14bbea12c7ef1fee90e97/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:51.905334 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b481d9-c612-431b-8e78-7c94fa334fc3 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:51.907867 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-65b481d9-c612-431b-8e78-7c94fa334fc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:51.913698 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ed67c-09d2-49d0-b877-e1a31c121d2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:51.915075 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ed67c-09d2-49d0-b877-e1a31c121d2c service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:51.916171 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ed67c-09d2-49d0-b877-e1a31c121d2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:51.918908 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ed67c-09d2-49d0-b877-e1a31c121d2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:51.925042 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-256ed67c-09d2-49d0-b877-e1a31c121d2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:51.959297 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ed67c-09d2-49d0-b877-e1a31c121d2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:51.963564 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ed67c-09d2-49d0-b877-e1a31c121d2c service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:51.997953 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 899/1790] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:27:52.002779 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57808b-58f5-4e9d-bff6-70cc3958c319 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:52.004332 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57808b-58f5-4e9d-bff6-70cc3958c319 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:52.004684 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57808b-58f5-4e9d-bff6-70cc3958c319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:52.017383 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b481d9-c612-431b-8e78-7c94fa334fc3 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:52.030656 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaefff2-b4c8-4123-9d64-64ce4d986b88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:52.031344 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaefff2-b4c8-4123-9d64-64ce4d986b88 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:52.031632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaefff2-b4c8-4123-9d64-64ce4d986b88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:52.032072 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaefff2-b4c8-4123-9d64-64ce4d986b88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:52.037377 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-eaaefff2-b4c8-4123-9d64-64ce4d986b88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:52.067432 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7d57808b-58f5-4e9d-bff6-70cc3958c319 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:52.069173 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7d57808b-58f5-4e9d-bff6-70cc3958c319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:52.210530 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaefff2-b4c8-4123-9d64-64ce4d986b88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:52.212010 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaefff2-b4c8-4123-9d64-64ce4d986b88 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:52.237565 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 892/1791] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:27:52.238434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaefff2-b4c8-4123-9d64-64ce4d986b88 service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:52.258205 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaefff2-b4c8-4123-9d64-64ce4d986b88 service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:52.276357 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 900/1792] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:52.277259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af5e88-2fdf-4a0c-a8fe-468fe9c6f86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:52.277259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af5e88-2fdf-4a0c-a8fe-468fe9c6f86b admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:52.277544 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af5e88-2fdf-4a0c-a8fe-468fe9c6f86b admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:52.277716 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57808b-58f5-4e9d-bff6-70cc3958c319 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:52.277823 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af5e88-2fdf-4a0c-a8fe-468fe9c6f86b admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:52.278584 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af5e88-2fdf-4a0c-a8fe-468fe9c6f86b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:52.280598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af5e88-2fdf-4a0c-a8fe-468fe9c6f86b admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:52.280790 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7d57808b-58f5-4e9d-bff6-70cc3958c319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:52.281749 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:52.305499 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 893/1793] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:52.306916 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82179ce3-974b-4bd2-96dd-c70711da7fdd None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:52.307200 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82179ce3-974b-4bd2-96dd-c70711da7fdd None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:52.307480 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82179ce3-974b-4bd2-96dd-c70711da7fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:52.314412 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57808b-58f5-4e9d-bff6-70cc3958c319 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:52.330998 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95e9d0-0e2f-4ae6-85e6-d757abbe6a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:52.331675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95e9d0-0e2f-4ae6-85e6-d757abbe6a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:52.331961 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95e9d0-0e2f-4ae6-85e6-d757abbe6a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:52.332239 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95e9d0-0e2f-4ae6-85e6-d757abbe6a82 admin admin] PATH_INFO: `/v3/users/b46ced40b8d54ebfb47d633b4a6df23c` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:52.335516 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95e9d0-0e2f-4ae6-85e6-d757abbe6a82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b46ced40b8d54ebfb47d633b4a6df23c)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:52.337964 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95e9d0-0e2f-4ae6-85e6-d757abbe6a82 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:52.346469 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:52.355224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-82179ce3-974b-4bd2-96dd-c70711da7fdd None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:52.356988 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-82179ce3-974b-4bd2-96dd-c70711da7fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:52.370139 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 894/1794] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:52.370139 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82179ce3-974b-4bd2-96dd-c70711da7fdd None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:52.406838 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82179ce3-974b-4bd2-96dd-c70711da7fdd None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:52.442799 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502267b7-faa5-415d-af55-222d48724f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:52.443711 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502267b7-faa5-415d-af55-222d48724f5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:52.443993 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502267b7-faa5-415d-af55-222d48724f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:52.444276 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502267b7-faa5-415d-af55-222d48724f5b admin admin] PATH_INFO: `/v3/projects/58adb5e5d28c4d3fa4e1f5e40f12f540/users/6b57b717a4c14bbea12c7ef1fee90e97/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:52.448036 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502267b7-faa5-415d-af55-222d48724f5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=58adb5e5d28c4d3fa4e1f5e40f12f540, user_id=6b57b717a4c14bbea12c7ef1fee90e97, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:52.451369 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502267b7-faa5-415d-af55-222d48724f5b admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:52.468481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-df95e9d0-0e2f-4ae6-85e6-d757abbe6a82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b46ced40b8d54ebfb47d633b4a6df23c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:52.469995 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-df95e9d0-0e2f-4ae6-85e6-d757abbe6a82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b46ced40b8d54ebfb47d633b4a6df23c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:52.481730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 895/1795] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:27:52 2022] PUT /identity/v3/projects/58adb5e5d28c4d3fa4e1f5e40f12f540/users/6b57b717a4c14bbea12c7ef1fee90e97/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:52.483134 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502267b7-faa5-415d-af55-222d48724f5b admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:52.487690 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-502267b7-faa5-415d-af55-222d48724f5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:52.504408 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-df95e9d0-0e2f-4ae6-85e6-d757abbe6a82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b46ced40b8d54ebfb47d633b4a6df23c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:52.516858 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-df95e9d0-0e2f-4ae6-85e6-d757abbe6a82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b46ced40b8d54ebfb47d633b4a6df23c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:52.518070 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-df95e9d0-0e2f-4ae6-85e6-d757abbe6a82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b46ced40b8d54ebfb47d633b4a6df23c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:52.547466 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 901/1796] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:27:52 2022] DELETE /identity/v3/users/b46ced40b8d54ebfb47d633b4a6df23c => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:52.551170 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d8082-8b76-4fb1-8c12-40ee3a82cb83 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:52.551583 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d8082-8b76-4fb1-8c12-40ee3a82cb83 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:52.551980 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d8082-8b76-4fb1-8c12-40ee3a82cb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:52.616258 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-4a8d8082-8b76-4fb1-8c12-40ee3a82cb83 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:52.618209 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4a8d8082-8b76-4fb1-8c12-40ee3a82cb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:52.688952 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502267b7-faa5-415d-af55-222d48724f5b admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:52.743958 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 902/1797] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:52.781647 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d8082-8b76-4fb1-8c12-40ee3a82cb83 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:52.783803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4a8d8082-8b76-4fb1-8c12-40ee3a82cb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:52.818284 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4e765-39aa-4fb3-a145-e080c3675a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:52.819427 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4e765-39aa-4fb3-a145-e080c3675a04 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:52.820461 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4e765-39aa-4fb3-a145-e080c3675a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:52.820940 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4e765-39aa-4fb3-a145-e080c3675a04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:52.822707 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4e765-39aa-4fb3-a145-e080c3675a04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:27:52.823234 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4e765-39aa-4fb3-a145-e080c3675a04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:52.826009 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4e765-39aa-4fb3-a145-e080c3675a04 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:52.860574 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 896/1798] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:27:52.867590 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4e765-39aa-4fb3-a145-e080c3675a04 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:52.885915 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4e765-39aa-4fb3-a145-e080c3675a04 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:52.894170 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f5d45-07ee-445f-aa17-3bd374af0b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:52.895123 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f5d45-07ee-445f-aa17-3bd374af0b1a admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:52.895422 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f5d45-07ee-445f-aa17-3bd374af0b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:52.896770 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f5d45-07ee-445f-aa17-3bd374af0b1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:52.897517 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f5d45-07ee-445f-aa17-3bd374af0b1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:52.905822 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f5d45-07ee-445f-aa17-3bd374af0b1a admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:52.961383 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d8082-8b76-4fb1-8c12-40ee3a82cb83 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:52.981707 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665bfe7-829d-4df2-8e2e-64115ce5adee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:52.982343 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665bfe7-829d-4df2-8e2e-64115ce5adee service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:52.982776 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665bfe7-829d-4df2-8e2e-64115ce5adee service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:52.983074 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665bfe7-829d-4df2-8e2e-64115ce5adee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:53.011224 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8665bfe7-829d-4df2-8e2e-64115ce5adee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:53.012746 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8665bfe7-829d-4df2-8e2e-64115ce5adee service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:53.026339 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 897/1799] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:27:52 2022] POST /identity/v3/projects => generated 401 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:53.030383 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f5d45-07ee-445f-aa17-3bd374af0b1a admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:53.042580 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 903/1800] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:27:53.223676 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:53.232240 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f5d45-07ee-445f-aa17-3bd374af0b1a admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:53.251943 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b77cca-f5e7-412a-81f3-3197127edfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:53.251943 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b77cca-f5e7-412a-81f3-3197127edfb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:53.252172 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b77cca-f5e7-412a-81f3-3197127edfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:53.252360 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b77cca-f5e7-412a-81f3-3197127edfb9 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:53.253863 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b77cca-f5e7-412a-81f3-3197127edfb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:53.255758 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b77cca-f5e7-412a-81f3-3197127edfb9 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:53.304169 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 898/1801] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:27:53 2022] POST /identity/v3/users => generated 301 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:53.307914 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665bfe7-829d-4df2-8e2e-64115ce5adee service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:53.331126 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665bfe7-829d-4df2-8e2e-64115ce5adee service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:53.361081 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9015b110-b8e1-470a-ab4d-5ca47f59c57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:53.362984 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015b110-b8e1-470a-ab4d-5ca47f59c57e admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:53.364631 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015b110-b8e1-470a-ab4d-5ca47f59c57e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:53.365917 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015b110-b8e1-470a-ab4d-5ca47f59c57e admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:53.367000 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9015b110-b8e1-470a-ab4d-5ca47f59c57e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:53.372187 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9015b110-b8e1-470a-ab4d-5ca47f59c57e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:53.398368 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b77cca-f5e7-412a-81f3-3197127edfb9 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:53.407702 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 904/1802] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:53.416826 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b77cca-f5e7-412a-81f3-3197127edfb9 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:53.424393 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e951bd-015d-4f4c-82f5-701262f197f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:53.425288 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e951bd-015d-4f4c-82f5-701262f197f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:53.425652 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e951bd-015d-4f4c-82f5-701262f197f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:53.426174 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e951bd-015d-4f4c-82f5-701262f197f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:53.427007 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e951bd-015d-4f4c-82f5-701262f197f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:53.454886 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e951bd-015d-4f4c-82f5-701262f197f3 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:53.485888 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9015b110-b8e1-470a-ab4d-5ca47f59c57e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:53.501722 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9015b110-b8e1-470a-ab4d-5ca47f59c57e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:53.502206 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 899/1803] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:53.509855 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c229b-0973-448b-9bdc-8a5e8f938ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:53.512520 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c229b-0973-448b-9bdc-8a5e8f938ad4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:53.512961 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c229b-0973-448b-9bdc-8a5e8f938ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:53.513527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c229b-0973-448b-9bdc-8a5e8f938ad4 admin admin] PATH_INFO: `/v3/projects/f6c87bf35ca14f0fb732c6228f1a2ae7/users/5b3cf75e7578417cac903d9323960af8/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:53.519699 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e951bd-015d-4f4c-82f5-701262f197f3 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:53.521886 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-55e951bd-015d-4f4c-82f5-701262f197f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:53.546936 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e951bd-015d-4f4c-82f5-701262f197f3 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:53.558150 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:53.563064 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d5a79-9046-4ee0-8dc2-cf7f1251231d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:53.564011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d5a79-9046-4ee0-8dc2-cf7f1251231d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:53.564446 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d5a79-9046-4ee0-8dc2-cf7f1251231d admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:53.564734 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d5a79-9046-4ee0-8dc2-cf7f1251231d admin admin] PATH_INFO: `/v3/projects/771e901107914969b4e47a811973715e` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:53.567441 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d5a79-9046-4ee0-8dc2-cf7f1251231d admin admin] RBAC: Authorizing `identity:delete_project(project_id=771e901107914969b4e47a811973715e)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:53.570696 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c229b-0973-448b-9bdc-8a5e8f938ad4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6c87bf35ca14f0fb732c6228f1a2ae7, user_id=5b3cf75e7578417cac903d9323960af8, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:53.574237 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c229b-0973-448b-9bdc-8a5e8f938ad4 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:53.575624 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d5a79-9046-4ee0-8dc2-cf7f1251231d admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:53.618555 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 905/1804] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:27:53 2022] PUT /identity/v3/projects/f6c87bf35ca14f0fb732c6228f1a2ae7/users/5b3cf75e7578417cac903d9323960af8/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:53.623842 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee86b1-74b4-4e6c-a9ec-75176bf2d1bc None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:53.624146 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee86b1-74b4-4e6c-a9ec-75176bf2d1bc None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:53.626996 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee86b1-74b4-4e6c-a9ec-75176bf2d1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:53.680300 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-faee86b1-74b4-4e6c-a9ec-75176bf2d1bc None None] MFA Rules not processed for user `5b3cf75e7578417cac903d9323960af8`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:53.681579 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-faee86b1-74b4-4e6c-a9ec-75176bf2d1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:53.796420 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 906/1805] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:53.802690 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee86b1-74b4-4e6c-a9ec-75176bf2d1bc None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:53.907679 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d12d5a79-9046-4ee0-8dc2-cf7f1251231d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '771e901107914969b4e47a811973715e', 'request_id': 'req-d12d5a79-9046-4ee0-8dc2-cf7f1251231d'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:53.928324 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d12d5a79-9046-4ee0-8dc2-cf7f1251231d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '771e901107914969b4e47a811973715e', 'request_id': 'req-d12d5a79-9046-4ee0-8dc2-cf7f1251231d'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:53.939427 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d12d5a79-9046-4ee0-8dc2-cf7f1251231d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '771e901107914969b4e47a811973715e', 'request_id': 'req-d12d5a79-9046-4ee0-8dc2-cf7f1251231d'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:53.974630 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee86b1-74b4-4e6c-a9ec-75176bf2d1bc None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:53.974842 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d12d5a79-9046-4ee0-8dc2-cf7f1251231d admin admin] The token cache is being invalidate because project 771e901107914969b4e47a811973715e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:27:53.975118 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d12d5a79-9046-4ee0-8dc2-cf7f1251231d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:53.979154 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d12d5a79-9046-4ee0-8dc2-cf7f1251231d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:53.986848 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 900/1806] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:27:53 2022] DELETE /identity/v3/projects/771e901107914969b4e47a811973715e => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:27:53.988167 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d5a79-9046-4ee0-8dc2-cf7f1251231d admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:53.990336 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d12d5a79-9046-4ee0-8dc2-cf7f1251231d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:54.105719 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361bc8a4-a06d-4c8d-a197-e8684884136e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:54.106437 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bc8a4-a06d-4c8d-a197-e8684884136e admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:54.106726 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bc8a4-a06d-4c8d-a197-e8684884136e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:54.107009 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bc8a4-a06d-4c8d-a197-e8684884136e admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:54.107716 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361bc8a4-a06d-4c8d-a197-e8684884136e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:54.109660 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361bc8a4-a06d-4c8d-a197-e8684884136e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:54.131218 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d5a79-9046-4ee0-8dc2-cf7f1251231d admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:54.137327 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddbd7c-ec9a-4af0-897b-c4f916e9ba15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:54.138439 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddbd7c-ec9a-4af0-897b-c4f916e9ba15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:54.138745 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddbd7c-ec9a-4af0-897b-c4f916e9ba15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:54.139128 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddbd7c-ec9a-4af0-897b-c4f916e9ba15 admin admin] PATH_INFO: `/v3/users/e4e4cd94703f48398fd531d860838743` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:54.140732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cddbd7c-ec9a-4af0-897b-c4f916e9ba15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4e4cd94703f48398fd531d860838743)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:54.143237 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cddbd7c-ec9a-4af0-897b-c4f916e9ba15 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:54.162857 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 907/1807] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:27:53 2022] POST /identity/v3/projects => generated 399 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:54.164247 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361bc8a4-a06d-4c8d-a197-e8684884136e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:54.166466 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-361bc8a4-a06d-4c8d-a197-e8684884136e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:54.184801 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:54.242057 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3cddbd7c-ec9a-4af0-897b-c4f916e9ba15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4e4cd94703f48398fd531d860838743'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:54.242926 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3cddbd7c-ec9a-4af0-897b-c4f916e9ba15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4e4cd94703f48398fd531d860838743'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:54.263290 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=81,keystone:INSERT=4,keystone:DELETE=15 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:54.274655 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3cddbd7c-ec9a-4af0-897b-c4f916e9ba15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4e4cd94703f48398fd531d860838743'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:54.293473 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3cddbd7c-ec9a-4af0-897b-c4f916e9ba15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4e4cd94703f48398fd531d860838743'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:54.311458 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3cddbd7c-ec9a-4af0-897b-c4f916e9ba15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4e4cd94703f48398fd531d860838743'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:54.341492 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 901/1808] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:27:53 2022] DELETE /identity/v3/users/e4e4cd94703f48398fd531d860838743 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:27:54.347423 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddbd7c-ec9a-4af0-897b-c4f916e9ba15 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:54.352500 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3cddbd7c-ec9a-4af0-897b-c4f916e9ba15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:54.365289 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361bc8a4-a06d-4c8d-a197-e8684884136e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:54.498273 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a0a7a-6bbf-4d21-ab2d-1ec63386d974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:54.500141 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a0a7a-6bbf-4d21-ab2d-1ec63386d974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:54.500878 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a0a7a-6bbf-4d21-ab2d-1ec63386d974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:54.501492 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a0a7a-6bbf-4d21-ab2d-1ec63386d974 admin admin] PATH_INFO: `/v3/projects/d5a6fcda97a74b51af5325725a81f2a4` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:54.503908 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a0a7a-6bbf-4d21-ab2d-1ec63386d974 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5a6fcda97a74b51af5325725a81f2a4)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:54.506412 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a0a7a-6bbf-4d21-ab2d-1ec63386d974 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:54.537654 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddbd7c-ec9a-4af0-897b-c4f916e9ba15 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:54.544284 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad165aa-748e-4502-96dd-4000c6da5da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:54.546197 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad165aa-748e-4502-96dd-4000c6da5da1 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:54.546624 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad165aa-748e-4502-96dd-4000c6da5da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:54.547002 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad165aa-748e-4502-96dd-4000c6da5da1 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:54.547931 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad165aa-748e-4502-96dd-4000c6da5da1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:54.550710 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad165aa-748e-4502-96dd-4000c6da5da1 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:54.585104 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f43a0a7a-6bbf-4d21-ab2d-1ec63386d974 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5a6fcda97a74b51af5325725a81f2a4', 'request_id': 'req-f43a0a7a-6bbf-4d21-ab2d-1ec63386d974'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:54.595915 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 902/1809] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:27:54 2022] POST /identity/v3/users => generated 306 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:54.599799 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad165aa-748e-4502-96dd-4000c6da5da1 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:54.602629 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f43a0a7a-6bbf-4d21-ab2d-1ec63386d974 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5a6fcda97a74b51af5325725a81f2a4', 'request_id': 'req-f43a0a7a-6bbf-4d21-ab2d-1ec63386d974'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:54.614754 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f43a0a7a-6bbf-4d21-ab2d-1ec63386d974 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5a6fcda97a74b51af5325725a81f2a4', 'request_id': 'req-f43a0a7a-6bbf-4d21-ab2d-1ec63386d974'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:54.629883 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad165aa-748e-4502-96dd-4000c6da5da1 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:54.653926 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f43a0a7a-6bbf-4d21-ab2d-1ec63386d974 admin admin] The token cache is being invalidate because project d5a6fcda97a74b51af5325725a81f2a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:27:54.654804 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f43a0a7a-6bbf-4d21-ab2d-1ec63386d974 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:54.655813 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f43a0a7a-6bbf-4d21-ab2d-1ec63386d974 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:54.657664 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 908/1810] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:27:54 2022] DELETE /identity/v3/projects/d5a6fcda97a74b51af5325725a81f2a4 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:54.664507 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a0a7a-6bbf-4d21-ab2d-1ec63386d974 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:54.666436 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f43a0a7a-6bbf-4d21-ab2d-1ec63386d974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:54.794352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9872ee5-416e-4c0e-bce9-0cd014a3bbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:54.794352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9872ee5-416e-4c0e-bce9-0cd014a3bbfd admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:54.794352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9872ee5-416e-4c0e-bce9-0cd014a3bbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:54.794352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9872ee5-416e-4c0e-bce9-0cd014a3bbfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:54.801388 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9872ee5-416e-4c0e-bce9-0cd014a3bbfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:54.801388 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9872ee5-416e-4c0e-bce9-0cd014a3bbfd admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:54.842571 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:54.864226 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 903/1811] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:54.867321 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c91a0-7c80-40c7-b426-1fdd1178b37d None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:54.867512 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c91a0-7c80-40c7-b426-1fdd1178b37d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:54.867731 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c91a0-7c80-40c7-b426-1fdd1178b37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:54.923104 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a0a7a-6bbf-4d21-ab2d-1ec63386d974 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:54.931973 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde16d65-17f7-487e-9d95-8534db81c4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:54.932917 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde16d65-17f7-487e-9d95-8534db81c4fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:54.933253 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde16d65-17f7-487e-9d95-8534db81c4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:54.933599 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde16d65-17f7-487e-9d95-8534db81c4fd admin admin] PATH_INFO: `/v3/users/6e423ca6af7342a0801b4c51596c2995` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:54.939398 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde16d65-17f7-487e-9d95-8534db81c4fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e423ca6af7342a0801b4c51596c2995)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:54.943550 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde16d65-17f7-487e-9d95-8534db81c4fd admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:54.981710 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-795c91a0-7c80-40c7-b426-1fdd1178b37d None None] MFA Rules not processed for user `6b57b717a4c14bbea12c7ef1fee90e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:54.983063 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-795c91a0-7c80-40c7-b426-1fdd1178b37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:55.066515 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bde16d65-17f7-487e-9d95-8534db81c4fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e423ca6af7342a0801b4c51596c2995'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:55.067406 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bde16d65-17f7-487e-9d95-8534db81c4fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e423ca6af7342a0801b4c51596c2995'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:55.087919 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bde16d65-17f7-487e-9d95-8534db81c4fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e423ca6af7342a0801b4c51596c2995'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:55.092761 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:55.100196 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bde16d65-17f7-487e-9d95-8534db81c4fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e423ca6af7342a0801b4c51596c2995'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:55.101236 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bde16d65-17f7-487e-9d95-8534db81c4fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e423ca6af7342a0801b4c51596c2995'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:55.122186 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 909/1812] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:27:54 2022] DELETE /identity/v3/users/6e423ca6af7342a0801b4c51596c2995 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:55.122186 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde16d65-17f7-487e-9d95-8534db81c4fd admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:55.124679 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-bde16d65-17f7-487e-9d95-8534db81c4fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:55.131835 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 904/1813] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:54 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:55.133694 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c91a0-7c80-40c7-b426-1fdd1178b37d None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:55.135767 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-795c91a0-7c80-40c7-b426-1fdd1178b37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:55.164357 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c91a0-7c80-40c7-b426-1fdd1178b37d None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:55.232275 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde16d65-17f7-487e-9d95-8534db81c4fd admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:55.238582 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62390b-ee05-4bac-a795-738d0649886f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:55.239837 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62390b-ee05-4bac-a795-738d0649886f admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:55.241403 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62390b-ee05-4bac-a795-738d0649886f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:55.241912 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62390b-ee05-4bac-a795-738d0649886f admin admin] PATH_INFO: `/v3/projects/66ab6f9f489448ceb3272d871f28df0a/users/0bbd4a59e34041e380bed7bc9aeb25b9/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:55.285454 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f62390b-ee05-4bac-a795-738d0649886f admin admin] RBAC: Authorizing `identity:create_grant(project_id=66ab6f9f489448ceb3272d871f28df0a, user_id=0bbd4a59e34041e380bed7bc9aeb25b9, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:55.292844 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f62390b-ee05-4bac-a795-738d0649886f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:55.307148 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c3735-42c0-45d5-b28b-07ad4938a9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:55.309095 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c3735-42c0-45d5-b28b-07ad4938a9c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:55.309600 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c3735-42c0-45d5-b28b-07ad4938a9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:55.310338 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c3735-42c0-45d5-b28b-07ad4938a9c1 admin admin] PATH_INFO: `/v3/projects/39b1dd2ba55a49d9bc3ac82e8b89413b` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:55.312353 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c3735-42c0-45d5-b28b-07ad4938a9c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39b1dd2ba55a49d9bc3ac82e8b89413b)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:55.313565 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 910/1814] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:27:55 2022] PUT /identity/v3/projects/66ab6f9f489448ceb3272d871f28df0a/users/0bbd4a59e34041e380bed7bc9aeb25b9/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:55.315984 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c3735-42c0-45d5-b28b-07ad4938a9c1 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:55.317176 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62390b-ee05-4bac-a795-738d0649886f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:55.393391 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-890c3735-42c0-45d5-b28b-07ad4938a9c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39b1dd2ba55a49d9bc3ac82e8b89413b', 'request_id': 'req-890c3735-42c0-45d5-b28b-07ad4938a9c1'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:55.416504 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-890c3735-42c0-45d5-b28b-07ad4938a9c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39b1dd2ba55a49d9bc3ac82e8b89413b', 'request_id': 'req-890c3735-42c0-45d5-b28b-07ad4938a9c1'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:55.428651 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-890c3735-42c0-45d5-b28b-07ad4938a9c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39b1dd2ba55a49d9bc3ac82e8b89413b', 'request_id': 'req-890c3735-42c0-45d5-b28b-07ad4938a9c1'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:55.443310 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:55.450474 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-890c3735-42c0-45d5-b28b-07ad4938a9c1 admin admin] The token cache is being invalidate because project 39b1dd2ba55a49d9bc3ac82e8b89413b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:27:55.451086 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-890c3735-42c0-45d5-b28b-07ad4938a9c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:55.451984 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-890c3735-42c0-45d5-b28b-07ad4938a9c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:55.457332 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 905/1815] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:27:55 2022] DELETE /identity/v3/projects/39b1dd2ba55a49d9bc3ac82e8b89413b => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:55.458852 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62390b-ee05-4bac-a795-738d0649886f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:55.462652 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c3735-42c0-45d5-b28b-07ad4938a9c1 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:55.464904 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-890c3735-42c0-45d5-b28b-07ad4938a9c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:55.552300 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b9203-9012-4f8b-9e5f-23138573cc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:55.554458 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b9203-9012-4f8b-9e5f-23138573cc73 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:55.554697 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b9203-9012-4f8b-9e5f-23138573cc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:55.555053 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b9203-9012-4f8b-9e5f-23138573cc73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:55.555886 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b9203-9012-4f8b-9e5f-23138573cc73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:55.557655 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b9203-9012-4f8b-9e5f-23138573cc73 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:55.571446 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 911/1816] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 04:27:55.576066 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b9203-9012-4f8b-9e5f-23138573cc73 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:55.577893 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4d4b9203-9012-4f8b-9e5f-23138573cc73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:55.598159 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b9203-9012-4f8b-9e5f-23138573cc73 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:55.602099 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c3735-42c0-45d5-b28b-07ad4938a9c1 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:55.608493 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2587fe96-7021-4000-80cf-cfcb3f4442d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:55.609444 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587fe96-7021-4000-80cf-cfcb3f4442d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:55.609780 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587fe96-7021-4000-80cf-cfcb3f4442d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:55.610083 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587fe96-7021-4000-80cf-cfcb3f4442d5 admin admin] PATH_INFO: `/v3/users/79f6d963ee514d4182d7abaf0c22e154` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:55.612306 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2587fe96-7021-4000-80cf-cfcb3f4442d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79f6d963ee514d4182d7abaf0c22e154)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:55.614647 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2587fe96-7021-4000-80cf-cfcb3f4442d5 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:55.615994 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a31e8-5361-4051-9a11-6366eacc9706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:55.616926 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a31e8-5361-4051-9a11-6366eacc9706 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:55.617214 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a31e8-5361-4051-9a11-6366eacc9706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:55.617550 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a31e8-5361-4051-9a11-6366eacc9706 admin admin] PATH_INFO: `/v3/projects/66ab6f9f489448ceb3272d871f28df0a/users/0bbd4a59e34041e380bed7bc9aeb25b9/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:55.619729 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a31e8-5361-4051-9a11-6366eacc9706 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66ab6f9f489448ceb3272d871f28df0a, user_id=0bbd4a59e34041e380bed7bc9aeb25b9, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:55.623948 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a31e8-5361-4051-9a11-6366eacc9706 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:55.639438 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 912/1817] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:27:55 2022] PUT /identity/v3/projects/66ab6f9f489448ceb3272d871f28df0a/users/0bbd4a59e34041e380bed7bc9aeb25b9/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:27:55.647813 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:55.653144 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dcf5e-4559-424f-a0a9-5a3f0ec7fd67 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:55.653698 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dcf5e-4559-424f-a0a9-5a3f0ec7fd67 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:55.654529 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dcf5e-4559-424f-a0a9-5a3f0ec7fd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:55.698621 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-513dcf5e-4559-424f-a0a9-5a3f0ec7fd67 None None] MFA Rules not processed for user `0bbd4a59e34041e380bed7bc9aeb25b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:55.700566 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-513dcf5e-4559-424f-a0a9-5a3f0ec7fd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:55.703443 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-2587fe96-7021-4000-80cf-cfcb3f4442d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79f6d963ee514d4182d7abaf0c22e154'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:55.704213 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-2587fe96-7021-4000-80cf-cfcb3f4442d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79f6d963ee514d4182d7abaf0c22e154'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:55.732850 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-2587fe96-7021-4000-80cf-cfcb3f4442d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79f6d963ee514d4182d7abaf0c22e154'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:55.745142 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-2587fe96-7021-4000-80cf-cfcb3f4442d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79f6d963ee514d4182d7abaf0c22e154'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:55.755942 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-2587fe96-7021-4000-80cf-cfcb3f4442d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79f6d963ee514d4182d7abaf0c22e154'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:55.768262 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 906/1818] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:27:55 2022] DELETE /identity/v3/users/79f6d963ee514d4182d7abaf0c22e154 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:55.788427 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 913/1819] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:55 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:55.799439 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2587fe96-7021-4000-80cf-cfcb3f4442d5 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:55.800903 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-2587fe96-7021-4000-80cf-cfcb3f4442d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:55.886155 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2587fe96-7021-4000-80cf-cfcb3f4442d5 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:55.891386 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f095f-60a1-422f-810d-bb7eaff878d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:55.892061 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f095f-60a1-422f-810d-bb7eaff878d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:55.892580 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f095f-60a1-422f-810d-bb7eaff878d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:55.892764 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f095f-60a1-422f-810d-bb7eaff878d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:55.966424 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f095f-60a1-422f-810d-bb7eaff878d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:55.968821 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f095f-60a1-422f-810d-bb7eaff878d7 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:55.982200 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 907/1820] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:55 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:27:56.068801 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513dcf5e-4559-424f-a0a9-5a3f0ec7fd67 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:56.220015 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f095f-60a1-422f-810d-bb7eaff878d7 service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:56.224707 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-038f095f-60a1-422f-810d-bb7eaff878d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:56.238665 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513dcf5e-4559-424f-a0a9-5a3f0ec7fd67 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:56.242885 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c50827-c7bc-4555-b482-d386f36d948a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:56.244075 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c50827-c7bc-4555-b482-d386f36d948a service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:56.244075 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c50827-c7bc-4555-b482-d386f36d948a service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:56.244075 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c50827-c7bc-4555-b482-d386f36d948a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:56.255325 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-89c50827-c7bc-4555-b482-d386f36d948a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:56.294110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:56.358082 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:56.398601 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f095f-60a1-422f-810d-bb7eaff878d7 service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:56.404350 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c50827-c7bc-4555-b482-d386f36d948a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:56.408727 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59221be-fdb3-41c7-b508-8a4d4f0af5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:56.409625 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59221be-fdb3-41c7-b508-8a4d4f0af5bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:56.409915 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59221be-fdb3-41c7-b508-8a4d4f0af5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:56.410228 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59221be-fdb3-41c7-b508-8a4d4f0af5bb admin admin] PATH_INFO: `/v3/projects/e0375fc0bec74a4e9ea421b6168a1ec7` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:56.410648 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c50827-c7bc-4555-b482-d386f36d948a service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:56.415614 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59221be-fdb3-41c7-b508-8a4d4f0af5bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0375fc0bec74a4e9ea421b6168a1ec7)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:56.419496 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59221be-fdb3-41c7-b508-8a4d4f0af5bb admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:56.436182 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 914/1821] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:56 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:27:56.516916 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b59221be-fdb3-41c7-b508-8a4d4f0af5bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0375fc0bec74a4e9ea421b6168a1ec7', 'request_id': 'req-b59221be-fdb3-41c7-b508-8a4d4f0af5bb'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:56.534592 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b59221be-fdb3-41c7-b508-8a4d4f0af5bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0375fc0bec74a4e9ea421b6168a1ec7', 'request_id': 'req-b59221be-fdb3-41c7-b508-8a4d4f0af5bb'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:56.558555 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b59221be-fdb3-41c7-b508-8a4d4f0af5bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0375fc0bec74a4e9ea421b6168a1ec7', 'request_id': 'req-b59221be-fdb3-41c7-b508-8a4d4f0af5bb'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:56.584864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c50827-c7bc-4555-b482-d386f36d948a service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:56.586424 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b59221be-fdb3-41c7-b508-8a4d4f0af5bb admin admin] The token cache is being invalidate because project e0375fc0bec74a4e9ea421b6168a1ec7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:27:56.586739 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b59221be-fdb3-41c7-b508-8a4d4f0af5bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:56.586861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-89c50827-c7bc-4555-b482-d386f36d948a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:56.587418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b59221be-fdb3-41c7-b508-8a4d4f0af5bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:56.591139 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 908/1822] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:27:56 2022] DELETE /identity/v3/projects/e0375fc0bec74a4e9ea421b6168a1ec7 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:56.595670 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca1c44-e038-46a7-a8e9-add0b31b45bd None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:56.595966 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca1c44-e038-46a7-a8e9-add0b31b45bd None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:56.596250 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca1c44-e038-46a7-a8e9-add0b31b45bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:56.621832 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c50827-c7bc-4555-b482-d386f36d948a service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:56.631381 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-54ca1c44-e038-46a7-a8e9-add0b31b45bd None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:56.632605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-54ca1c44-e038-46a7-a8e9-add0b31b45bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:56.773749 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 909/1823] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:56.776867 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096b7bd-1d4d-4227-b60a-0122af5e8774 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:56.777608 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096b7bd-1d4d-4227-b60a-0122af5e8774 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:56.779909 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096b7bd-1d4d-4227-b60a-0122af5e8774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:56.816452 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062c15b-3217-4da8-8e28-e46228d07197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:56.818054 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062c15b-3217-4da8-8e28-e46228d07197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:56.818353 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062c15b-3217-4da8-8e28-e46228d07197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:56.818640 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062c15b-3217-4da8-8e28-e46228d07197 admin admin] PATH_INFO: `/v3/projects/80aae41e6afc4719b491ac95564b901f` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:56.820024 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7062c15b-3217-4da8-8e28-e46228d07197 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80aae41e6afc4719b491ac95564b901f)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:56.820563 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-8096b7bd-1d4d-4227-b60a-0122af5e8774 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:56.822162 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7062c15b-3217-4da8-8e28-e46228d07197 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:56.824795 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-8096b7bd-1d4d-4227-b60a-0122af5e8774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:56.847546 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 910/1824] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:56.851794 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096b7bd-1d4d-4227-b60a-0122af5e8774 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:56.868662 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096b7bd-1d4d-4227-b60a-0122af5e8774 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:56.883444 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23f5fa-7cc1-460c-bda0-18b3c7d311eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:56.884422 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23f5fa-7cc1-460c-bda0-18b3c7d311eb admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:56.884593 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23f5fa-7cc1-460c-bda0-18b3c7d311eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:56.884951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23f5fa-7cc1-460c-bda0-18b3c7d311eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:56.885801 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23f5fa-7cc1-460c-bda0-18b3c7d311eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:27:56.886140 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23f5fa-7cc1-460c-bda0-18b3c7d311eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:56.890685 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23f5fa-7cc1-460c-bda0-18b3c7d311eb admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:56.920410 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 911/1825] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:27:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:27:56.924514 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23f5fa-7cc1-460c-bda0-18b3c7d311eb admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:56.938594 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7062c15b-3217-4da8-8e28-e46228d07197 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80aae41e6afc4719b491ac95564b901f', 'request_id': 'req-7062c15b-3217-4da8-8e28-e46228d07197'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:56.945744 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7062c15b-3217-4da8-8e28-e46228d07197 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80aae41e6afc4719b491ac95564b901f', 'request_id': 'req-7062c15b-3217-4da8-8e28-e46228d07197'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:56.946088 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23f5fa-7cc1-460c-bda0-18b3c7d311eb admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:56.961125 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7062c15b-3217-4da8-8e28-e46228d07197 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80aae41e6afc4719b491ac95564b901f', 'request_id': 'req-7062c15b-3217-4da8-8e28-e46228d07197'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:56.977913 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7062c15b-3217-4da8-8e28-e46228d07197 admin admin] The token cache is being invalidate because project 80aae41e6afc4719b491ac95564b901f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:27:56.978186 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7062c15b-3217-4da8-8e28-e46228d07197 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:56.979217 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7062c15b-3217-4da8-8e28-e46228d07197 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:56.981284 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 915/1826] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:27:56 2022] DELETE /identity/v3/projects/80aae41e6afc4719b491ac95564b901f => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:27:56.989169 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14feef6-4f3f-4828-aec5-ca0d76982962 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:56.989555 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14feef6-4f3f-4828-aec5-ca0d76982962 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:56.990189 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14feef6-4f3f-4828-aec5-ca0d76982962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:57.047108 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a14feef6-4f3f-4828-aec5-ca0d76982962 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:57.048869 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a14feef6-4f3f-4828-aec5-ca0d76982962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:57.075667 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:57.078787 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4b60b-194e-498c-a61b-f2e6df740507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:57.079466 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4b60b-194e-498c-a61b-f2e6df740507 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:57.079832 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4b60b-194e-498c-a61b-f2e6df740507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:57.080259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4b60b-194e-498c-a61b-f2e6df740507 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:57.081709 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4b60b-194e-498c-a61b-f2e6df740507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:57.085548 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4b60b-194e-498c-a61b-f2e6df740507 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:57.142806 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 912/1827] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:27:56 2022] POST /identity/v3/projects => generated 367 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:27:57.143737 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4b60b-194e-498c-a61b-f2e6df740507 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:57.148318 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-9fe4b60b-194e-498c-a61b-f2e6df740507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:57.163020 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:57.205685 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 916/1828] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:57.208327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14feef6-4f3f-4828-aec5-ca0d76982962 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:57.211592 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a14feef6-4f3f-4828-aec5-ca0d76982962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:57.238214 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14feef6-4f3f-4828-aec5-ca0d76982962 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:57.297913 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4b60b-194e-498c-a61b-f2e6df740507 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:57.315134 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcfd565-2705-4cdd-81bc-2d7c483352f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:57.316056 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfd565-2705-4cdd-81bc-2d7c483352f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:57.316454 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfd565-2705-4cdd-81bc-2d7c483352f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:57.316828 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfd565-2705-4cdd-81bc-2d7c483352f1 admin admin] PATH_INFO: `/v3/projects/163da5b66926496e92d08817f712e0eb` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:57.318727 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcfd565-2705-4cdd-81bc-2d7c483352f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=163da5b66926496e92d08817f712e0eb)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:57.320833 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcfd565-2705-4cdd-81bc-2d7c483352f1 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:57.363593 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989557d6-d7d9-4cd4-897c-2028e7c634b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:57.364293 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989557d6-d7d9-4cd4-897c-2028e7c634b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:57.364586 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989557d6-d7d9-4cd4-897c-2028e7c634b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:57.364869 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989557d6-d7d9-4cd4-897c-2028e7c634b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:57.365570 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989557d6-d7d9-4cd4-897c-2028e7c634b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:57.367743 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989557d6-d7d9-4cd4-897c-2028e7c634b2 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:57.398267 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 917/1829] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:27:57 2022] POST /identity/v3/users => generated 284 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:57.400274 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8c4b5-240a-4b96-a786-e0fc01fa5322 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:57.400828 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8c4b5-240a-4b96-a786-e0fc01fa5322 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:57.401433 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8c4b5-240a-4b96-a786-e0fc01fa5322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:57.417795 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-5fcfd565-2705-4cdd-81bc-2d7c483352f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '163da5b66926496e92d08817f712e0eb', 'request_id': 'req-5fcfd565-2705-4cdd-81bc-2d7c483352f1'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:57.428043 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-9db8c4b5-240a-4b96-a786-e0fc01fa5322 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:57.429168 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-5fcfd565-2705-4cdd-81bc-2d7c483352f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '163da5b66926496e92d08817f712e0eb', 'request_id': 'req-5fcfd565-2705-4cdd-81bc-2d7c483352f1'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:57.429604 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9db8c4b5-240a-4b96-a786-e0fc01fa5322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:57.442798 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-5fcfd565-2705-4cdd-81bc-2d7c483352f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '163da5b66926496e92d08817f712e0eb', 'request_id': 'req-5fcfd565-2705-4cdd-81bc-2d7c483352f1'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:57.457214 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-5fcfd565-2705-4cdd-81bc-2d7c483352f1 admin admin] The token cache is being invalidate because project 163da5b66926496e92d08817f712e0eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:27:57.457760 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-5fcfd565-2705-4cdd-81bc-2d7c483352f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:57.458947 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-5fcfd565-2705-4cdd-81bc-2d7c483352f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:27:57.462058 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 913/1830] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:27:57 2022] DELETE /identity/v3/projects/163da5b66926496e92d08817f712e0eb => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:57.463061 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcfd565-2705-4cdd-81bc-2d7c483352f1 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:57.472989 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-5fcfd565-2705-4cdd-81bc-2d7c483352f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:57.513402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 918/1831] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:57.516318 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef43a50-dcdc-4e60-903d-67173a73383c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:57.522489 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef43a50-dcdc-4e60-903d-67173a73383c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:57.522787 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef43a50-dcdc-4e60-903d-67173a73383c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:57.545966 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-8ef43a50-dcdc-4e60-903d-67173a73383c None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:57.547522 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8ef43a50-dcdc-4e60-903d-67173a73383c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:57.582241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 919/1832] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:57.582241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafeb71-dfbc-40ef-84ca-d532029e5dab None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:57.582241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafeb71-dfbc-40ef-84ca-d532029e5dab None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:57.582241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafeb71-dfbc-40ef-84ca-d532029e5dab None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:57.582241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 920/1833] 10.222.0.32 () {54 vars in 921 bytes} [Wed Jun 1 04:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:27:57.582241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafeb71-dfbc-40ef-84ca-d532029e5dab None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:57.613724 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafeb71-dfbc-40ef-84ca-d532029e5dab None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:57.624851 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e9bed-6681-42d2-bd6c-a22a56c1a681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:57.625772 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e9bed-6681-42d2-bd6c-a22a56c1a681 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:57.626090 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e9bed-6681-42d2-bd6c-a22a56c1a681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:57.626377 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e9bed-6681-42d2-bd6c-a22a56c1a681 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:57.627395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e9bed-6681-42d2-bd6c-a22a56c1a681 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:27:57.627612 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e9bed-6681-42d2-bd6c-a22a56c1a681 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:57.632358 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e9bed-6681-42d2-bd6c-a22a56c1a681 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:57.648558 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcfd565-2705-4cdd-81bc-2d7c483352f1 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:57.664524 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 921/1834] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:27:57.666210 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146e8ae-0c4f-4bc4-ad7a-a196c1712c7c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:57.666510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146e8ae-0c4f-4bc4-ad7a-a196c1712c7c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:57.666800 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146e8ae-0c4f-4bc4-ad7a-a196c1712c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:57.671632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c8777-63ae-4d1c-9e87-fb3446a6c260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:57.672327 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c8777-63ae-4d1c-9e87-fb3446a6c260 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:57.672614 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c8777-63ae-4d1c-9e87-fb3446a6c260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:57.672892 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c8777-63ae-4d1c-9e87-fb3446a6c260 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:57.673629 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c8777-63ae-4d1c-9e87-fb3446a6c260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:57.675423 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c8777-63ae-4d1c-9e87-fb3446a6c260 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:57.703873 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 914/1835] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:57.705324 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6135544-3a09-4fb0-8679-7cf3e12d13e2 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:57.705621 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6135544-3a09-4fb0-8679-7cf3e12d13e2 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:57.705905 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6135544-3a09-4fb0-8679-7cf3e12d13e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:57.711587 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a146e8ae-0c4f-4bc4-ad7a-a196c1712c7c None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:57.713064 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a146e8ae-0c4f-4bc4-ad7a-a196c1712c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:57.730891 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 922/1836] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:57.733500 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146e8ae-0c4f-4bc4-ad7a-a196c1712c7c None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:57.755455 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-b6135544-3a09-4fb0-8679-7cf3e12d13e2 None None] MFA Rules not processed for user `79d614f85f5541d3babbb41468cbf55c`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:57.760861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146e8ae-0c4f-4bc4-ad7a-a196c1712c7c None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:57.761198 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-b6135544-3a09-4fb0-8679-7cf3e12d13e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:57.768896 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:57.772107 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc866bc-b7bd-4da0-ac14-8e9c9bc2b424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:57.772799 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc866bc-b7bd-4da0-ac14-8e9c9bc2b424 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:57.773086 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc866bc-b7bd-4da0-ac14-8e9c9bc2b424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:57.773360 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc866bc-b7bd-4da0-ac14-8e9c9bc2b424 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:57.774239 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc866bc-b7bd-4da0-ac14-8e9c9bc2b424 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:57.776477 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc866bc-b7bd-4da0-ac14-8e9c9bc2b424 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:57.824810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 923/1837] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:27:57 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:57.825681 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc866bc-b7bd-4da0-ac14-8e9c9bc2b424 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:57.919211 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 915/1838] 10.222.0.32 () {58 vars in 1018 bytes} [Wed Jun 1 04:27:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:57.921763 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6135544-3a09-4fb0-8679-7cf3e12d13e2 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:57.935440 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:57.939629 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6135544-3a09-4fb0-8679-7cf3e12d13e2 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:57.969373 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc866bc-b7bd-4da0-ac14-8e9c9bc2b424 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:57.976268 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d3bad-df5e-4b1d-aad6-6fb4a7af4405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:57.977102 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d3bad-df5e-4b1d-aad6-6fb4a7af4405 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:57.977305 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d3bad-df5e-4b1d-aad6-6fb4a7af4405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:57.977636 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d3bad-df5e-4b1d-aad6-6fb4a7af4405 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:57.978619 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d3bad-df5e-4b1d-aad6-6fb4a7af4405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:57.982336 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d3bad-df5e-4b1d-aad6-6fb4a7af4405 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:57.997649 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 924/1839] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:57.998634 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d3bad-df5e-4b1d-aad6-6fb4a7af4405 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:58.012564 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d3bad-df5e-4b1d-aad6-6fb4a7af4405 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:58.018844 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e14a01-9bbe-48f7-9a59-d6db2b4d7694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:58.019552 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e14a01-9bbe-48f7-9a59-d6db2b4d7694 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:58.019859 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e14a01-9bbe-48f7-9a59-d6db2b4d7694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:58.020404 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e14a01-9bbe-48f7-9a59-d6db2b4d7694 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:58.021419 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e14a01-9bbe-48f7-9a59-d6db2b4d7694 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:58.023694 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e14a01-9bbe-48f7-9a59-d6db2b4d7694 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:58.039386 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373340b-6e50-441a-be5d-0f81bb4ac17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:58.041001 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373340b-6e50-441a-be5d-0f81bb4ac17c admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:58.041369 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373340b-6e50-441a-be5d-0f81bb4ac17c admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:58.041656 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373340b-6e50-441a-be5d-0f81bb4ac17c admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:58.043722 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373340b-6e50-441a-be5d-0f81bb4ac17c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:27:58.044007 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373340b-6e50-441a-be5d-0f81bb4ac17c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:58.045836 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373340b-6e50-441a-be5d-0f81bb4ac17c admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:58.060775 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 925/1840] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:27:57 2022] POST /identity/v3/users => generated 291 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:58.063239 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331a9f2-2ba0-4272-9048-bca52c094fe2 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:58.063835 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331a9f2-2ba0-4272-9048-bca52c094fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:58.064185 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331a9f2-2ba0-4272-9048-bca52c094fe2 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:58.066370 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 926/1841] 10.222.0.32 () {54 vars in 921 bytes} [Wed Jun 1 04:27:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:27:58.067141 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331a9f2-2ba0-4272-9048-bca52c094fe2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:58.071705 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 916/1842] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:27:58.071705 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373340b-6e50-441a-be5d-0f81bb4ac17c admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:58.094599 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331a9f2-2ba0-4272-9048-bca52c094fe2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:58.096131 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373340b-6e50-441a-be5d-0f81bb4ac17c admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:58.100787 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de1c1c-ce38-45cb-bc94-fa94c59c9127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:58.102280 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de1c1c-ce38-45cb-bc94-fa94c59c9127 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:58.102570 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de1c1c-ce38-45cb-bc94-fa94c59c9127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:58.102851 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de1c1c-ce38-45cb-bc94-fa94c59c9127 admin admin] PATH_INFO: `/v3/projects/084520030c5d4d58a7f5d48c456df0ab/users/befb5805fb0845198b49ba60f7c2b68f/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:58.107034 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4468b-46a3-40b4-8cd7-490397bf9f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:58.108470 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4468b-46a3-40b4-8cd7-490397bf9f85 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:58.109378 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4468b-46a3-40b4-8cd7-490397bf9f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:58.109673 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4468b-46a3-40b4-8cd7-490397bf9f85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:58.110620 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4468b-46a3-40b4-8cd7-490397bf9f85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:58.115889 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4468b-46a3-40b4-8cd7-490397bf9f85 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:58.146733 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67de1c1c-ce38-45cb-bc94-fa94c59c9127 admin admin] RBAC: Authorizing `identity:create_grant(project_id=084520030c5d4d58a7f5d48c456df0ab, user_id=befb5805fb0845198b49ba60f7c2b68f, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:58.150170 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67de1c1c-ce38-45cb-bc94-fa94c59c9127 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:58.155652 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 917/1843] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:58.159196 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4468b-46a3-40b4-8cd7-490397bf9f85 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:58.174648 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 927/1844] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:27:58 2022] PUT /identity/v3/projects/084520030c5d4d58a7f5d48c456df0ab/users/befb5805fb0845198b49ba60f7c2b68f/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:58.175478 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4468b-46a3-40b4-8cd7-490397bf9f85 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:58.177023 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bedb5b-bc4f-4568-8ea8-56fdc2c7f5c7 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:58.177282 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bedb5b-bc4f-4568-8ea8-56fdc2c7f5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:58.177686 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bedb5b-bc4f-4568-8ea8-56fdc2c7f5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:58.203473 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-81bedb5b-bc4f-4568-8ea8-56fdc2c7f5c7 None None] MFA Rules not processed for user `0433f6219478476286ea27c5c82d41a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:58.204996 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-81bedb5b-bc4f-4568-8ea8-56fdc2c7f5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:58.262130 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86e133-9a0d-40ff-8869-6d9c357006e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:58.263230 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86e133-9a0d-40ff-8869-6d9c357006e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:58.263724 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86e133-9a0d-40ff-8869-6d9c357006e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:58.264399 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86e133-9a0d-40ff-8869-6d9c357006e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:58.265563 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86e133-9a0d-40ff-8869-6d9c357006e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:58.271528 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86e133-9a0d-40ff-8869-6d9c357006e8 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:58.371364 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 928/1845] 10.222.0.32 () {58 vars in 1018 bytes} [Wed Jun 1 04:27:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:58.372287 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bedb5b-bc4f-4568-8ea8-56fdc2c7f5c7 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:58.373190 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 918/1846] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:27:58 2022] POST /identity/v3/projects => generated 365 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:58.375171 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1beaedd-3cd8-428f-998f-3e003bcc3e74 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:58.375714 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1beaedd-3cd8-428f-998f-3e003bcc3e74 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:58.376260 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1beaedd-3cd8-428f-998f-3e003bcc3e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:58.402472 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bedb5b-bc4f-4568-8ea8-56fdc2c7f5c7 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:58.417491 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:58.434751 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-a1beaedd-3cd8-428f-998f-3e003bcc3e74 None None] MFA Rules not processed for user `befb5805fb0845198b49ba60f7c2b68f`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:58.437569 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a1beaedd-3cd8-428f-998f-3e003bcc3e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:58.560446 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 919/1847] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:58 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:58.560446 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1beaedd-3cd8-428f-998f-3e003bcc3e74 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:58.560446 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a1beaedd-3cd8-428f-998f-3e003bcc3e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:58.582452 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d347ce0-32a2-45e8-aed1-ba6f69ec969e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:58.583270 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d347ce0-32a2-45e8-aed1-ba6f69ec969e admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:58.583563 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d347ce0-32a2-45e8-aed1-ba6f69ec969e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:58.585188 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d347ce0-32a2-45e8-aed1-ba6f69ec969e admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:58.585996 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d347ce0-32a2-45e8-aed1-ba6f69ec969e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:58.587931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d347ce0-32a2-45e8-aed1-ba6f69ec969e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:58.621915 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 929/1848] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:58.623534 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d347ce0-32a2-45e8-aed1-ba6f69ec969e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:58.641674 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d347ce0-32a2-45e8-aed1-ba6f69ec969e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:58.654895 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec71481-5318-48e9-8320-062c448be6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:58.657113 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec71481-5318-48e9-8320-062c448be6c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:58.657411 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec71481-5318-48e9-8320-062c448be6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:58.658990 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec71481-5318-48e9-8320-062c448be6c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:58.659764 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec71481-5318-48e9-8320-062c448be6c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:58.663412 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec71481-5318-48e9-8320-062c448be6c2 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:58.730501 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 930/1849] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:27:58 2022] POST /identity/v3/users => generated 283 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:58.732815 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec71481-5318-48e9-8320-062c448be6c2 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:58.739430 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1beaedd-3cd8-428f-998f-3e003bcc3e74 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:58.742048 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6ec71481-5318-48e9-8320-062c448be6c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:58.768683 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:58.774561 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5d583-6459-4607-b3d4-370536c31a0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:58.775291 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5d583-6459-4607-b3d4-370536c31a0b service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:58.775597 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5d583-6459-4607-b3d4-370536c31a0b service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:58.775857 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5d583-6459-4607-b3d4-370536c31a0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:58.794952 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa5d583-6459-4607-b3d4-370536c31a0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:58.796860 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa5d583-6459-4607-b3d4-370536c31a0b service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:58.816220 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 920/1850] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:27:58.817344 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5d583-6459-4607-b3d4-370536c31a0b service nova] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:58.835678 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5d583-6459-4607-b3d4-370536c31a0b service nova] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:58.847770 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61211262-9629-4697-9f44-4344eb478a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:58.850997 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61211262-9629-4697-9f44-4344eb478a0a admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:58.852511 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61211262-9629-4697-9f44-4344eb478a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:58.853010 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61211262-9629-4697-9f44-4344eb478a0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:58.854078 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61211262-9629-4697-9f44-4344eb478a0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:58.857209 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61211262-9629-4697-9f44-4344eb478a0a admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:58.922734 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 921/1851] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:27:58 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:58.924711 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61211262-9629-4697-9f44-4344eb478a0a admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:58.960898 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec71481-5318-48e9-8320-062c448be6c2 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:59.049020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61211262-9629-4697-9f44-4344eb478a0a admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:59.056124 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca9558-ec38-456a-8127-9836959e95bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:59.066594 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca9558-ec38-456a-8127-9836959e95bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:59.067188 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca9558-ec38-456a-8127-9836959e95bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:59.067713 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca9558-ec38-456a-8127-9836959e95bd admin admin] PATH_INFO: `/v3/projects/36e58ea7f3564794b37743e58abf21ae/users/28f5167ef7a546999490a07f8292805b/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:59.073520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:59.093032 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca9558-ec38-456a-8127-9836959e95bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=36e58ea7f3564794b37743e58abf21ae, user_id=28f5167ef7a546999490a07f8292805b, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:59.096623 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca9558-ec38-456a-8127-9836959e95bd admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:59.110918 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5d5c7-b88b-481c-b072-67ac3980d843 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0433f6219478476286ea27c5c82d41a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:59.111926 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5d5c7-b88b-481c-b072-67ac3980d843 service placement] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:59.112193 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5d5c7-b88b-481c-b072-67ac3980d843 service placement] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:59.113520 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5d5c7-b88b-481c-b072-67ac3980d843 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:59.121738 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 922/1852] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:27:58 2022] PUT /identity/v3/projects/36e58ea7f3564794b37743e58abf21ae/users/28f5167ef7a546999490a07f8292805b/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:59.122653 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca9558-ec38-456a-8127-9836959e95bd admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:59.132296 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5d5c7-b88b-481c-b072-67ac3980d843 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:59.134502 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5d5c7-b88b-481c-b072-67ac3980d843 service placement] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:59.185566 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 931/1853] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:27:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:27:59.187141 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60702465-0f35-4e0b-8d32-08bce3072783 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:59.187535 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60702465-0f35-4e0b-8d32-08bce3072783 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:59.187913 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60702465-0f35-4e0b-8d32-08bce3072783 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:59.190811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 932/1854] 10.222.0.32 () {54 vars in 921 bytes} [Wed Jun 1 04:27:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:27:59.191634 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60702465-0f35-4e0b-8d32-08bce3072783 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:59.241575 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca9558-ec38-456a-8127-9836959e95bd admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:59.252255 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08d46b-72ae-4ecc-9661-e0abd8b2760e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:59.253793 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08d46b-72ae-4ecc-9661-e0abd8b2760e admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:59.255201 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08d46b-72ae-4ecc-9661-e0abd8b2760e admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:59.256377 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08d46b-72ae-4ecc-9661-e0abd8b2760e admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:59.258477 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d08d46b-72ae-4ecc-9661-e0abd8b2760e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:59.262047 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d08d46b-72ae-4ecc-9661-e0abd8b2760e admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:59.277568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 923/1855] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:59.280411 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c73ef-b115-41be-8e5f-9d0b55cb86bb None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:59.281424 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c73ef-b115-41be-8e5f-9d0b55cb86bb None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:59.281920 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c73ef-b115-41be-8e5f-9d0b55cb86bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:59.284390 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60702465-0f35-4e0b-8d32-08bce3072783 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:59.291136 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8540a602-b39f-46cd-9fe7-4dc4d8df281e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:59.291842 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540a602-b39f-46cd-9fe7-4dc4d8df281e admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:59.292123 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540a602-b39f-46cd-9fe7-4dc4d8df281e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:59.292466 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540a602-b39f-46cd-9fe7-4dc4d8df281e admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:59.293179 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8540a602-b39f-46cd-9fe7-4dc4d8df281e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:59.296126 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8540a602-b39f-46cd-9fe7-4dc4d8df281e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:59.339055 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-1e3c73ef-b115-41be-8e5f-9d0b55cb86bb None None] MFA Rules not processed for user `28f5167ef7a546999490a07f8292805b`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:59.345306 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-1e3c73ef-b115-41be-8e5f-9d0b55cb86bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:59.346029 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 933/1856] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:27:59 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:59.348254 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d31d98-1253-4364-a1f5-09f36afb76de None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:59.348685 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d31d98-1253-4364-a1f5-09f36afb76de None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:59.349102 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d31d98-1253-4364-a1f5-09f36afb76de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:59.376630 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-26d31d98-1253-4364-a1f5-09f36afb76de None None] MFA Rules not processed for user `79d614f85f5541d3babbb41468cbf55c`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:27:59.380196 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-26d31d98-1253-4364-a1f5-09f36afb76de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:27:59.411669 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:59.495431 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 934/1857] 10.222.0.32 () {58 vars in 1018 bytes} [Wed Jun 1 04:27:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:59.498684 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d31d98-1253-4364-a1f5-09f36afb76de None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:59.511863 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 924/1858] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:27:59.511863 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c73ef-b115-41be-8e5f-9d0b55cb86bb None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:59.512382 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d31d98-1253-4364-a1f5-09f36afb76de None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:59.518905 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f74569-bd65-402f-8dfd-e877ac59e522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:59.519623 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f74569-bd65-402f-8dfd-e877ac59e522 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:59.523396 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f74569-bd65-402f-8dfd-e877ac59e522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:59.523703 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f74569-bd65-402f-8dfd-e877ac59e522 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:59.524788 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f74569-bd65-402f-8dfd-e877ac59e522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:59.526406 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f74569-bd65-402f-8dfd-e877ac59e522 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:59.531604 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c73ef-b115-41be-8e5f-9d0b55cb86bb None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:59.546758 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 935/1859] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:59.547215 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f74569-bd65-402f-8dfd-e877ac59e522 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:59.556059 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da6be6-f29b-4681-8c7d-3758bae4fdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:59.556927 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da6be6-f29b-4681-8c7d-3758bae4fdca admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:59.557218 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da6be6-f29b-4681-8c7d-3758bae4fdca admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:59.557496 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da6be6-f29b-4681-8c7d-3758bae4fdca admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:59.558934 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da6be6-f29b-4681-8c7d-3758bae4fdca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:59.560949 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da6be6-f29b-4681-8c7d-3758bae4fdca admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:59.562302 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f74569-bd65-402f-8dfd-e877ac59e522 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:59.569517 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4161edc-4cfc-48b7-9ce8-9938ca2db806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:59.570567 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4161edc-4cfc-48b7-9ce8-9938ca2db806 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:59.571081 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4161edc-4cfc-48b7-9ce8-9938ca2db806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:59.571886 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4161edc-4cfc-48b7-9ce8-9938ca2db806 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:59.573090 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4161edc-4cfc-48b7-9ce8-9938ca2db806 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:59.575767 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4161edc-4cfc-48b7-9ce8-9938ca2db806 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:59.584510 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 925/1860] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:27:59.586842 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da6be6-f29b-4681-8c7d-3758bae4fdca admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:59.603208 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da6be6-f29b-4681-8c7d-3758bae4fdca admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:59.610723 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d335f8-add1-446d-8eb5-10e8d278312d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:59.619089 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d335f8-add1-446d-8eb5-10e8d278312d admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:59.619089 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d335f8-add1-446d-8eb5-10e8d278312d admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:59.619089 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d335f8-add1-446d-8eb5-10e8d278312d admin admin] PATH_INFO: `/v3/projects/bdd695ca007e4f0dbf2061a7451b6a07/users/946f78685e5b49938165065b16c139c3/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:59.637909 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 936/1861] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:27:59 2022] POST /identity/v3/projects => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:59.639419 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4161edc-4cfc-48b7-9ce8-9938ca2db806 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:59.666049 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d335f8-add1-446d-8eb5-10e8d278312d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdd695ca007e4f0dbf2061a7451b6a07, user_id=946f78685e5b49938165065b16c139c3, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:59.671599 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d335f8-add1-446d-8eb5-10e8d278312d admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:59.716765 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 926/1862] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:27:59 2022] PUT /identity/v3/projects/bdd695ca007e4f0dbf2061a7451b6a07/users/946f78685e5b49938165065b16c139c3/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:59.722900 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d335f8-add1-446d-8eb5-10e8d278312d admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:59.806271 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:27:59.809468 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4161edc-4cfc-48b7-9ce8-9938ca2db806 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:59.863926 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d335f8-add1-446d-8eb5-10e8d278312d admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:27:59.876731 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca161e5-a46b-4a94-9bdb-c46b0344f787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:59.877421 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca161e5-a46b-4a94-9bdb-c46b0344f787 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:59.877704 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca161e5-a46b-4a94-9bdb-c46b0344f787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:59.877991 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca161e5-a46b-4a94-9bdb-c46b0344f787 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:59.883080 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca161e5-a46b-4a94-9bdb-c46b0344f787 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:59.886748 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca161e5-a46b-4a94-9bdb-c46b0344f787 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:59.919555 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 927/1863] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:27:59 2022] POST /identity/v3/users => generated 298 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:27:59.922538 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ed86d-66fd-4e8f-b0a8-39fa576c585b None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:59.923671 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ed86d-66fd-4e8f-b0a8-39fa576c585b None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:59.923671 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ed86d-66fd-4e8f-b0a8-39fa576c585b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:59.929352 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f3200-5e31-4b65-86ee-b4095e2d8712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:27:59.930320 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f3200-5e31-4b65-86ee-b4095e2d8712 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:27:59.930839 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f3200-5e31-4b65-86ee-b4095e2d8712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:27:59.931127 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f3200-5e31-4b65-86ee-b4095e2d8712 admin admin] PATH_INFO: `/v3/projects/812e656a8ace44c6a92580cddbe043a2/users/953d031dc8bb4fa28a83092ba80aa287/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:27:59.954957 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f3200-5e31-4b65-86ee-b4095e2d8712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=812e656a8ace44c6a92580cddbe043a2, user_id=953d031dc8bb4fa28a83092ba80aa287, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:27:59.958595 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f3200-5e31-4b65-86ee-b4095e2d8712 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:27:59.982016 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 937/1864] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:27:59 2022] PUT /identity/v3/projects/812e656a8ace44c6a92580cddbe043a2/users/953d031dc8bb4fa28a83092ba80aa287/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:27:59.982016 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f3200-5e31-4b65-86ee-b4095e2d8712 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:27:59.999697 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-d03ed86d-66fd-4e8f-b0a8-39fa576c585b None None] MFA Rules not processed for user `946f78685e5b49938165065b16c139c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:00.000959 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d03ed86d-66fd-4e8f-b0a8-39fa576c585b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:00.019168 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:00.133347 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f3200-5e31-4b65-86ee-b4095e2d8712 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:00.145698 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07140d9b-691e-4afa-b394-256d3ef293b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:00.147620 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07140d9b-691e-4afa-b394-256d3ef293b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:00.148011 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07140d9b-691e-4afa-b394-256d3ef293b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:00.148789 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07140d9b-691e-4afa-b394-256d3ef293b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:00.150829 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07140d9b-691e-4afa-b394-256d3ef293b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:00.154087 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07140d9b-691e-4afa-b394-256d3ef293b5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:00.173573 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 938/1865] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:00.174529 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07140d9b-691e-4afa-b394-256d3ef293b5 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:00.191482 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 928/1866] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:27:59 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:00.192926 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ed86d-66fd-4e8f-b0a8-39fa576c585b None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:00.209678 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07140d9b-691e-4afa-b394-256d3ef293b5 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:00.220525 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701930fa-3101-4e63-a329-8547167e5c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:00.221294 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701930fa-3101-4e63-a329-8547167e5c60 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:00.221579 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701930fa-3101-4e63-a329-8547167e5c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:00.221895 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701930fa-3101-4e63-a329-8547167e5c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:00.222689 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701930fa-3101-4e63-a329-8547167e5c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:00.226553 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701930fa-3101-4e63-a329-8547167e5c60 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:00.243669 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 939/1867] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:00.248455 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701930fa-3101-4e63-a329-8547167e5c60 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:00.275464 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701930fa-3101-4e63-a329-8547167e5c60 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:00.282527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c2a67-825e-43c6-a39e-0318154513c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:00.283517 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c2a67-825e-43c6-a39e-0318154513c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:00.284033 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c2a67-825e-43c6-a39e-0318154513c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:00.284531 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c2a67-825e-43c6-a39e-0318154513c6 admin admin] PATH_INFO: `/v3/projects/fe381dbf504941fa85c9f64df81c55bc/users/2c52751183e448159ddf394a5d2edac4/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:00.310620 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c2a67-825e-43c6-a39e-0318154513c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe381dbf504941fa85c9f64df81c55bc, user_id=2c52751183e448159ddf394a5d2edac4, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:00.316519 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c2a67-825e-43c6-a39e-0318154513c6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:00.363143 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 940/1868] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:00 2022] PUT /identity/v3/projects/fe381dbf504941fa85c9f64df81c55bc/users/2c52751183e448159ddf394a5d2edac4/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:00.364180 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c2a67-825e-43c6-a39e-0318154513c6 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:00.365675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ed86d-66fd-4e8f-b0a8-39fa576c585b None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:00.453385 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:00.471885 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c2a67-825e-43c6-a39e-0318154513c6 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:00.480681 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e5f02-55e6-483f-bdc8-e10c96adbbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:00.482070 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e5f02-55e6-483f-bdc8-e10c96adbbc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:00.482488 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e5f02-55e6-483f-bdc8-e10c96adbbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:00.482879 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e5f02-55e6-483f-bdc8-e10c96adbbc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:00.483815 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e5f02-55e6-483f-bdc8-e10c96adbbc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:00.486095 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06b850-e46f-410f-be13-f358ef0ebc0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:00.486257 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e5f02-55e6-483f-bdc8-e10c96adbbc4 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:00.487760 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06b850-e46f-410f-be13-f358ef0ebc0d service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:00.488289 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06b850-e46f-410f-be13-f358ef0ebc0d service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:00.488807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06b850-e46f-410f-be13-f358ef0ebc0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:00.501903 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06b850-e46f-410f-be13-f358ef0ebc0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:00.504644 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06b850-e46f-410f-be13-f358ef0ebc0d service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:00.519787 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 929/1869] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:00.524393 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 941/1870] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:28:00 2022] POST /identity/v3/projects => generated 365 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:00.525284 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e5f02-55e6-483f-bdc8-e10c96adbbc4 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:00.534953 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24e48c-1932-46d3-84cb-4bb170f15737 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:00.535297 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24e48c-1932-46d3-84cb-4bb170f15737 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:00.535584 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24e48c-1932-46d3-84cb-4bb170f15737 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:00.540235 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 930/1871] 10.222.0.32 () {54 vars in 921 bytes} [Wed Jun 1 04:28:00 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:28:00.541073 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24e48c-1932-46d3-84cb-4bb170f15737 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:00.626778 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e5f02-55e6-483f-bdc8-e10c96adbbc4 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:00.633912 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ad69c-2d62-4bdb-9640-3a327fa2290a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:00.634889 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ad69c-2d62-4bdb-9640-3a327fa2290a admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:00.635180 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ad69c-2d62-4bdb-9640-3a327fa2290a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:00.635466 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ad69c-2d62-4bdb-9640-3a327fa2290a admin admin] PATH_INFO: `/v3/projects/812e656a8ace44c6a92580cddbe043a2/users/953d031dc8bb4fa28a83092ba80aa287/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:00.638240 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ad69c-2d62-4bdb-9640-3a327fa2290a admin admin] RBAC: Authorizing `identity:create_grant(project_id=812e656a8ace44c6a92580cddbe043a2, user_id=953d031dc8bb4fa28a83092ba80aa287, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:00.641061 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ad69c-2d62-4bdb-9640-3a327fa2290a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:00.643958 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:00.670525 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 942/1872] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:00 2022] PUT /identity/v3/projects/812e656a8ace44c6a92580cddbe043a2/users/953d031dc8bb4fa28a83092ba80aa287/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:00.672597 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ad69c-2d62-4bdb-9640-3a327fa2290a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:00.681512 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d09ad69c-2d62-4bdb-9640-3a327fa2290a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:00.697773 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24e48c-1932-46d3-84cb-4bb170f15737 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:00.783934 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee8fe3-af3d-4f0a-8e11-fffd9cbb08b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:00.784343 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ad69c-2d62-4bdb-9640-3a327fa2290a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:00.784788 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee8fe3-af3d-4f0a-8e11-fffd9cbb08b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:00.785214 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee8fe3-af3d-4f0a-8e11-fffd9cbb08b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:00.785601 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee8fe3-af3d-4f0a-8e11-fffd9cbb08b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:00.786368 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee8fe3-af3d-4f0a-8e11-fffd9cbb08b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:00.788263 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee8fe3-af3d-4f0a-8e11-fffd9cbb08b8 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:00.789782 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaedf119-b780-4bdb-a452-4f64b67ecfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:00.790776 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedf119-b780-4bdb-a452-4f64b67ecfb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:00.791276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedf119-b780-4bdb-a452-4f64b67ecfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:00.791631 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedf119-b780-4bdb-a452-4f64b67ecfb7 admin admin] PATH_INFO: `/v3/users/675307898fe04214b1c5d568625e9ec3` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:00.792970 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaedf119-b780-4bdb-a452-4f64b67ecfb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=675307898fe04214b1c5d568625e9ec3)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:00.795041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaedf119-b780-4bdb-a452-4f64b67ecfb7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:00.806069 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 931/1873] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:00.806069 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee8fe3-af3d-4f0a-8e11-fffd9cbb08b8 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:00.818930 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee8fe3-af3d-4f0a-8e11-fffd9cbb08b8 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:00.843102 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc58d63-7f31-4c80-87ce-d478b22759ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:00.843825 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc58d63-7f31-4c80-87ce-d478b22759ed admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:00.845313 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc58d63-7f31-4c80-87ce-d478b22759ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:00.845634 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc58d63-7f31-4c80-87ce-d478b22759ed admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:00.846929 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc58d63-7f31-4c80-87ce-d478b22759ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:00.851279 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc58d63-7f31-4c80-87ce-d478b22759ed admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:00.867374 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-eaedf119-b780-4bdb-a452-4f64b67ecfb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '675307898fe04214b1c5d568625e9ec3'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:00.868589 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-eaedf119-b780-4bdb-a452-4f64b67ecfb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '675307898fe04214b1c5d568625e9ec3'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:00.875477 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 932/1874] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:28:00 2022] POST /identity/v3/users => generated 289 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:00.876974 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49f84c-efd5-452b-ade7-b4fe6ececac9 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:00.877155 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49f84c-efd5-452b-ade7-b4fe6ececac9 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:00.877441 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49f84c-efd5-452b-ade7-b4fe6ececac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:00.893146 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-eaedf119-b780-4bdb-a452-4f64b67ecfb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '675307898fe04214b1c5d568625e9ec3'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:00.899000 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-7e49f84c-efd5-452b-ade7-b4fe6ececac9 None None] MFA Rules not processed for user `0433f6219478476286ea27c5c82d41a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:00.900260 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7e49f84c-efd5-452b-ade7-b4fe6ececac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:00.903637 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-eaedf119-b780-4bdb-a452-4f64b67ecfb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '675307898fe04214b1c5d568625e9ec3'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:00.904902 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-eaedf119-b780-4bdb-a452-4f64b67ecfb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '675307898fe04214b1c5d568625e9ec3'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:00.923823 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 943/1875] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:00 2022] DELETE /identity/v3/users/675307898fe04214b1c5d568625e9ec3 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:00.925920 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0745b2-4c23-4541-9b07-080704a12784 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:00.926066 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0745b2-4c23-4541-9b07-080704a12784 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:00.926256 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0745b2-4c23-4541-9b07-080704a12784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:00.959726 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-df0745b2-4c23-4541-9b07-080704a12784 None None] MFA Rules not processed for user `953d031dc8bb4fa28a83092ba80aa287`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:00.960991 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-df0745b2-4c23-4541-9b07-080704a12784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:00.973556 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:00.988866 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 933/1876] 10.222.0.32 () {58 vars in 1018 bytes} [Wed Jun 1 04:28:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:01.005370 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49f84c-efd5-452b-ade7-b4fe6ececac9 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:01.010331 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7e49f84c-efd5-452b-ade7-b4fe6ececac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:01.039728 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49f84c-efd5-452b-ade7-b4fe6ececac9 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:01.078281 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:01.086153 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 944/1877] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:00 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:01.086977 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0745b2-4c23-4541-9b07-080704a12784 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:01.109050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-df0745b2-4c23-4541-9b07-080704a12784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:01.151067 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f837c48-a7e0-4a6c-82d6-c550f53682f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:01.152765 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f837c48-a7e0-4a6c-82d6-c550f53682f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:01.153051 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f837c48-a7e0-4a6c-82d6-c550f53682f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:01.153326 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f837c48-a7e0-4a6c-82d6-c550f53682f3 admin admin] PATH_INFO: `/v3/projects/fe381dbf504941fa85c9f64df81c55bc/users/2c52751183e448159ddf394a5d2edac4/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:01.155484 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f837c48-a7e0-4a6c-82d6-c550f53682f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe381dbf504941fa85c9f64df81c55bc, user_id=2c52751183e448159ddf394a5d2edac4, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:01.159022 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f837c48-a7e0-4a6c-82d6-c550f53682f3 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:01.185568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 934/1878] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:01 2022] PUT /identity/v3/projects/fe381dbf504941fa85c9f64df81c55bc/users/2c52751183e448159ddf394a5d2edac4/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:01.185568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f837c48-a7e0-4a6c-82d6-c550f53682f3 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:01.185568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-5f837c48-a7e0-4a6c-82d6-c550f53682f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:01.228885 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0745b2-4c23-4541-9b07-080704a12784 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:01.288259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f837c48-a7e0-4a6c-82d6-c550f53682f3 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:01.294312 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb3a7e-6b5e-4865-83e6-b8572b5cad1c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0433f6219478476286ea27c5c82d41a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:01.295057 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb3a7e-6b5e-4865-83e6-b8572b5cad1c service placement] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:01.295417 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb3a7e-6b5e-4865-83e6-b8572b5cad1c service placement] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:01.295770 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb3a7e-6b5e-4865-83e6-b8572b5cad1c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:01.313832 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f494a-ef04-4e04-abc7-7e05000f75d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:01.314716 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f494a-ef04-4e04-abc7-7e05000f75d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:01.315000 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f494a-ef04-4e04-abc7-7e05000f75d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:01.315118 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb3a7e-6b5e-4865-83e6-b8572b5cad1c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:01.315286 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f494a-ef04-4e04-abc7-7e05000f75d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:01.316145 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f494a-ef04-4e04-abc7-7e05000f75d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:01.317518 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb3a7e-6b5e-4865-83e6-b8572b5cad1c service placement] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:01.326271 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f494a-ef04-4e04-abc7-7e05000f75d9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:01.330155 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 935/1879] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:01.331033 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb3a7e-6b5e-4865-83e6-b8572b5cad1c service placement] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:01.336151 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-00cb3a7e-6b5e-4865-83e6-b8572b5cad1c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:01.347286 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 945/1880] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:01.349139 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b81d48-3d1e-45c8-8614-d1fecd38f7b2 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:01.349492 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b81d48-3d1e-45c8-8614-d1fecd38f7b2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:01.349777 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b81d48-3d1e-45c8-8614-d1fecd38f7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:01.388394 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-44b81d48-3d1e-45c8-8614-d1fecd38f7b2 None None] MFA Rules not processed for user `2c52751183e448159ddf394a5d2edac4`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:01.389657 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-44b81d48-3d1e-45c8-8614-d1fecd38f7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:01.496449 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb3a7e-6b5e-4865-83e6-b8572b5cad1c service placement] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:01.509071 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3c19b-7723-4a31-a351-8f3209e11f6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:01.510475 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3c19b-7723-4a31-a351-8f3209e11f6c service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:01.510806 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3c19b-7723-4a31-a351-8f3209e11f6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:01.512698 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3c19b-7723-4a31-a351-8f3209e11f6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:01.516533 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 946/1881] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:01.520588 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b81d48-3d1e-45c8-8614-d1fecd38f7b2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:01.522730 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-44b81d48-3d1e-45c8-8614-d1fecd38f7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:01.550335 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b81d48-3d1e-45c8-8614-d1fecd38f7b2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:01.556632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14138f01-3b39-441b-9f42-f0b00aea7b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:01.557920 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14138f01-3b39-441b-9f42-f0b00aea7b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:01.558500 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14138f01-3b39-441b-9f42-f0b00aea7b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:01.558986 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14138f01-3b39-441b-9f42-f0b00aea7b76 admin admin] PATH_INFO: `/v3/projects/2512e0f3f1884783beef0c271058eee5` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:01.560581 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14138f01-3b39-441b-9f42-f0b00aea7b76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2512e0f3f1884783beef0c271058eee5)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:01.563264 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14138f01-3b39-441b-9f42-f0b00aea7b76 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:01.577836 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:01.596775 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:01.612060 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec3c19b-7723-4a31-a351-8f3209e11f6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:01.613678 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec3c19b-7723-4a31-a351-8f3209e11f6c service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:01.626175 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 936/1882] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:01 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:01.627086 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3c19b-7723-4a31-a351-8f3209e11f6c service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:01.634265 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-14138f01-3b39-441b-9f42-f0b00aea7b76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2512e0f3f1884783beef0c271058eee5', 'request_id': 'req-14138f01-3b39-441b-9f42-f0b00aea7b76'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:01.640344 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3c19b-7723-4a31-a351-8f3209e11f6c service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:01.643643 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-14138f01-3b39-441b-9f42-f0b00aea7b76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2512e0f3f1884783beef0c271058eee5', 'request_id': 'req-14138f01-3b39-441b-9f42-f0b00aea7b76'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:01.656853 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-14138f01-3b39-441b-9f42-f0b00aea7b76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2512e0f3f1884783beef0c271058eee5', 'request_id': 'req-14138f01-3b39-441b-9f42-f0b00aea7b76'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:01.672650 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-14138f01-3b39-441b-9f42-f0b00aea7b76 admin admin] The token cache is being invalidate because project 2512e0f3f1884783beef0c271058eee5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:01.672997 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-14138f01-3b39-441b-9f42-f0b00aea7b76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:01.675763 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-14138f01-3b39-441b-9f42-f0b00aea7b76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:01.681447 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 947/1883] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:01 2022] DELETE /identity/v3/projects/2512e0f3f1884783beef0c271058eee5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:01.684544 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14138f01-3b39-441b-9f42-f0b00aea7b76 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:01.686396 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-14138f01-3b39-441b-9f42-f0b00aea7b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:01.750337 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c2bad-f0a8-4b11-8ba7-3e83c2e21735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:01.751244 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c2bad-f0a8-4b11-8ba7-3e83c2e21735 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:01.752495 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c2bad-f0a8-4b11-8ba7-3e83c2e21735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:01.752747 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c2bad-f0a8-4b11-8ba7-3e83c2e21735 admin admin] PATH_INFO: `/v3/projects/a2e255dc0a804e6db89f2854a806087c/users/2b749f2db28441d0a36e43c4d7070c3f/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:01.780664 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c2bad-f0a8-4b11-8ba7-3e83c2e21735 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2e255dc0a804e6db89f2854a806087c, user_id=2b749f2db28441d0a36e43c4d7070c3f, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:01.784064 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c2bad-f0a8-4b11-8ba7-3e83c2e21735 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:01.792369 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14138f01-3b39-441b-9f42-f0b00aea7b76 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:01.797288 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b98ece-52d4-4bb5-a9b9-d6c50b789d14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:01.798075 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b98ece-52d4-4bb5-a9b9-d6c50b789d14 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:01.798720 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b98ece-52d4-4bb5-a9b9-d6c50b789d14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:01.798941 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b98ece-52d4-4bb5-a9b9-d6c50b789d14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:01.800929 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-43b98ece-52d4-4bb5-a9b9-d6c50b789d14 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:01.806039 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 937/1884] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:01 2022] PUT /identity/v3/projects/a2e255dc0a804e6db89f2854a806087c/users/2b749f2db28441d0a36e43c4d7070c3f/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:01.807055 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c2bad-f0a8-4b11-8ba7-3e83c2e21735 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:01.809410 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-5f1c2bad-f0a8-4b11-8ba7-3e83c2e21735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:01.918937 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c2bad-f0a8-4b11-8ba7-3e83c2e21735 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:01.924485 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56282789-5a3b-4301-aad2-879b9999be74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:01.925733 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56282789-5a3b-4301-aad2-879b9999be74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:01.928115 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56282789-5a3b-4301-aad2-879b9999be74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:01.928424 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56282789-5a3b-4301-aad2-879b9999be74 admin admin] PATH_INFO: `/v3/users/6b57b717a4c14bbea12c7ef1fee90e97` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:01.929878 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56282789-5a3b-4301-aad2-879b9999be74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b57b717a4c14bbea12c7ef1fee90e97)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:01.930945 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b98ece-52d4-4bb5-a9b9-d6c50b789d14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:01.932226 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56282789-5a3b-4301-aad2-879b9999be74 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:01.932863 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b98ece-52d4-4bb5-a9b9-d6c50b789d14 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:01.946411 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 948/1885] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:01.948153 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b98ece-52d4-4bb5-a9b9-d6c50b789d14 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:01.950607 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-43b98ece-52d4-4bb5-a9b9-d6c50b789d14 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:01.970499 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b98ece-52d4-4bb5-a9b9-d6c50b789d14 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:01.983560 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c378c-a96e-4d06-b392-c284ef362986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:01.985023 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c378c-a96e-4d06-b392-c284ef362986 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:01.985579 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c378c-a96e-4d06-b392-c284ef362986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:01.986427 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c378c-a96e-4d06-b392-c284ef362986 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:01.988057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8c378c-a96e-4d06-b392-c284ef362986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:01.990110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8c378c-a96e-4d06-b392-c284ef362986 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:02.006145 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 949/1886] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:02.012087 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c378c-a96e-4d06-b392-c284ef362986 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:02.015117 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7f8c378c-a96e-4d06-b392-c284ef362986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:02.036774 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-56282789-5a3b-4301-aad2-879b9999be74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b57b717a4c14bbea12c7ef1fee90e97'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:02.038147 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-56282789-5a3b-4301-aad2-879b9999be74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b57b717a4c14bbea12c7ef1fee90e97'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:02.052051 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:02.062893 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-56282789-5a3b-4301-aad2-879b9999be74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b57b717a4c14bbea12c7ef1fee90e97'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:02.083408 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-56282789-5a3b-4301-aad2-879b9999be74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b57b717a4c14bbea12c7ef1fee90e97'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:02.097670 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-56282789-5a3b-4301-aad2-879b9999be74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b57b717a4c14bbea12c7ef1fee90e97'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:02.108837 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 938/1887] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:01 2022] DELETE /identity/v3/users/6b57b717a4c14bbea12c7ef1fee90e97 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:02.120316 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56282789-5a3b-4301-aad2-879b9999be74 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:02.125967 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-56282789-5a3b-4301-aad2-879b9999be74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:02.143366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:02.166969 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c378c-a96e-4d06-b392-c284ef362986 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:02.210879 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56282789-5a3b-4301-aad2-879b9999be74 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:02.215786 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5a97f-c34c-460b-a160-774614b869d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:02.216764 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5a97f-c34c-460b-a160-774614b869d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:02.217238 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5a97f-c34c-460b-a160-774614b869d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:02.217450 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5a97f-c34c-460b-a160-774614b869d7 admin admin] PATH_INFO: `/v3/projects/a2e255dc0a804e6db89f2854a806087c/users/2b749f2db28441d0a36e43c4d7070c3f/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:02.220056 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5a97f-c34c-460b-a160-774614b869d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2e255dc0a804e6db89f2854a806087c, user_id=2b749f2db28441d0a36e43c4d7070c3f, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:02.221936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2520fae-99b7-49fc-a726-ff79ad8998fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:02.222463 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5a97f-c34c-460b-a160-774614b869d7 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:02.222742 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2520fae-99b7-49fc-a726-ff79ad8998fd service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:02.223263 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2520fae-99b7-49fc-a726-ff79ad8998fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:02.223606 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2520fae-99b7-49fc-a726-ff79ad8998fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:02.225581 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d2520fae-99b7-49fc-a726-ff79ad8998fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:02.242293 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 939/1888] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:02 2022] PUT /identity/v3/projects/a2e255dc0a804e6db89f2854a806087c/users/2b749f2db28441d0a36e43c4d7070c3f/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:02.242293 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5a97f-c34c-460b-a160-774614b869d7 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:02.244601 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-64c5a97f-c34c-460b-a160-774614b869d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:02.305932 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2520fae-99b7-49fc-a726-ff79ad8998fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:02.307532 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2520fae-99b7-49fc-a726-ff79ad8998fd service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:02.333387 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 950/1889] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:02 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:02.334223 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2520fae-99b7-49fc-a726-ff79ad8998fd service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:02.335999 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d2520fae-99b7-49fc-a726-ff79ad8998fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:02.341689 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5a97f-c34c-460b-a160-774614b869d7 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:02.347864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2520fae-99b7-49fc-a726-ff79ad8998fd service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:02.349935 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852e992-6856-406b-9ad2-e32af94089fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:02.352139 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852e992-6856-406b-9ad2-e32af94089fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:02.352428 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852e992-6856-406b-9ad2-e32af94089fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:02.352770 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852e992-6856-406b-9ad2-e32af94089fa admin admin] PATH_INFO: `/v3/users/5b3cf75e7578417cac903d9323960af8` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:02.355987 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852e992-6856-406b-9ad2-e32af94089fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b3cf75e7578417cac903d9323960af8)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:02.356187 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852e992-6856-406b-9ad2-e32af94089fa admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:02.410500 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6452cb-5fb7-4219-858d-e2cbb0f47ae7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:02.411163 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6452cb-5fb7-4219-858d-e2cbb0f47ae7 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:02.411450 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6452cb-5fb7-4219-858d-e2cbb0f47ae7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:02.411729 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6452cb-5fb7-4219-858d-e2cbb0f47ae7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:02.414396 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-bf6452cb-5fb7-4219-858d-e2cbb0f47ae7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:02.421261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d852e992-6856-406b-9ad2-e32af94089fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b3cf75e7578417cac903d9323960af8'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:02.422597 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d852e992-6856-406b-9ad2-e32af94089fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b3cf75e7578417cac903d9323960af8'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:02.453367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d852e992-6856-406b-9ad2-e32af94089fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b3cf75e7578417cac903d9323960af8'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:02.463531 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:02.469754 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d852e992-6856-406b-9ad2-e32af94089fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b3cf75e7578417cac903d9323960af8'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:02.483304 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d852e992-6856-406b-9ad2-e32af94089fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b3cf75e7578417cac903d9323960af8'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:02.497394 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 940/1890] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:02 2022] DELETE /identity/v3/users/5b3cf75e7578417cac903d9323960af8 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:02.497394 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dbbf3-179f-48b5-9953-41d448ea97f3 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:02.497678 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dbbf3-179f-48b5-9953-41d448ea97f3 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:02.498781 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dbbf3-179f-48b5-9953-41d448ea97f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:02.520531 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6452cb-5fb7-4219-858d-e2cbb0f47ae7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:02.523600 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6452cb-5fb7-4219-858d-e2cbb0f47ae7 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:02.534530 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-122dbbf3-179f-48b5-9953-41d448ea97f3 None None] MFA Rules not processed for user `2b749f2db28441d0a36e43c4d7070c3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:02.536262 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-122dbbf3-179f-48b5-9953-41d448ea97f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:02.539761 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 951/1891] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:02.540903 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6452cb-5fb7-4219-858d-e2cbb0f47ae7 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:02.543774 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-bf6452cb-5fb7-4219-858d-e2cbb0f47ae7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:02.567112 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6452cb-5fb7-4219-858d-e2cbb0f47ae7 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:02.615098 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:02.736121 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ea917-8883-4f5d-b01b-bee2d741fc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:02.737034 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ea917-8883-4f5d-b01b-bee2d741fc5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:02.737326 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ea917-8883-4f5d-b01b-bee2d741fc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:02.737606 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ea917-8883-4f5d-b01b-bee2d741fc5a admin admin] PATH_INFO: `/v3/projects/58adb5e5d28c4d3fa4e1f5e40f12f540` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:02.742629 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ea917-8883-4f5d-b01b-bee2d741fc5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=58adb5e5d28c4d3fa4e1f5e40f12f540)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:02.744723 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ea917-8883-4f5d-b01b-bee2d741fc5a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:02.778313 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 941/1892] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:02 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:02.783736 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87af54d-be4c-4bdc-9de6-60cd758c2e14 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:02.784998 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87af54d-be4c-4bdc-9de6-60cd758c2e14 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:02.787296 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87af54d-be4c-4bdc-9de6-60cd758c2e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:02.854286 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-f87af54d-be4c-4bdc-9de6-60cd758c2e14 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:02.861149 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f87af54d-be4c-4bdc-9de6-60cd758c2e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:02.875263 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ca2ea917-8883-4f5d-b01b-bee2d741fc5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58adb5e5d28c4d3fa4e1f5e40f12f540', 'request_id': 'req-ca2ea917-8883-4f5d-b01b-bee2d741fc5a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:02.889502 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ca2ea917-8883-4f5d-b01b-bee2d741fc5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58adb5e5d28c4d3fa4e1f5e40f12f540', 'request_id': 'req-ca2ea917-8883-4f5d-b01b-bee2d741fc5a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:02.915677 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ca2ea917-8883-4f5d-b01b-bee2d741fc5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58adb5e5d28c4d3fa4e1f5e40f12f540', 'request_id': 'req-ca2ea917-8883-4f5d-b01b-bee2d741fc5a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:02.936022 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ca2ea917-8883-4f5d-b01b-bee2d741fc5a admin admin] The token cache is being invalidate because project 58adb5e5d28c4d3fa4e1f5e40f12f540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:02.936335 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ca2ea917-8883-4f5d-b01b-bee2d741fc5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:02.946551 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ca2ea917-8883-4f5d-b01b-bee2d741fc5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:02.952207 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 952/1893] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:02 2022] DELETE /identity/v3/projects/58adb5e5d28c4d3fa4e1f5e40f12f540 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:02.953384 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ea917-8883-4f5d-b01b-bee2d741fc5a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:02.954711 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ca2ea917-8883-4f5d-b01b-bee2d741fc5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:03.062642 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 942/1894] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:03.064566 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec904f0-38e6-4782-b6fb-42d29491a177 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:03.064866 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec904f0-38e6-4782-b6fb-42d29491a177 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:03.065634 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec904f0-38e6-4782-b6fb-42d29491a177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:03.106620 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-9ec904f0-38e6-4782-b6fb-42d29491a177 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:03.116102 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-9ec904f0-38e6-4782-b6fb-42d29491a177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:03.129932 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ea917-8883-4f5d-b01b-bee2d741fc5a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:03.140704 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 943/1895] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:03.141407 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768fe63-10a9-4728-a753-a1786db9b30d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:03.141714 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec904f0-38e6-4782-b6fb-42d29491a177 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:03.142574 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768fe63-10a9-4728-a753-a1786db9b30d service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:03.144301 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768fe63-10a9-4728-a753-a1786db9b30d service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:03.145136 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-9ec904f0-38e6-4782-b6fb-42d29491a177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:03.147130 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768fe63-10a9-4728-a753-a1786db9b30d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:03.149693 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e768fe63-10a9-4728-a753-a1786db9b30d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:03.282572 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:03.291839 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768fe63-10a9-4728-a753-a1786db9b30d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:03.294650 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec904f0-38e6-4782-b6fb-42d29491a177 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:03.294950 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768fe63-10a9-4728-a753-a1786db9b30d service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:03.298448 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80b292-43b8-45a2-97f5-764f1984d128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:03.299158 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80b292-43b8-45a2-97f5-764f1984d128 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:03.299444 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80b292-43b8-45a2-97f5-764f1984d128 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:03.299747 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80b292-43b8-45a2-97f5-764f1984d128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:03.307705 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 953/1896] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:02 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:03.310393 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba38f88-004a-4b1e-9132-44a08338c09d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:03.310981 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba38f88-004a-4b1e-9132-44a08338c09d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:03.311262 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba38f88-004a-4b1e-9132-44a08338c09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:03.331280 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab80b292-43b8-45a2-97f5-764f1984d128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:03.333101 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab80b292-43b8-45a2-97f5-764f1984d128 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:03.341136 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-aba38f88-004a-4b1e-9132-44a08338c09d None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:03.342758 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-aba38f88-004a-4b1e-9132-44a08338c09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:03.351484 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 944/1897] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:03.357994 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 954/1898] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:03.362237 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80b292-43b8-45a2-97f5-764f1984d128 service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:03.374675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80b292-43b8-45a2-97f5-764f1984d128 service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:03.380238 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2912e8b-fbfc-4841-9ace-62492d9fa3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:03.380904 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2912e8b-fbfc-4841-9ace-62492d9fa3a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:03.381186 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2912e8b-fbfc-4841-9ace-62492d9fa3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:03.381567 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2912e8b-fbfc-4841-9ace-62492d9fa3a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:03.382228 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2912e8b-fbfc-4841-9ace-62492d9fa3a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:28:03.382517 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2912e8b-fbfc-4841-9ace-62492d9fa3a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:03.384866 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2912e8b-fbfc-4841-9ace-62492d9fa3a9 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:03.393790 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:03.403102 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 945/1899] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:28:03.407786 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba38f88-004a-4b1e-9132-44a08338c09d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:03.445703 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2912e8b-fbfc-4841-9ace-62492d9fa3a9 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:03.446281 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba38f88-004a-4b1e-9132-44a08338c09d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:03.452542 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b2e85-8462-4bdd-9d09-adbb7329cb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:03.453226 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b2e85-8462-4bdd-9d09-adbb7329cb07 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:03.454056 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b2e85-8462-4bdd-9d09-adbb7329cb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:03.455222 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b2e85-8462-4bdd-9d09-adbb7329cb07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:03.457586 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b2e85-8462-4bdd-9d09-adbb7329cb07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:03.458747 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2912e8b-fbfc-4841-9ace-62492d9fa3a9 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:03.462830 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b2e85-8462-4bdd-9d09-adbb7329cb07 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:03.465651 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6942b-028c-4e91-b595-e8e0cab3a6ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:03.466699 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6942b-028c-4e91-b595-e8e0cab3a6ff service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:03.467139 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6942b-028c-4e91-b595-e8e0cab3a6ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:03.467961 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6942b-028c-4e91-b595-e8e0cab3a6ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:03.470234 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a8e6942b-028c-4e91-b595-e8e0cab3a6ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:03.509420 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 955/1900] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:28:03 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:03.510691 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b2e85-8462-4bdd-9d09-adbb7329cb07 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:03.574695 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e6942b-028c-4e91-b595-e8e0cab3a6ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:03.583509 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e6942b-028c-4e91-b595-e8e0cab3a6ff service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:03.597332 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 946/1901] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:03 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:28:03.602574 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b2e85-8462-4bdd-9d09-adbb7329cb07 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:03.609078 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b17739-cf25-4a4f-addd-93c031c93f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:03.610018 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b17739-cf25-4a4f-addd-93c031c93f7f admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:03.610142 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b17739-cf25-4a4f-addd-93c031c93f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:03.610423 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b17739-cf25-4a4f-addd-93c031c93f7f admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:03.611151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b17739-cf25-4a4f-addd-93c031c93f7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:03.613218 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b17739-cf25-4a4f-addd-93c031c93f7f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:03.637728 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 956/1902] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:28:03 2022] POST /identity/v3/users => generated 287 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:03.643735 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6942b-028c-4e91-b595-e8e0cab3a6ff service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:03.657844 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6942b-028c-4e91-b595-e8e0cab3a6ff service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:03.662938 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bff71f-a748-4b1e-a404-768a294e39e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:03.663718 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bff71f-a748-4b1e-a404-768a294e39e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:03.664078 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bff71f-a748-4b1e-a404-768a294e39e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:03.664427 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bff71f-a748-4b1e-a404-768a294e39e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:03.665248 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bff71f-a748-4b1e-a404-768a294e39e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:03.666970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bff71f-a748-4b1e-a404-768a294e39e7 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:03.680301 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 947/1903] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:03.685116 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b17739-cf25-4a4f-addd-93c031c93f7f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:03.698323 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b17739-cf25-4a4f-addd-93c031c93f7f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:03.704784 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebb785-5906-4288-8f33-3163d96dcd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:03.705874 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebb785-5906-4288-8f33-3163d96dcd8b admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:03.706265 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebb785-5906-4288-8f33-3163d96dcd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:03.706610 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebb785-5906-4288-8f33-3163d96dcd8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:03.707552 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aebb785-5906-4288-8f33-3163d96dcd8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:03.709470 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aebb785-5906-4288-8f33-3163d96dcd8b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:03.723503 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 957/1904] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:03.727975 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bff71f-a748-4b1e-a404-768a294e39e7 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:03.729131 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebb785-5906-4288-8f33-3163d96dcd8b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:03.732579 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9aebb785-5906-4288-8f33-3163d96dcd8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:03.752030 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebb785-5906-4288-8f33-3163d96dcd8b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:03.752622 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bff71f-a748-4b1e-a404-768a294e39e7 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:03.759740 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0208421-c720-4589-af6f-b6537d09bb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:03.762069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0208421-c720-4589-af6f-b6537d09bb72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:03.762629 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0208421-c720-4589-af6f-b6537d09bb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:03.763069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0208421-c720-4589-af6f-b6537d09bb72 admin admin] PATH_INFO: `/v3/projects/f6c87bf35ca14f0fb732c6228f1a2ae7` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:03.764752 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0208421-c720-4589-af6f-b6537d09bb72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6c87bf35ca14f0fb732c6228f1a2ae7)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:03.766613 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904d4a9-b5ce-454b-be9e-3a9e403e03b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:03.767398 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0208421-c720-4589-af6f-b6537d09bb72 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:03.767531 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904d4a9-b5ce-454b-be9e-3a9e403e03b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:03.767806 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904d4a9-b5ce-454b-be9e-3a9e403e03b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:03.768102 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904d4a9-b5ce-454b-be9e-3a9e403e03b1 admin admin] PATH_INFO: `/v3/projects/0c6a5738b20343bda30f2c1ebca3004c/users/abde4aabbb074da29b9ab091d86f2ec0/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:03.791144 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904d4a9-b5ce-454b-be9e-3a9e403e03b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c6a5738b20343bda30f2c1ebca3004c, user_id=abde4aabbb074da29b9ab091d86f2ec0, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:03.794132 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904d4a9-b5ce-454b-be9e-3a9e403e03b1 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:03.812223 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 948/1905] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:03 2022] PUT /identity/v3/projects/0c6a5738b20343bda30f2c1ebca3004c/users/abde4aabbb074da29b9ab091d86f2ec0/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:03.822776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb046b3a-7c78-4cad-a78c-f8933834f070 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:03.823106 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb046b3a-7c78-4cad-a78c-f8933834f070 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:03.823313 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb046b3a-7c78-4cad-a78c-f8933834f070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:03.839929 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f0208421-c720-4589-af6f-b6537d09bb72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6c87bf35ca14f0fb732c6228f1a2ae7', 'request_id': 'req-f0208421-c720-4589-af6f-b6537d09bb72'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:03.846104 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f0208421-c720-4589-af6f-b6537d09bb72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6c87bf35ca14f0fb732c6228f1a2ae7', 'request_id': 'req-f0208421-c720-4589-af6f-b6537d09bb72'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:03.852026 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-fb046b3a-7c78-4cad-a78c-f8933834f070 None None] MFA Rules not processed for user `abde4aabbb074da29b9ab091d86f2ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:03.853393 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-fb046b3a-7c78-4cad-a78c-f8933834f070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:03.855245 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f0208421-c720-4589-af6f-b6537d09bb72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6c87bf35ca14f0fb732c6228f1a2ae7', 'request_id': 'req-f0208421-c720-4589-af6f-b6537d09bb72'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:03.869824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f0208421-c720-4589-af6f-b6537d09bb72 admin admin] The token cache is being invalidate because project f6c87bf35ca14f0fb732c6228f1a2ae7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:03.870147 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f0208421-c720-4589-af6f-b6537d09bb72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:03.871350 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f0208421-c720-4589-af6f-b6537d09bb72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:03.872907 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 958/1906] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:03 2022] DELETE /identity/v3/projects/f6c87bf35ca14f0fb732c6228f1a2ae7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:03.876819 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0208421-c720-4589-af6f-b6537d09bb72 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:03.878425 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f0208421-c720-4589-af6f-b6537d09bb72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:03.911683 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:03.926613 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 949/1907] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:28:03.930957 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb046b3a-7c78-4cad-a78c-f8933834f070 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:03.932315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-fb046b3a-7c78-4cad-a78c-f8933834f070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:03.950096 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0208421-c720-4589-af6f-b6537d09bb72 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:03.954874 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73641ee7-49a3-44fe-ac6b-04d33c434faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:03.955744 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73641ee7-49a3-44fe-ac6b-04d33c434faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:03.956022 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73641ee7-49a3-44fe-ac6b-04d33c434faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:03.956292 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73641ee7-49a3-44fe-ac6b-04d33c434faf admin admin] PATH_INFO: `/v3/users/0bbd4a59e34041e380bed7bc9aeb25b9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:03.957496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73641ee7-49a3-44fe-ac6b-04d33c434faf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bbd4a59e34041e380bed7bc9aeb25b9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:03.959445 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73641ee7-49a3-44fe-ac6b-04d33c434faf admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:03.986391 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:04.001862 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb046b3a-7c78-4cad-a78c-f8933834f070 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:04.007884 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-73641ee7-49a3-44fe-ac6b-04d33c434faf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bbd4a59e34041e380bed7bc9aeb25b9'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:04.008240 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecd674-a2a1-4e6d-b56f-cebf10d374b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:04.008857 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-73641ee7-49a3-44fe-ac6b-04d33c434faf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bbd4a59e34041e380bed7bc9aeb25b9'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:04.009201 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecd674-a2a1-4e6d-b56f-cebf10d374b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:04.009554 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecd674-a2a1-4e6d-b56f-cebf10d374b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:04.009925 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecd674-a2a1-4e6d-b56f-cebf10d374b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:04.010851 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ecd674-a2a1-4e6d-b56f-cebf10d374b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:04.013295 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ecd674-a2a1-4e6d-b56f-cebf10d374b7 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:04.021458 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-73641ee7-49a3-44fe-ac6b-04d33c434faf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bbd4a59e34041e380bed7bc9aeb25b9'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:04.030191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-73641ee7-49a3-44fe-ac6b-04d33c434faf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bbd4a59e34041e380bed7bc9aeb25b9'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:04.030901 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-73641ee7-49a3-44fe-ac6b-04d33c434faf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bbd4a59e34041e380bed7bc9aeb25b9'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:04.040599 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 950/1908] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:28:03 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:28:04.044603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecd674-a2a1-4e6d-b56f-cebf10d374b7 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:04.045077 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 959/1909] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:03 2022] DELETE /identity/v3/users/0bbd4a59e34041e380bed7bc9aeb25b9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:28:04.047210 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-10ecd674-a2a1-4e6d-b56f-cebf10d374b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:04.113531 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecd674-a2a1-4e6d-b56f-cebf10d374b7 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:04.194449 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5992c5-f9db-4e19-a75e-e7f7e2fdbb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:04.195367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5992c5-f9db-4e19-a75e-e7f7e2fdbb42 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:04.195722 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5992c5-f9db-4e19-a75e-e7f7e2fdbb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:04.196069 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5992c5-f9db-4e19-a75e-e7f7e2fdbb42 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:04.196833 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5992c5-f9db-4e19-a75e-e7f7e2fdbb42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:04.200027 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5992c5-f9db-4e19-a75e-e7f7e2fdbb42 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:04.237550 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 951/1910] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:28:04 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:28:04.241190 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73641ee7-49a3-44fe-ac6b-04d33c434faf admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:04.253348 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73641ee7-49a3-44fe-ac6b-04d33c434faf admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:04.258431 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a476f323-3baf-4563-853e-867a46ae8845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:04.259201 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476f323-3baf-4563-853e-867a46ae8845 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:04.259389 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476f323-3baf-4563-853e-867a46ae8845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:04.259661 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476f323-3baf-4563-853e-867a46ae8845 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:04.260454 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a476f323-3baf-4563-853e-867a46ae8845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:04.262669 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a476f323-3baf-4563-853e-867a46ae8845 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:04.274322 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 960/1911] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:04.279351 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5992c5-f9db-4e19-a75e-e7f7e2fdbb42 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:04.293390 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5992c5-f9db-4e19-a75e-e7f7e2fdbb42 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:04.303948 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe7517-1167-4f8c-b2ef-2653b5771eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:04.304304 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe7517-1167-4f8c-b2ef-2653b5771eb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:04.306104 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe7517-1167-4f8c-b2ef-2653b5771eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:04.307336 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe7517-1167-4f8c-b2ef-2653b5771eb0 admin admin] PATH_INFO: `/v3/projects/6a9a55903378420d89803e5fc54c31ec/users/31a1ca96a09844668c366773ab660d4d/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:04.353494 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe7517-1167-4f8c-b2ef-2653b5771eb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a9a55903378420d89803e5fc54c31ec, user_id=31a1ca96a09844668c366773ab660d4d, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:04.359803 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe7517-1167-4f8c-b2ef-2653b5771eb0 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:04.398477 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 952/1912] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:04 2022] PUT /identity/v3/projects/6a9a55903378420d89803e5fc54c31ec/users/31a1ca96a09844668c366773ab660d4d/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:04.402494 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a476f323-3baf-4563-853e-867a46ae8845 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:04.427864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a476f323-3baf-4563-853e-867a46ae8845 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:04.577814 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efecbd8d-148c-46fe-812f-902a4c142673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:04.578538 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecbd8d-148c-46fe-812f-902a4c142673 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:04.578820 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecbd8d-148c-46fe-812f-902a4c142673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:04.579108 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecbd8d-148c-46fe-812f-902a4c142673 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:04.579872 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efecbd8d-148c-46fe-812f-902a4c142673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:04.581573 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efecbd8d-148c-46fe-812f-902a4c142673 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:04.596985 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 961/1913] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:04.600766 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe7517-1167-4f8c-b2ef-2653b5771eb0 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:04.614554 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe7517-1167-4f8c-b2ef-2653b5771eb0 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:04.623135 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139cf178-e797-4dcb-92ed-dc997947da65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:04.624365 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139cf178-e797-4dcb-92ed-dc997947da65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:04.624803 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139cf178-e797-4dcb-92ed-dc997947da65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:04.625228 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139cf178-e797-4dcb-92ed-dc997947da65 admin admin] PATH_INFO: `/v3/projects/6a9a55903378420d89803e5fc54c31ec/users/31a1ca96a09844668c366773ab660d4d/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:04.627890 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139cf178-e797-4dcb-92ed-dc997947da65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a9a55903378420d89803e5fc54c31ec, user_id=31a1ca96a09844668c366773ab660d4d, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:04.631191 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139cf178-e797-4dcb-92ed-dc997947da65 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:04.658649 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 953/1914] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:04 2022] PUT /identity/v3/projects/6a9a55903378420d89803e5fc54c31ec/users/31a1ca96a09844668c366773ab660d4d/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:04.659865 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae899f5-33b5-4e63-8dea-00981de4db16 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:04.660176 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae899f5-33b5-4e63-8dea-00981de4db16 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:04.660519 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae899f5-33b5-4e63-8dea-00981de4db16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:04.706451 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-eae899f5-33b5-4e63-8dea-00981de4db16 None None] MFA Rules not processed for user `31a1ca96a09844668c366773ab660d4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:04.707268 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-eae899f5-33b5-4e63-8dea-00981de4db16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:04.738272 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:04.806125 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 962/1915] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:04.822186 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139cf178-e797-4dcb-92ed-dc997947da65 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:04.827818 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-139cf178-e797-4dcb-92ed-dc997947da65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:04.902790 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:04.931813 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139cf178-e797-4dcb-92ed-dc997947da65 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:04.950750 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75349778-01a4-4da1-8f90-159d26fda32b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:04.968615 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75349778-01a4-4da1-8f90-159d26fda32b service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:04.969009 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae899f5-33b5-4e63-8dea-00981de4db16 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:04.969711 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75349778-01a4-4da1-8f90-159d26fda32b service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:04.970696 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-eae899f5-33b5-4e63-8dea-00981de4db16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:04.971170 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75349778-01a4-4da1-8f90-159d26fda32b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:05.013240 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75349778-01a4-4da1-8f90-159d26fda32b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:05.015065 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75349778-01a4-4da1-8f90-159d26fda32b service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:05.043722 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 954/1916] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:05.163905 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae899f5-33b5-4e63-8dea-00981de4db16 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:05.177850 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37580c1d-fb43-4128-8bb2-31880af1f6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:05.178835 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37580c1d-fb43-4128-8bb2-31880af1f6eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:05.179128 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37580c1d-fb43-4128-8bb2-31880af1f6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:05.179761 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37580c1d-fb43-4128-8bb2-31880af1f6eb admin admin] PATH_INFO: `/v3/projects/66ab6f9f489448ceb3272d871f28df0a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:05.182577 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37580c1d-fb43-4128-8bb2-31880af1f6eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=66ab6f9f489448ceb3272d871f28df0a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:05.186433 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37580c1d-fb43-4128-8bb2-31880af1f6eb admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:05.286257 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-37580c1d-fb43-4128-8bb2-31880af1f6eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66ab6f9f489448ceb3272d871f28df0a', 'request_id': 'req-37580c1d-fb43-4128-8bb2-31880af1f6eb'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:05.293426 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-37580c1d-fb43-4128-8bb2-31880af1f6eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66ab6f9f489448ceb3272d871f28df0a', 'request_id': 'req-37580c1d-fb43-4128-8bb2-31880af1f6eb'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:05.305796 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-37580c1d-fb43-4128-8bb2-31880af1f6eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66ab6f9f489448ceb3272d871f28df0a', 'request_id': 'req-37580c1d-fb43-4128-8bb2-31880af1f6eb'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:05.335434 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-37580c1d-fb43-4128-8bb2-31880af1f6eb admin admin] The token cache is being invalidate because project 66ab6f9f489448ceb3272d871f28df0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:05.336153 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-37580c1d-fb43-4128-8bb2-31880af1f6eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:05.337643 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-37580c1d-fb43-4128-8bb2-31880af1f6eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:05.340906 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 963/1917] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:04 2022] DELETE /identity/v3/projects/66ab6f9f489448ceb3272d871f28df0a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:28:05.345729 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f86d5-e4b7-46bb-9fe8-224db7a4e0cb None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:05.346311 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f86d5-e4b7-46bb-9fe8-224db7a4e0cb None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:05.346571 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f86d5-e4b7-46bb-9fe8-224db7a4e0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:05.368226 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-5b2f86d5-e4b7-46bb-9fe8-224db7a4e0cb None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:05.369586 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-5b2f86d5-e4b7-46bb-9fe8-224db7a4e0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:05.458415 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 955/1918] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:05.460495 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633a281-dcca-4056-bb10-b9762f962f3f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:05.460784 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633a281-dcca-4056-bb10-b9762f962f3f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:05.461065 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633a281-dcca-4056-bb10-b9762f962f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:05.495188 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d633a281-dcca-4056-bb10-b9762f962f3f None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:05.497005 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d633a281-dcca-4056-bb10-b9762f962f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:05.508502 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 964/1919] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:05.514409 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f86d5-e4b7-46bb-9fe8-224db7a4e0cb None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:05.528452 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f86d5-e4b7-46bb-9fe8-224db7a4e0cb None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:05.534458 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de4af9-209a-400b-9eae-2741ba1ee6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:05.535148 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de4af9-209a-400b-9eae-2741ba1ee6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:05.535435 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de4af9-209a-400b-9eae-2741ba1ee6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:05.535714 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de4af9-209a-400b-9eae-2741ba1ee6a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:05.536655 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de4af9-209a-400b-9eae-2741ba1ee6a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:28:05.536963 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de4af9-209a-400b-9eae-2741ba1ee6a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:05.539990 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de4af9-209a-400b-9eae-2741ba1ee6a7 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:05.570955 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633a281-dcca-4056-bb10-b9762f962f3f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:05.584920 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 956/1920] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:28:05.585892 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de4af9-209a-400b-9eae-2741ba1ee6a7 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:05.588297 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633a281-dcca-4056-bb10-b9762f962f3f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:05.591387 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-61de4af9-209a-400b-9eae-2741ba1ee6a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:05.598784 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44a427-7734-4be6-b2e5-670730ac8901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:05.599766 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44a427-7734-4be6-b2e5-670730ac8901 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:05.600065 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44a427-7734-4be6-b2e5-670730ac8901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:05.600349 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44a427-7734-4be6-b2e5-670730ac8901 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:05.601051 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44a427-7734-4be6-b2e5-670730ac8901 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:05.608395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44a427-7734-4be6-b2e5-670730ac8901 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:05.688151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 965/1921] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:28:05 2022] POST /identity/v3/projects => generated 381 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:05.692497 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44a427-7734-4be6-b2e5-670730ac8901 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:05.730549 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:05.752768 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de4af9-209a-400b-9eae-2741ba1ee6a7 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:05.809111 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44a427-7734-4be6-b2e5-670730ac8901 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:05.816442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e519f9-6146-4562-bfe2-d5077e8e32c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:05.817486 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e519f9-6146-4562-bfe2-d5077e8e32c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:05.818152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e519f9-6146-4562-bfe2-d5077e8e32c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:05.818573 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e519f9-6146-4562-bfe2-d5077e8e32c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:05.819563 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e519f9-6146-4562-bfe2-d5077e8e32c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:05.823916 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e519f9-6146-4562-bfe2-d5077e8e32c4 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:05.856343 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676e3c5-7552-4a2e-9873-b533f200d553 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:05.857244 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676e3c5-7552-4a2e-9873-b533f200d553 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:05.857576 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676e3c5-7552-4a2e-9873-b533f200d553 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:05.857861 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676e3c5-7552-4a2e-9873-b533f200d553 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:05.859043 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 966/1922] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:28:05 2022] POST /identity/v3/users => generated 291 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:05.860085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e519f9-6146-4562-bfe2-d5077e8e32c4 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:05.860847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-4676e3c5-7552-4a2e-9873-b533f200d553 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:05.862144 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a1e519f9-6146-4562-bfe2-d5077e8e32c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:05.879554 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e519f9-6146-4562-bfe2-d5077e8e32c4 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:05.887745 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f457ce1-89f1-4b3b-824f-9ca0529a1c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:05.889215 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f457ce1-89f1-4b3b-824f-9ca0529a1c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:05.889721 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f457ce1-89f1-4b3b-824f-9ca0529a1c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:05.890616 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f457ce1-89f1-4b3b-824f-9ca0529a1c20 admin admin] PATH_INFO: `/v3/users/28f5167ef7a546999490a07f8292805b` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:05.892781 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f457ce1-89f1-4b3b-824f-9ca0529a1c20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28f5167ef7a546999490a07f8292805b)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:05.896292 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f457ce1-89f1-4b3b-824f-9ca0529a1c20 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:05.930314 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:05.969884 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8f457ce1-89f1-4b3b-824f-9ca0529a1c20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28f5167ef7a546999490a07f8292805b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:05.970918 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8f457ce1-89f1-4b3b-824f-9ca0529a1c20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28f5167ef7a546999490a07f8292805b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:05.981234 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676e3c5-7552-4a2e-9873-b533f200d553 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:05.982764 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676e3c5-7552-4a2e-9873-b533f200d553 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:06.000350 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8f457ce1-89f1-4b3b-824f-9ca0529a1c20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28f5167ef7a546999490a07f8292805b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:06.008461 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 957/1923] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:06.009278 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676e3c5-7552-4a2e-9873-b533f200d553 service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:06.014668 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8f457ce1-89f1-4b3b-824f-9ca0529a1c20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28f5167ef7a546999490a07f8292805b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:06.016897 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8f457ce1-89f1-4b3b-824f-9ca0529a1c20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28f5167ef7a546999490a07f8292805b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:06.033630 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676e3c5-7552-4a2e-9873-b533f200d553 service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:06.046605 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 967/1924] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:05 2022] DELETE /identity/v3/users/28f5167ef7a546999490a07f8292805b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:06.046847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2b64a-5b5c-486d-bc45-d2339153d4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:06.047831 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2b64a-5b5c-486d-bc45-d2339153d4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:06.048135 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2b64a-5b5c-486d-bc45-d2339153d4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:06.048243 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30662c-7e5a-42c6-ad79-ea2bbe83623f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:06.048419 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2b64a-5b5c-486d-bc45-d2339153d4e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:06.048512 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30662c-7e5a-42c6-ad79-ea2bbe83623f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:06.049205 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2b64a-5b5c-486d-bc45-d2339153d4e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:06.055814 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2b64a-5b5c-486d-bc45-d2339153d4e7 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:06.059089 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30662c-7e5a-42c6-ad79-ea2bbe83623f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:06.077056 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 958/1925] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:06.081261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2b64a-5b5c-486d-bc45-d2339153d4e7 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:06.083569 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-8df2b64a-5b5c-486d-bc45-d2339153d4e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:06.089791 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2d30662c-7e5a-42c6-ad79-ea2bbe83623f None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:06.091125 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2d30662c-7e5a-42c6-ad79-ea2bbe83623f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:06.123555 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2b64a-5b5c-486d-bc45-d2339153d4e7 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:06.195288 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 968/1926] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:28:06.210683 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04887512-2ab4-4b4e-8631-1fb78d016883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:06.212663 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30662c-7e5a-42c6-ad79-ea2bbe83623f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:06.212842 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04887512-2ab4-4b4e-8631-1fb78d016883 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:06.213143 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04887512-2ab4-4b4e-8631-1fb78d016883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:06.213408 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04887512-2ab4-4b4e-8631-1fb78d016883 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:06.215752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04887512-2ab4-4b4e-8631-1fb78d016883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:06.218177 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04887512-2ab4-4b4e-8631-1fb78d016883 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:06.219489 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2d30662c-7e5a-42c6-ad79-ea2bbe83623f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:06.234028 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 959/1927] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 04:28:06.238424 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04887512-2ab4-4b4e-8631-1fb78d016883 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:06.269378 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04887512-2ab4-4b4e-8631-1fb78d016883 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:06.273488 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:06.277627 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0218d-5a13-4010-a3d2-a6ab92874687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:06.279294 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0218d-5a13-4010-a3d2-a6ab92874687 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:06.279736 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0218d-5a13-4010-a3d2-a6ab92874687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:06.280294 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0218d-5a13-4010-a3d2-a6ab92874687 admin admin] PATH_INFO: `/v3/projects/23b754907f1f443ba19e9ef742fabfc5/users/8392f3dc030b40afa466e3167b8a3ac0/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:06.307135 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0218d-5a13-4010-a3d2-a6ab92874687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23b754907f1f443ba19e9ef742fabfc5, user_id=8392f3dc030b40afa466e3167b8a3ac0, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:06.310920 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0218d-5a13-4010-a3d2-a6ab92874687 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:06.331175 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 960/1928] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:06 2022] PUT /identity/v3/projects/23b754907f1f443ba19e9ef742fabfc5/users/8392f3dc030b40afa466e3167b8a3ac0/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:06.332451 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30662c-7e5a-42c6-ad79-ea2bbe83623f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:06.345051 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2a7ac-2e37-4229-806a-8a2443fdb787 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:06.345369 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2a7ac-2e37-4229-806a-8a2443fdb787 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:06.345751 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2a7ac-2e37-4229-806a-8a2443fdb787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:06.378138 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-38b2a7ac-2e37-4229-806a-8a2443fdb787 None None] MFA Rules not processed for user `8392f3dc030b40afa466e3167b8a3ac0`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:06.379518 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-38b2a7ac-2e37-4229-806a-8a2443fdb787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:06.415177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041bf1f-4b71-441e-9dba-dc1f277e58c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:06.415792 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041bf1f-4b71-441e-9dba-dc1f277e58c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:06.416540 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041bf1f-4b71-441e-9dba-dc1f277e58c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:06.416540 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041bf1f-4b71-441e-9dba-dc1f277e58c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:06.457581 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 961/1929] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:28:06.462154 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2a7ac-2e37-4229-806a-8a2443fdb787 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:06.487589 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041bf1f-4b71-441e-9dba-dc1f277e58c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:06.489170 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041bf1f-4b71-441e-9dba-dc1f277e58c9 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:06.497704 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:06.499458 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 969/1930] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:06.536460 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2a7ac-2e37-4229-806a-8a2443fdb787 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:06.541239 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0556b1-3f6b-4522-bbd0-0066665b56fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:06.541952 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0556b1-3f6b-4522-bbd0-0066665b56fb admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:06.542326 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0556b1-3f6b-4522-bbd0-0066665b56fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:06.542761 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0556b1-3f6b-4522-bbd0-0066665b56fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:06.543463 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0556b1-3f6b-4522-bbd0-0066665b56fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:06.545470 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0556b1-3f6b-4522-bbd0-0066665b56fb admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:06.575744 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 962/1931] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:28:06 2022] POST /identity/v3/projects => generated 381 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:28:06.579701 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041bf1f-4b71-441e-9dba-dc1f277e58c9 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:06.590631 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041bf1f-4b71-441e-9dba-dc1f277e58c9 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:06.697726 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d196b8-5bc9-4a79-ae9f-40ee7880dec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:06.699307 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d196b8-5bc9-4a79-ae9f-40ee7880dec5 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:06.699821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d196b8-5bc9-4a79-ae9f-40ee7880dec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:06.700355 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d196b8-5bc9-4a79-ae9f-40ee7880dec5 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:06.701856 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d196b8-5bc9-4a79-ae9f-40ee7880dec5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:06.705069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d196b8-5bc9-4a79-ae9f-40ee7880dec5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:06.734543 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 970/1932] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:28:06 2022] POST /identity/v3/users => generated 297 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:28:06.739037 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0556b1-3f6b-4522-bbd0-0066665b56fb admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:06.754643 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0556b1-3f6b-4522-bbd0-0066665b56fb admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:06.765007 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24b071-151e-4b73-a9df-66cf3b7a8b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:06.766136 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24b071-151e-4b73-a9df-66cf3b7a8b4d admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:06.766702 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24b071-151e-4b73-a9df-66cf3b7a8b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:06.767208 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24b071-151e-4b73-a9df-66cf3b7a8b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:06.768351 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad24b071-151e-4b73-a9df-66cf3b7a8b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:06.770314 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad24b071-151e-4b73-a9df-66cf3b7a8b4d admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:06.786068 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 963/1933] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:06.791844 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d196b8-5bc9-4a79-ae9f-40ee7880dec5 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:06.804444 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d196b8-5bc9-4a79-ae9f-40ee7880dec5 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:06.830370 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6850c2-7d11-438f-8188-38a89d59ba9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:06.830370 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6850c2-7d11-438f-8188-38a89d59ba9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:06.830370 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6850c2-7d11-438f-8188-38a89d59ba9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:06.830370 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6850c2-7d11-438f-8188-38a89d59ba9e admin admin] PATH_INFO: `/v3/projects/a64d7cd43b9342abb8247559feaf2b13/users/f8aa87513df84f8ba5c46d15fdd9a8e5/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:06.838790 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24b071-151e-4b73-a9df-66cf3b7a8b4d admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:06.843133 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-ad24b071-151e-4b73-a9df-66cf3b7a8b4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:06.856899 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:06.871894 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6850c2-7d11-438f-8188-38a89d59ba9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a64d7cd43b9342abb8247559feaf2b13, user_id=f8aa87513df84f8ba5c46d15fdd9a8e5, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:06.883485 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24b071-151e-4b73-a9df-66cf3b7a8b4d admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:06.888998 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6850c2-7d11-438f-8188-38a89d59ba9e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:06.904943 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a889b9-6697-414b-acfb-6dbec599eeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:06.906480 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a889b9-6697-414b-acfb-6dbec599eeba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:06.906851 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a889b9-6697-414b-acfb-6dbec599eeba admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:06.908095 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a889b9-6697-414b-acfb-6dbec599eeba admin admin] PATH_INFO: `/v3/projects/36e58ea7f3564794b37743e58abf21ae` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:06.911209 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a889b9-6697-414b-acfb-6dbec599eeba admin admin] RBAC: Authorizing `identity:delete_project(project_id=36e58ea7f3564794b37743e58abf21ae)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:06.921318 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a889b9-6697-414b-acfb-6dbec599eeba admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:06.934071 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 971/1934] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:06 2022] PUT /identity/v3/projects/a64d7cd43b9342abb8247559feaf2b13/users/f8aa87513df84f8ba5c46d15fdd9a8e5/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:06.935323 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6850c2-7d11-438f-8188-38a89d59ba9e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:07.020267 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b3a889b9-6697-414b-acfb-6dbec599eeba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36e58ea7f3564794b37743e58abf21ae', 'request_id': 'req-b3a889b9-6697-414b-acfb-6dbec599eeba'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:07.041768 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b3a889b9-6697-414b-acfb-6dbec599eeba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36e58ea7f3564794b37743e58abf21ae', 'request_id': 'req-b3a889b9-6697-414b-acfb-6dbec599eeba'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:07.054493 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b3a889b9-6697-414b-acfb-6dbec599eeba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36e58ea7f3564794b37743e58abf21ae', 'request_id': 'req-b3a889b9-6697-414b-acfb-6dbec599eeba'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:07.058147 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6850c2-7d11-438f-8188-38a89d59ba9e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:07.079902 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b3a889b9-6697-414b-acfb-6dbec599eeba admin admin] The token cache is being invalidate because project 36e58ea7f3564794b37743e58abf21ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:07.080518 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b3a889b9-6697-414b-acfb-6dbec599eeba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:07.081582 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b3a889b9-6697-414b-acfb-6dbec599eeba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:07.083848 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 964/1935] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:06 2022] DELETE /identity/v3/projects/36e58ea7f3564794b37743e58abf21ae => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:28:07.088040 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a889b9-6697-414b-acfb-6dbec599eeba admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:07.094860 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-b3a889b9-6697-414b-acfb-6dbec599eeba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:07.142650 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfa014-da17-473b-98f7-56af71962267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:07.143341 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfa014-da17-473b-98f7-56af71962267 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:07.143630 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfa014-da17-473b-98f7-56af71962267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:07.143911 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfa014-da17-473b-98f7-56af71962267 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:07.145310 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bfa014-da17-473b-98f7-56af71962267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:07.146617 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bfa014-da17-473b-98f7-56af71962267 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:07.159820 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 972/1936] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:07.165250 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfa014-da17-473b-98f7-56af71962267 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:07.168505 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-09bfa014-da17-473b-98f7-56af71962267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:07.205094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfa014-da17-473b-98f7-56af71962267 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:07.222892 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c55db-a448-4cb2-ae68-03f8c913cee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:07.224189 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c55db-a448-4cb2-ae68-03f8c913cee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:07.224628 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c55db-a448-4cb2-ae68-03f8c913cee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:07.225056 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c55db-a448-4cb2-ae68-03f8c913cee0 admin admin] PATH_INFO: `/v3/projects/a64d7cd43b9342abb8247559feaf2b13/users/f8aa87513df84f8ba5c46d15fdd9a8e5/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:07.230554 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c55db-a448-4cb2-ae68-03f8c913cee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a64d7cd43b9342abb8247559feaf2b13, user_id=f8aa87513df84f8ba5c46d15fdd9a8e5, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:07.233919 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c55db-a448-4cb2-ae68-03f8c913cee0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:07.263738 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 973/1937] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:07 2022] PUT /identity/v3/projects/a64d7cd43b9342abb8247559feaf2b13/users/f8aa87513df84f8ba5c46d15fdd9a8e5/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:07.266038 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d2ee8-8779-48b9-a1e5-e2dd8d1fcfd4 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:07.266380 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d2ee8-8779-48b9-a1e5-e2dd8d1fcfd4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:07.266670 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d2ee8-8779-48b9-a1e5-e2dd8d1fcfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:07.297130 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a889b9-6697-414b-acfb-6dbec599eeba admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:07.340190 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-1e9d2ee8-8779-48b9-a1e5-e2dd8d1fcfd4 None None] MFA Rules not processed for user `f8aa87513df84f8ba5c46d15fdd9a8e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:07.341454 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1e9d2ee8-8779-48b9-a1e5-e2dd8d1fcfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:07.378537 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:07.443219 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155a107-3e18-4a58-a27a-ff8fec97c40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:07.444129 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155a107-3e18-4a58-a27a-ff8fec97c40b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:07.444413 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155a107-3e18-4a58-a27a-ff8fec97c40b admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:07.444692 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155a107-3e18-4a58-a27a-ff8fec97c40b admin admin] PATH_INFO: `/v3/users/2c52751183e448159ddf394a5d2edac4` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:07.446361 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155a107-3e18-4a58-a27a-ff8fec97c40b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c52751183e448159ddf394a5d2edac4)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:07.449224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155a107-3e18-4a58-a27a-ff8fec97c40b admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:07.551841 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 974/1938] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:07.553788 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-c155a107-3e18-4a58-a27a-ff8fec97c40b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c52751183e448159ddf394a5d2edac4'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:07.555251 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-c155a107-3e18-4a58-a27a-ff8fec97c40b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c52751183e448159ddf394a5d2edac4'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:07.585085 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-c155a107-3e18-4a58-a27a-ff8fec97c40b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c52751183e448159ddf394a5d2edac4'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:07.600168 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-c155a107-3e18-4a58-a27a-ff8fec97c40b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c52751183e448159ddf394a5d2edac4'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:07.616686 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-c155a107-3e18-4a58-a27a-ff8fec97c40b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c52751183e448159ddf394a5d2edac4'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:07.626591 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 965/1939] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:07 2022] DELETE /identity/v3/users/2c52751183e448159ddf394a5d2edac4 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:07.727743 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d2ee8-8779-48b9-a1e5-e2dd8d1fcfd4 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:07.730606 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1e9d2ee8-8779-48b9-a1e5-e2dd8d1fcfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:07.746068 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:07.819771 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d2ee8-8779-48b9-a1e5-e2dd8d1fcfd4 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:07.928812 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118d005-bfce-4b27-b52c-fe45dfdf5f4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:07.929488 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118d005-bfce-4b27-b52c-fe45dfdf5f4d service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:07.929777 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118d005-bfce-4b27-b52c-fe45dfdf5f4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:07.930083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118d005-bfce-4b27-b52c-fe45dfdf5f4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:07.936606 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a118d005-bfce-4b27-b52c-fe45dfdf5f4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:08.050510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a118d005-bfce-4b27-b52c-fe45dfdf5f4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:08.052342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a118d005-bfce-4b27-b52c-fe45dfdf5f4d service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:08.071401 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 975/1940] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:08.094145 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155a107-3e18-4a58-a27a-ff8fec97c40b admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:08.096047 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c155a107-3e18-4a58-a27a-ff8fec97c40b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:08.188049 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155a107-3e18-4a58-a27a-ff8fec97c40b admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:08.193374 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5f4bd-3b88-4470-91bc-b9ab2cb3741d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:08.194572 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5f4bd-3b88-4470-91bc-b9ab2cb3741d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:08.194929 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5f4bd-3b88-4470-91bc-b9ab2cb3741d admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:08.195212 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5f4bd-3b88-4470-91bc-b9ab2cb3741d admin admin] PATH_INFO: `/v3/projects/fe381dbf504941fa85c9f64df81c55bc` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:08.196452 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5f4bd-3b88-4470-91bc-b9ab2cb3741d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe381dbf504941fa85c9f64df81c55bc)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:08.199398 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5f4bd-3b88-4470-91bc-b9ab2cb3741d admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:08.276143 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-dba5f4bd-3b88-4470-91bc-b9ab2cb3741d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe381dbf504941fa85c9f64df81c55bc', 'request_id': 'req-dba5f4bd-3b88-4470-91bc-b9ab2cb3741d'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:08.281561 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:08.289424 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-dba5f4bd-3b88-4470-91bc-b9ab2cb3741d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe381dbf504941fa85c9f64df81c55bc', 'request_id': 'req-dba5f4bd-3b88-4470-91bc-b9ab2cb3741d'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:08.307134 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-dba5f4bd-3b88-4470-91bc-b9ab2cb3741d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe381dbf504941fa85c9f64df81c55bc', 'request_id': 'req-dba5f4bd-3b88-4470-91bc-b9ab2cb3741d'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:08.319112 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118d005-bfce-4b27-b52c-fe45dfdf5f4d service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:08.320737 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a118d005-bfce-4b27-b52c-fe45dfdf5f4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:08.324681 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-dba5f4bd-3b88-4470-91bc-b9ab2cb3741d admin admin] The token cache is being invalidate because project fe381dbf504941fa85c9f64df81c55bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:08.324995 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-dba5f4bd-3b88-4470-91bc-b9ab2cb3741d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:08.325737 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-dba5f4bd-3b88-4470-91bc-b9ab2cb3741d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:08.327595 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 966/1941] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:08 2022] DELETE /identity/v3/projects/fe381dbf504941fa85c9f64df81c55bc => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:08.334365 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61acd8-f925-4f9c-955a-9ddf14d3796a None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:08.334365 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61acd8-f925-4f9c-955a-9ddf14d3796a None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:08.334365 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61acd8-f925-4f9c-955a-9ddf14d3796a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:08.340498 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118d005-bfce-4b27-b52c-fe45dfdf5f4d service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:08.358266 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-cc61acd8-f925-4f9c-955a-9ddf14d3796a None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:08.359515 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-cc61acd8-f925-4f9c-955a-9ddf14d3796a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:08.416630 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7580119-3193-436d-a8ed-eeb9bdaa93e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:08.418110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7580119-3193-436d-a8ed-eeb9bdaa93e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:08.418557 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7580119-3193-436d-a8ed-eeb9bdaa93e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:08.418922 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7580119-3193-436d-a8ed-eeb9bdaa93e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:08.421083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e7580119-3193-436d-a8ed-eeb9bdaa93e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:08.462620 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 967/1942] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:28:08.478941 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fba24-ad26-4c07-a381-6c25f8b5f06f None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:08.479387 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fba24-ad26-4c07-a381-6c25f8b5f06f None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:08.479500 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:08.481016 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fba24-ad26-4c07-a381-6c25f8b5f06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:08.505050 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-cd8fba24-ad26-4c07-a381-6c25f8b5f06f None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:08.506558 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-cd8fba24-ad26-4c07-a381-6c25f8b5f06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:08.517346 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 968/1943] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:08.521475 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8fba24-ad26-4c07-a381-6c25f8b5f06f None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:08.524568 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7580119-3193-436d-a8ed-eeb9bdaa93e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:08.526722 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7580119-3193-436d-a8ed-eeb9bdaa93e0 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:08.531461 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8fba24-ad26-4c07-a381-6c25f8b5f06f None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:08.537401 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98643bac-9b7a-4c64-93da-9231d0eba13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:08.538170 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98643bac-9b7a-4c64-93da-9231d0eba13c admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:08.538507 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98643bac-9b7a-4c64-93da-9231d0eba13c admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:08.538723 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98643bac-9b7a-4c64-93da-9231d0eba13c admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:08.538889 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 976/1944] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:08.539571 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98643bac-9b7a-4c64-93da-9231d0eba13c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:28:08.539744 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98643bac-9b7a-4c64-93da-9231d0eba13c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:08.541392 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98643bac-9b7a-4c64-93da-9231d0eba13c admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:08.557035 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 969/1945] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:28:08.561989 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7580119-3193-436d-a8ed-eeb9bdaa93e0 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:08.573905 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7580119-3193-436d-a8ed-eeb9bdaa93e0 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:08.579134 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f10976d-9c27-45ce-9a2b-59bf39fd5864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:08.579674 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10976d-9c27-45ce-9a2b-59bf39fd5864 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:08.579997 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10976d-9c27-45ce-9a2b-59bf39fd5864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:08.580398 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10976d-9c27-45ce-9a2b-59bf39fd5864 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:08.581144 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f10976d-9c27-45ce-9a2b-59bf39fd5864 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:08.583287 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f10976d-9c27-45ce-9a2b-59bf39fd5864 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:08.620051 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 977/1946] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:28:08 2022] POST /identity/v3/projects => generated 389 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:28:08.621801 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98643bac-9b7a-4c64-93da-9231d0eba13c admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:08.632548 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98643bac-9b7a-4c64-93da-9231d0eba13c admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:08.693282 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f10976d-9c27-45ce-9a2b-59bf39fd5864 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:08.695877 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0f10976d-9c27-45ce-9a2b-59bf39fd5864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:08.732517 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac71de-b261-47b1-93a0-b58ed93ea90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:08.733204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac71de-b261-47b1-93a0-b58ed93ea90f admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:08.733486 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac71de-b261-47b1-93a0-b58ed93ea90f admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:08.733942 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac71de-b261-47b1-93a0-b58ed93ea90f admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:08.735757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac71de-b261-47b1-93a0-b58ed93ea90f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:08.742251 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac71de-b261-47b1-93a0-b58ed93ea90f admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:08.777999 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 970/1947] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:28:08 2022] POST /identity/v3/users => generated 295 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:08.781998 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac71de-b261-47b1-93a0-b58ed93ea90f admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:08.800690 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac71de-b261-47b1-93a0-b58ed93ea90f admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:08.806373 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a4e91-5b41-45a8-a95c-47439971fc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:08.807101 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a4e91-5b41-45a8-a95c-47439971fc27 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:08.807589 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a4e91-5b41-45a8-a95c-47439971fc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:08.808636 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a4e91-5b41-45a8-a95c-47439971fc27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:08.809523 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a4e91-5b41-45a8-a95c-47439971fc27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:08.811649 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a4e91-5b41-45a8-a95c-47439971fc27 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:08.815984 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f10976d-9c27-45ce-9a2b-59bf39fd5864 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:08.823165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 971/1948] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:08.827216 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a4e91-5b41-45a8-a95c-47439971fc27 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:08.827598 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64dcb15-19af-4472-a24c-677d88bba149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:08.829187 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64dcb15-19af-4472-a24c-677d88bba149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:08.829587 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64dcb15-19af-4472-a24c-677d88bba149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:08.830730 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64dcb15-19af-4472-a24c-677d88bba149 admin admin] PATH_INFO: `/v3/users/befb5805fb0845198b49ba60f7c2b68f` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:08.832177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64dcb15-19af-4472-a24c-677d88bba149 admin admin] RBAC: Authorizing `identity:delete_user(user_id=befb5805fb0845198b49ba60f7c2b68f)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:08.834297 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64dcb15-19af-4472-a24c-677d88bba149 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:08.844741 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a4e91-5b41-45a8-a95c-47439971fc27 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:08.857291 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59cd94-72e2-4973-a125-2ef5fddd8095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:08.858101 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59cd94-72e2-4973-a125-2ef5fddd8095 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:08.858647 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59cd94-72e2-4973-a125-2ef5fddd8095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:08.858940 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59cd94-72e2-4973-a125-2ef5fddd8095 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:08.859996 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59cd94-72e2-4973-a125-2ef5fddd8095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:08.862181 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59cd94-72e2-4973-a125-2ef5fddd8095 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:08.881360 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 972/1949] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:08.885439 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59cd94-72e2-4973-a125-2ef5fddd8095 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:08.902183 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59cd94-72e2-4973-a125-2ef5fddd8095 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:08.913133 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b64dcb15-19af-4472-a24c-677d88bba149 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'befb5805fb0845198b49ba60f7c2b68f'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:08.914519 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b64dcb15-19af-4472-a24c-677d88bba149 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'befb5805fb0845198b49ba60f7c2b68f'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:08.922173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0265e38-5545-490d-9602-b0a4c5195d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:08.923834 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0265e38-5545-490d-9602-b0a4c5195d1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:08.923957 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0265e38-5545-490d-9602-b0a4c5195d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:08.924361 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0265e38-5545-490d-9602-b0a4c5195d1f admin admin] PATH_INFO: `/v3/projects/3575bf08e1564446a9d2ada5ed5dc40e/users/71459adf4edd465bafc87255a6f89637/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:08.942586 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b64dcb15-19af-4472-a24c-677d88bba149 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'befb5805fb0845198b49ba60f7c2b68f'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:08.955506 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b64dcb15-19af-4472-a24c-677d88bba149 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'befb5805fb0845198b49ba60f7c2b68f'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:08.956499 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0265e38-5545-490d-9602-b0a4c5195d1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3575bf08e1564446a9d2ada5ed5dc40e, user_id=71459adf4edd465bafc87255a6f89637, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:08.958191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b64dcb15-19af-4472-a24c-677d88bba149 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'befb5805fb0845198b49ba60f7c2b68f'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:08.960506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0265e38-5545-490d-9602-b0a4c5195d1f admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:08.974820 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 978/1950] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:08 2022] DELETE /identity/v3/users/befb5805fb0845198b49ba60f7c2b68f => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:08.984762 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 973/1951] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:08 2022] PUT /identity/v3/projects/3575bf08e1564446a9d2ada5ed5dc40e/users/71459adf4edd465bafc87255a6f89637/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:08.984940 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a5702-df55-4223-8037-0bd9fec4bd78 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:08.986440 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a5702-df55-4223-8037-0bd9fec4bd78 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:08.986953 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a5702-df55-4223-8037-0bd9fec4bd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:08.996150 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72efb7f-f7a7-4c03-a6e1-30eaeee35118 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:08.996451 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72efb7f-f7a7-4c03-a6e1-30eaeee35118 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:08.996755 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72efb7f-f7a7-4c03-a6e1-30eaeee35118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:09.013517 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:09.020408 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-bf4a5702-df55-4223-8037-0bd9fec4bd78 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:09.022913 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-bf4a5702-df55-4223-8037-0bd9fec4bd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:09.041126 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-f72efb7f-f7a7-4c03-a6e1-30eaeee35118 None None] MFA Rules not processed for user `71459adf4edd465bafc87255a6f89637`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:09.043495 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f72efb7f-f7a7-4c03-a6e1-30eaeee35118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:09.046876 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:09.098636 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 979/1952] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:09.101931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a5702-df55-4223-8037-0bd9fec4bd78 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:09.101931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-bf4a5702-df55-4223-8037-0bd9fec4bd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:09.112912 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a5702-df55-4223-8037-0bd9fec4bd78 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:09.118386 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39aec95-8c01-4c77-ba65-6e1bd5488242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:09.119597 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39aec95-8c01-4c77-ba65-6e1bd5488242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:09.119597 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39aec95-8c01-4c77-ba65-6e1bd5488242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:09.120002 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39aec95-8c01-4c77-ba65-6e1bd5488242 admin admin] PATH_INFO: `/v3/users/8392f3dc030b40afa466e3167b8a3ac0` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:09.122178 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39aec95-8c01-4c77-ba65-6e1bd5488242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8392f3dc030b40afa466e3167b8a3ac0)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:09.124424 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39aec95-8c01-4c77-ba65-6e1bd5488242 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:09.132901 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 974/1953] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:09.133759 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72efb7f-f7a7-4c03-a6e1-30eaeee35118 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:09.135747 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f72efb7f-f7a7-4c03-a6e1-30eaeee35118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:09.190850 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b39aec95-8c01-4c77-ba65-6e1bd5488242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8392f3dc030b40afa466e3167b8a3ac0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:09.192073 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b39aec95-8c01-4c77-ba65-6e1bd5488242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8392f3dc030b40afa466e3167b8a3ac0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:09.201343 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72efb7f-f7a7-4c03-a6e1-30eaeee35118 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:09.205100 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dade37-3137-41e6-b91d-8f81fd5c4da5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:09.205878 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dade37-3137-41e6-b91d-8f81fd5c4da5 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:09.206198 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dade37-3137-41e6-b91d-8f81fd5c4da5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:09.206605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dade37-3137-41e6-b91d-8f81fd5c4da5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:09.208086 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b39aec95-8c01-4c77-ba65-6e1bd5488242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8392f3dc030b40afa466e3167b8a3ac0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:09.216579 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f7dade37-3137-41e6-b91d-8f81fd5c4da5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:09.219086 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b39aec95-8c01-4c77-ba65-6e1bd5488242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8392f3dc030b40afa466e3167b8a3ac0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:09.220707 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b39aec95-8c01-4c77-ba65-6e1bd5488242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8392f3dc030b40afa466e3167b8a3ac0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:09.236707 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dade37-3137-41e6-b91d-8f81fd5c4da5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:09.238592 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dade37-3137-41e6-b91d-8f81fd5c4da5 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:09.239379 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 980/1954] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:09 2022] DELETE /identity/v3/users/8392f3dc030b40afa466e3167b8a3ac0 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:09.240484 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39aec95-8c01-4c77-ba65-6e1bd5488242 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:09.242212 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b39aec95-8c01-4c77-ba65-6e1bd5488242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:09.260662 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 975/1955] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:09.277147 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd708b4-7dc7-4a1d-8d1d-97e19198f392 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:09.280250 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd708b4-7dc7-4a1d-8d1d-97e19198f392 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:09.280771 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd708b4-7dc7-4a1d-8d1d-97e19198f392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:09.332174 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39aec95-8c01-4c77-ba65-6e1bd5488242 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:09.339302 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e181ac2-638d-4eef-a8c8-601b7f96c956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:09.341001 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e181ac2-638d-4eef-a8c8-601b7f96c956 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:09.342110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e181ac2-638d-4eef-a8c8-601b7f96c956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:09.342622 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e181ac2-638d-4eef-a8c8-601b7f96c956 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:09.343480 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e181ac2-638d-4eef-a8c8-601b7f96c956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:09.346982 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e181ac2-638d-4eef-a8c8-601b7f96c956 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:09.363324 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-5fd708b4-7dc7-4a1d-8d1d-97e19198f392 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:09.369816 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-5fd708b4-7dc7-4a1d-8d1d-97e19198f392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:09.403342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 981/1957] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:28:09 2022] POST /identity/v3/projects => generated 389 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:09.404313 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e181ac2-638d-4eef-a8c8-601b7f96c956 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:09.414147 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 976/1957] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:09.415217 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd708b4-7dc7-4a1d-8d1d-97e19198f392 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:09.419458 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-5fd708b4-7dc7-4a1d-8d1d-97e19198f392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:09.453592 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:09.511132 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd708b4-7dc7-4a1d-8d1d-97e19198f392 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:09.513135 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e181ac2-638d-4eef-a8c8-601b7f96c956 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:09.522678 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b3711-1470-4fbb-8fd9-9e6f71682e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:09.523596 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b3711-1470-4fbb-8fd9-9e6f71682e65 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:09.523948 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b3711-1470-4fbb-8fd9-9e6f71682e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:09.524299 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b3711-1470-4fbb-8fd9-9e6f71682e65 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:09.525201 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b3711-1470-4fbb-8fd9-9e6f71682e65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:09.529062 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b3711-1470-4fbb-8fd9-9e6f71682e65 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:09.560103 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 982/1958] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:28:09 2022] POST /identity/v3/users => generated 301 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:09.563099 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b3711-1470-4fbb-8fd9-9e6f71682e65 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:09.568107 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:09.575846 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8d377-64fa-4e7d-9be7-ad1d0c29e0ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:09.576988 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8d377-64fa-4e7d-9be7-ad1d0c29e0ac service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:09.577647 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8d377-64fa-4e7d-9be7-ad1d0c29e0ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:09.578096 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8d377-64fa-4e7d-9be7-ad1d0c29e0ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:09.587221 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b3711-1470-4fbb-8fd9-9e6f71682e65 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:09.590256 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af8d377-64fa-4e7d-9be7-ad1d0c29e0ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:09.592111 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af8d377-64fa-4e7d-9be7-ad1d0c29e0ac service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:09.597082 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5e949-6134-4ff6-b087-bd75e92d1680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:09.599242 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5e949-6134-4ff6-b087-bd75e92d1680 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:09.600049 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5e949-6134-4ff6-b087-bd75e92d1680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:09.600390 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5e949-6134-4ff6-b087-bd75e92d1680 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:09.606568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 977/1959] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:09.615251 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5e949-6134-4ff6-b087-bd75e92d1680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:09.621782 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5e949-6134-4ff6-b087-bd75e92d1680 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:09.643951 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 983/1960] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:09.645326 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8d377-64fa-4e7d-9be7-ad1d0c29e0ac service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:09.667167 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8d377-64fa-4e7d-9be7-ad1d0c29e0ac service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:09.679801 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df73d1-df15-48fb-9c38-8ce51aa926c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:09.680779 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df73d1-df15-48fb-9c38-8ce51aa926c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:09.681301 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df73d1-df15-48fb-9c38-8ce51aa926c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:09.681546 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df73d1-df15-48fb-9c38-8ce51aa926c0 admin admin] PATH_INFO: `/v3/projects/4cc750abfda74c198d6a136f94c63445/users/7598ba432b7d48248a7b6c9349fea8e8/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:09.714570 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df73d1-df15-48fb-9c38-8ce51aa926c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cc750abfda74c198d6a136f94c63445, user_id=7598ba432b7d48248a7b6c9349fea8e8, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:09.717289 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df73d1-df15-48fb-9c38-8ce51aa926c0 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:09.749581 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 978/1961] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:09 2022] PUT /identity/v3/projects/4cc750abfda74c198d6a136f94c63445/users/7598ba432b7d48248a7b6c9349fea8e8/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:09.753558 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5e949-6134-4ff6-b087-bd75e92d1680 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:09.766787 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5e949-6134-4ff6-b087-bd75e92d1680 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:09.858644 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc7496-5d69-4f6e-864c-6fdeb12688f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:09.859583 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc7496-5d69-4f6e-864c-6fdeb12688f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:09.859964 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc7496-5d69-4f6e-864c-6fdeb12688f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:09.860372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc7496-5d69-4f6e-864c-6fdeb12688f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:09.861467 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc7496-5d69-4f6e-864c-6fdeb12688f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:09.863562 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc7496-5d69-4f6e-864c-6fdeb12688f5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:09.884639 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 984/1962] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 04:28:09.886519 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df73d1-df15-48fb-9c38-8ce51aa926c0 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:09.906136 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df73d1-df15-48fb-9c38-8ce51aa926c0 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:09.915116 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838ac59-3a10-4899-953a-00c0aa5a4431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:09.916624 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838ac59-3a10-4899-953a-00c0aa5a4431 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:09.916883 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838ac59-3a10-4899-953a-00c0aa5a4431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:09.917829 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838ac59-3a10-4899-953a-00c0aa5a4431 admin admin] PATH_INFO: `/v3/projects/4cc750abfda74c198d6a136f94c63445/users/7598ba432b7d48248a7b6c9349fea8e8/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:09.922946 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838ac59-3a10-4899-953a-00c0aa5a4431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cc750abfda74c198d6a136f94c63445, user_id=7598ba432b7d48248a7b6c9349fea8e8, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:09.926161 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838ac59-3a10-4899-953a-00c0aa5a4431 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:09.975477 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc7496-5d69-4f6e-864c-6fdeb12688f5 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:09.979020 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-71dc7496-5d69-4f6e-864c-6fdeb12688f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:09.979355 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 979/1963] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:09 2022] PUT /identity/v3/projects/4cc750abfda74c198d6a136f94c63445/users/7598ba432b7d48248a7b6c9349fea8e8/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:09.990452 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1aa94f-3557-4cc5-a9b0-10bb10a8dabc None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:09.990705 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1aa94f-3557-4cc5-a9b0-10bb10a8dabc None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:09.990993 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1aa94f-3557-4cc5-a9b0-10bb10a8dabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:10.036454 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc7496-5d69-4f6e-864c-6fdeb12688f5 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:10.077323 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-df1aa94f-3557-4cc5-a9b0-10bb10a8dabc None None] MFA Rules not processed for user `7598ba432b7d48248a7b6c9349fea8e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:10.082881 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-df1aa94f-3557-4cc5-a9b0-10bb10a8dabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:10.150449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd55c2-74cc-4d1c-949b-fd2a42e324cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:10.152667 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd55c2-74cc-4d1c-949b-fd2a42e324cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:10.153105 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd55c2-74cc-4d1c-949b-fd2a42e324cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:10.153854 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd55c2-74cc-4d1c-949b-fd2a42e324cd admin admin] PATH_INFO: `/v3/projects/084520030c5d4d58a7f5d48c456df0ab` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:10.154931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd55c2-74cc-4d1c-949b-fd2a42e324cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=084520030c5d4d58a7f5d48c456df0ab)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:10.157052 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd55c2-74cc-4d1c-949b-fd2a42e324cd admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:10.217860 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 980/1964] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:09 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:28:10.232015 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1aa94f-3557-4cc5-a9b0-10bb10a8dabc None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:10.234008 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-df1aa94f-3557-4cc5-a9b0-10bb10a8dabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:10.240390 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:10.258623 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0fbd55c2-74cc-4d1c-949b-fd2a42e324cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '084520030c5d4d58a7f5d48c456df0ab', 'request_id': 'req-0fbd55c2-74cc-4d1c-949b-fd2a42e324cd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:10.273152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0fbd55c2-74cc-4d1c-949b-fd2a42e324cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '084520030c5d4d58a7f5d48c456df0ab', 'request_id': 'req-0fbd55c2-74cc-4d1c-949b-fd2a42e324cd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:10.289517 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0fbd55c2-74cc-4d1c-949b-fd2a42e324cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '084520030c5d4d58a7f5d48c456df0ab', 'request_id': 'req-0fbd55c2-74cc-4d1c-949b-fd2a42e324cd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:10.307088 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0fbd55c2-74cc-4d1c-949b-fd2a42e324cd admin admin] The token cache is being invalidate because project 084520030c5d4d58a7f5d48c456df0ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:10.307450 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0fbd55c2-74cc-4d1c-949b-fd2a42e324cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:10.309195 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0fbd55c2-74cc-4d1c-949b-fd2a42e324cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:10.312590 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 985/1965] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:09 2022] DELETE /identity/v3/projects/084520030c5d4d58a7f5d48c456df0ab => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:28:10.316838 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1aa94f-3557-4cc5-a9b0-10bb10a8dabc None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:10.316991 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd55c2-74cc-4d1c-949b-fd2a42e324cd admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:10.329287 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0fbd55c2-74cc-4d1c-949b-fd2a42e324cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:10.437935 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd55c2-74cc-4d1c-949b-fd2a42e324cd admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:10.444341 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424806f-1d90-4f0f-8fad-5084776adab2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:10.444779 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f7e27-0dc4-4f79-a3eb-4d1e63c4ce7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:10.445540 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424806f-1d90-4f0f-8fad-5084776adab2 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:10.446091 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f7e27-0dc4-4f79-a3eb-4d1e63c4ce7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:10.446321 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424806f-1d90-4f0f-8fad-5084776adab2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:10.446496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f7e27-0dc4-4f79-a3eb-4d1e63c4ce7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:10.446848 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f7e27-0dc4-4f79-a3eb-4d1e63c4ce7b admin admin] PATH_INFO: `/v3/users/953d031dc8bb4fa28a83092ba80aa287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:10.447026 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424806f-1d90-4f0f-8fad-5084776adab2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:10.449437 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f7e27-0dc4-4f79-a3eb-4d1e63c4ce7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=953d031dc8bb4fa28a83092ba80aa287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:10.451122 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7424806f-1d90-4f0f-8fad-5084776adab2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:10.452151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f7e27-0dc4-4f79-a3eb-4d1e63c4ce7b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:10.469266 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:10.579672 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-980f7e27-0dc4-4f79-a3eb-4d1e63c4ce7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '953d031dc8bb4fa28a83092ba80aa287'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:10.579672 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-980f7e27-0dc4-4f79-a3eb-4d1e63c4ce7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '953d031dc8bb4fa28a83092ba80aa287'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:10.584458 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424806f-1d90-4f0f-8fad-5084776adab2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:10.586489 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424806f-1d90-4f0f-8fad-5084776adab2 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:10.596861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-980f7e27-0dc4-4f79-a3eb-4d1e63c4ce7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '953d031dc8bb4fa28a83092ba80aa287'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:10.601337 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 981/1966] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:10 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:28:10.602393 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424806f-1d90-4f0f-8fad-5084776adab2 service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:10.603784 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7424806f-1d90-4f0f-8fad-5084776adab2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:10.610208 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-980f7e27-0dc4-4f79-a3eb-4d1e63c4ce7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '953d031dc8bb4fa28a83092ba80aa287'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:10.611496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-980f7e27-0dc4-4f79-a3eb-4d1e63c4ce7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '953d031dc8bb4fa28a83092ba80aa287'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:10.619048 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424806f-1d90-4f0f-8fad-5084776adab2 service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:10.629756 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda1d57-7fc0-4cec-b36e-d069c5479311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:10.630735 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda1d57-7fc0-4cec-b36e-d069c5479311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:10.632708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda1d57-7fc0-4cec-b36e-d069c5479311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:10.633014 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda1d57-7fc0-4cec-b36e-d069c5479311 admin admin] PATH_INFO: `/v3/projects/23b754907f1f443ba19e9ef742fabfc5` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:10.634743 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda1d57-7fc0-4cec-b36e-d069c5479311 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23b754907f1f443ba19e9ef742fabfc5)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:10.638241 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda1d57-7fc0-4cec-b36e-d069c5479311 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:10.644315 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 986/1967] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:10 2022] DELETE /identity/v3/users/953d031dc8bb4fa28a83092ba80aa287 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:10.725923 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7cda1d57-7fc0-4cec-b36e-d069c5479311 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23b754907f1f443ba19e9ef742fabfc5', 'request_id': 'req-7cda1d57-7fc0-4cec-b36e-d069c5479311'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:10.750053 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7cda1d57-7fc0-4cec-b36e-d069c5479311 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23b754907f1f443ba19e9ef742fabfc5', 'request_id': 'req-7cda1d57-7fc0-4cec-b36e-d069c5479311'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:10.764128 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7cda1d57-7fc0-4cec-b36e-d069c5479311 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23b754907f1f443ba19e9ef742fabfc5', 'request_id': 'req-7cda1d57-7fc0-4cec-b36e-d069c5479311'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:10.787244 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7cda1d57-7fc0-4cec-b36e-d069c5479311 admin admin] The token cache is being invalidate because project 23b754907f1f443ba19e9ef742fabfc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:10.787599 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7cda1d57-7fc0-4cec-b36e-d069c5479311 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:10.795129 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7cda1d57-7fc0-4cec-b36e-d069c5479311 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:10.800598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 982/1968] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:10 2022] DELETE /identity/v3/projects/23b754907f1f443ba19e9ef742fabfc5 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:10.806382 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f7e27-0dc4-4f79-a3eb-4d1e63c4ce7b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:10.810781 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-980f7e27-0dc4-4f79-a3eb-4d1e63c4ce7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:10.921181 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:10.959526 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f7e27-0dc4-4f79-a3eb-4d1e63c4ce7b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:10.983181 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda1d57-7fc0-4cec-b36e-d069c5479311 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:10.984823 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7cda1d57-7fc0-4cec-b36e-d069c5479311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:11.155247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda1d57-7fc0-4cec-b36e-d069c5479311 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:11.171298 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a25c03-c013-47ea-90fe-5a53e149e478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:11.173656 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d3b0f-eddc-48e4-98de-0df4bdad9dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:11.174283 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a25c03-c013-47ea-90fe-5a53e149e478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:11.174702 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a25c03-c013-47ea-90fe-5a53e149e478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:11.175126 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a25c03-c013-47ea-90fe-5a53e149e478 admin admin] PATH_INFO: `/v3/users/71459adf4edd465bafc87255a6f89637` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:11.177742 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d3b0f-eddc-48e4-98de-0df4bdad9dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:11.178269 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d3b0f-eddc-48e4-98de-0df4bdad9dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:11.178695 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d3b0f-eddc-48e4-98de-0df4bdad9dec admin admin] PATH_INFO: `/v3/users/f8aa87513df84f8ba5c46d15fdd9a8e5` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:11.179226 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a25c03-c013-47ea-90fe-5a53e149e478 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71459adf4edd465bafc87255a6f89637)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:11.184026 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a25c03-c013-47ea-90fe-5a53e149e478 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:11.184742 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d3b0f-eddc-48e4-98de-0df4bdad9dec admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8aa87513df84f8ba5c46d15fdd9a8e5)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:11.191212 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d3b0f-eddc-48e4-98de-0df4bdad9dec admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:11.269218 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:11.318186 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f2a25c03-c013-47ea-90fe-5a53e149e478 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71459adf4edd465bafc87255a6f89637'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:11.320808 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f2a25c03-c013-47ea-90fe-5a53e149e478 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71459adf4edd465bafc87255a6f89637'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:11.328474 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d23d3b0f-eddc-48e4-98de-0df4bdad9dec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8aa87513df84f8ba5c46d15fdd9a8e5'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:11.330758 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d23d3b0f-eddc-48e4-98de-0df4bdad9dec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8aa87513df84f8ba5c46d15fdd9a8e5'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:11.367824 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f2a25c03-c013-47ea-90fe-5a53e149e478 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71459adf4edd465bafc87255a6f89637'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:11.381909 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d23d3b0f-eddc-48e4-98de-0df4bdad9dec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8aa87513df84f8ba5c46d15fdd9a8e5'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:11.391730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f2a25c03-c013-47ea-90fe-5a53e149e478 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71459adf4edd465bafc87255a6f89637'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:11.400663 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d23d3b0f-eddc-48e4-98de-0df4bdad9dec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8aa87513df84f8ba5c46d15fdd9a8e5'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:11.401724 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d23d3b0f-eddc-48e4-98de-0df4bdad9dec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8aa87513df84f8ba5c46d15fdd9a8e5'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:11.413097 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f2a25c03-c013-47ea-90fe-5a53e149e478 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71459adf4edd465bafc87255a6f89637'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:11.422975 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 987/1969] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:10 2022] DELETE /identity/v3/users/f8aa87513df84f8ba5c46d15fdd9a8e5 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:11.430944 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 983/1970] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:10 2022] DELETE /identity/v3/users/71459adf4edd465bafc87255a6f89637 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:11.436135 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2251bd-c5be-4d64-b62a-ddd064ed5584 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:11.437555 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2251bd-c5be-4d64-b62a-ddd064ed5584 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:11.438684 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2251bd-c5be-4d64-b62a-ddd064ed5584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:11.463023 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-da2251bd-c5be-4d64-b62a-ddd064ed5584 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:11.464316 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-da2251bd-c5be-4d64-b62a-ddd064ed5584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:11.491089 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a25c03-c013-47ea-90fe-5a53e149e478 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:11.493517 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f2a25c03-c013-47ea-90fe-5a53e149e478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:11.568578 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 988/1971] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:11.573808 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2251bd-c5be-4d64-b62a-ddd064ed5584 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:11.576156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-da2251bd-c5be-4d64-b62a-ddd064ed5584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:11.601962 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:11.645532 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a25c03-c013-47ea-90fe-5a53e149e478 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:11.659741 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b1357-c5ef-4021-b59b-e9e971c95091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:11.660629 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b1357-c5ef-4021-b59b-e9e971c95091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:11.660909 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b1357-c5ef-4021-b59b-e9e971c95091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:11.661716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b1357-c5ef-4021-b59b-e9e971c95091 admin admin] PATH_INFO: `/v3/projects/812e656a8ace44c6a92580cddbe043a2` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:11.664460 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b1357-c5ef-4021-b59b-e9e971c95091 admin admin] RBAC: Authorizing `identity:delete_project(project_id=812e656a8ace44c6a92580cddbe043a2)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:11.666691 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b1357-c5ef-4021-b59b-e9e971c95091 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:11.670004 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2251bd-c5be-4d64-b62a-ddd064ed5584 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:11.701000 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e0f81-b08a-4460-b05d-d6ace1a43ae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:11.704874 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e0f81-b08a-4460-b05d-d6ace1a43ae8 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:11.705440 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e0f81-b08a-4460-b05d-d6ace1a43ae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:11.706199 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e0f81-b08a-4460-b05d-d6ace1a43ae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:11.729028 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e0f81-b08a-4460-b05d-d6ace1a43ae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:11.733129 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e0f81-b08a-4460-b05d-d6ace1a43ae8 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:11.743414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-011b1357-c5ef-4021-b59b-e9e971c95091 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '812e656a8ace44c6a92580cddbe043a2', 'request_id': 'req-011b1357-c5ef-4021-b59b-e9e971c95091'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:11.755250 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-011b1357-c5ef-4021-b59b-e9e971c95091 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '812e656a8ace44c6a92580cddbe043a2', 'request_id': 'req-011b1357-c5ef-4021-b59b-e9e971c95091'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:11.756777 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 989/1972] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:28:11.764477 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-011b1357-c5ef-4021-b59b-e9e971c95091 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '812e656a8ace44c6a92580cddbe043a2', 'request_id': 'req-011b1357-c5ef-4021-b59b-e9e971c95091'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:11.780734 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-011b1357-c5ef-4021-b59b-e9e971c95091 admin admin] The token cache is being invalidate because project 812e656a8ace44c6a92580cddbe043a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:11.781029 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-011b1357-c5ef-4021-b59b-e9e971c95091 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:11.781691 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-011b1357-c5ef-4021-b59b-e9e971c95091 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:11.787528 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 984/1973] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:11 2022] DELETE /identity/v3/projects/812e656a8ace44c6a92580cddbe043a2 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:11.789017 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57e513-f08e-4628-8a99-7d948f9679b6 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:11.789322 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57e513-f08e-4628-8a99-7d948f9679b6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:11.789702 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57e513-f08e-4628-8a99-7d948f9679b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:11.831480 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-fd57e513-f08e-4628-8a99-7d948f9679b6 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:11.831480 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-fd57e513-f08e-4628-8a99-7d948f9679b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:11.971701 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cabe1c-a33d-4176-9fd9-84daa9a3c97a None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:11.972230 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cabe1c-a33d-4176-9fd9-84daa9a3c97a None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:11.972790 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cabe1c-a33d-4176-9fd9-84daa9a3c97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:11.982551 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 990/1974] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:28:11.999203 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-e5cabe1c-a33d-4176-9fd9-84daa9a3c97a None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:12.001421 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e5cabe1c-a33d-4176-9fd9-84daa9a3c97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:12.025302 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 985/1975] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:12.030504 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57e513-f08e-4628-8a99-7d948f9679b6 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:12.047143 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57e513-f08e-4628-8a99-7d948f9679b6 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:12.061109 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16684f0d-1df2-4029-b5be-5c4b676b501f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:12.062214 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16684f0d-1df2-4029-b5be-5c4b676b501f admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:12.062933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16684f0d-1df2-4029-b5be-5c4b676b501f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:12.063078 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16684f0d-1df2-4029-b5be-5c4b676b501f admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:12.066837 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16684f0d-1df2-4029-b5be-5c4b676b501f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:28:12.067276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16684f0d-1df2-4029-b5be-5c4b676b501f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:12.069008 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16684f0d-1df2-4029-b5be-5c4b676b501f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:12.102840 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cabe1c-a33d-4176-9fd9-84daa9a3c97a None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:12.117159 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 991/1976] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:28:12.117665 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cabe1c-a33d-4176-9fd9-84daa9a3c97a None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:12.144414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7f0b5-a41f-4f8a-ab76-0ee7dfd30738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:12.145183 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7f0b5-a41f-4f8a-ab76-0ee7dfd30738 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:12.145469 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7f0b5-a41f-4f8a-ab76-0ee7dfd30738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:12.145744 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7f0b5-a41f-4f8a-ab76-0ee7dfd30738 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:12.146561 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7f0b5-a41f-4f8a-ab76-0ee7dfd30738 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:12.148419 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7f0b5-a41f-4f8a-ab76-0ee7dfd30738 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:12.164028 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16684f0d-1df2-4029-b5be-5c4b676b501f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:12.165837 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-16684f0d-1df2-4029-b5be-5c4b676b501f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:12.196903 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16684f0d-1df2-4029-b5be-5c4b676b501f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:12.204402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d44dc-3908-452b-a9df-5329d34a31f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:12.205240 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d44dc-3908-452b-a9df-5329d34a31f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:12.207485 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d44dc-3908-452b-a9df-5329d34a31f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:12.207859 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d44dc-3908-452b-a9df-5329d34a31f7 admin admin] PATH_INFO: `/v3/users/946f78685e5b49938165065b16c139c3` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:12.211368 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d44dc-3908-452b-a9df-5329d34a31f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=946f78685e5b49938165065b16c139c3)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:12.220719 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d44dc-3908-452b-a9df-5329d34a31f7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:12.220897 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 986/1977] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:28:12 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:28:12.225183 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7f0b5-a41f-4f8a-ab76-0ee7dfd30738 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:12.248609 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:12.312938 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-276d44dc-3908-452b-a9df-5329d34a31f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '946f78685e5b49938165065b16c139c3'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:12.314096 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-276d44dc-3908-452b-a9df-5329d34a31f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '946f78685e5b49938165065b16c139c3'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:12.330867 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-276d44dc-3908-452b-a9df-5329d34a31f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '946f78685e5b49938165065b16c139c3'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:12.339742 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-276d44dc-3908-452b-a9df-5329d34a31f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '946f78685e5b49938165065b16c139c3'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:12.340405 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-276d44dc-3908-452b-a9df-5329d34a31f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '946f78685e5b49938165065b16c139c3'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:12.340633 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7f0b5-a41f-4f8a-ab76-0ee7dfd30738 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:12.345585 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee725f70-bac6-47f2-9a0e-c2f4f009cef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:12.346380 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee725f70-bac6-47f2-9a0e-c2f4f009cef4 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:12.346734 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee725f70-bac6-47f2-9a0e-c2f4f009cef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:12.347219 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee725f70-bac6-47f2-9a0e-c2f4f009cef4 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:12.348008 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee725f70-bac6-47f2-9a0e-c2f4f009cef4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:12.350085 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee725f70-bac6-47f2-9a0e-c2f4f009cef4 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:12.355516 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 992/1978] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:12 2022] DELETE /identity/v3/users/946f78685e5b49938165065b16c139c3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:12.356161 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d44dc-3908-452b-a9df-5329d34a31f7 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:12.357576 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-276d44dc-3908-452b-a9df-5329d34a31f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:12.376274 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 987/1979] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:28:12 2022] POST /identity/v3/users => generated 287 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:28:12.379453 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733a526-62f4-40f8-abf2-5679a8535690 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:12.379872 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733a526-62f4-40f8-abf2-5679a8535690 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:12.380204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733a526-62f4-40f8-abf2-5679a8535690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:12.381352 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:12.403766 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-1733a526-62f4-40f8-abf2-5679a8535690 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:12.405082 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-1733a526-62f4-40f8-abf2-5679a8535690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:12.437661 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d44dc-3908-452b-a9df-5329d34a31f7 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:12.443123 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeefd4c-8aa0-4cdf-8935-d6f2b5a13dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:12.444718 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeefd4c-8aa0-4cdf-8935-d6f2b5a13dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:12.445185 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeefd4c-8aa0-4cdf-8935-d6f2b5a13dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:12.445660 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeefd4c-8aa0-4cdf-8935-d6f2b5a13dce admin admin] PATH_INFO: `/v3/projects/3575bf08e1564446a9d2ada5ed5dc40e` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:12.447109 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeefd4c-8aa0-4cdf-8935-d6f2b5a13dce admin admin] RBAC: Authorizing `identity:delete_project(project_id=3575bf08e1564446a9d2ada5ed5dc40e)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:12.450017 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeefd4c-8aa0-4cdf-8935-d6f2b5a13dce admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:12.493330 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 988/1980] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:12.494639 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733a526-62f4-40f8-abf2-5679a8535690 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:12.496275 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-1733a526-62f4-40f8-abf2-5679a8535690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:12.511164 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733a526-62f4-40f8-abf2-5679a8535690 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:12.513717 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9aeefd4c-8aa0-4cdf-8935-d6f2b5a13dce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3575bf08e1564446a9d2ada5ed5dc40e', 'request_id': 'req-9aeefd4c-8aa0-4cdf-8935-d6f2b5a13dce'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:12.520408 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9aeefd4c-8aa0-4cdf-8935-d6f2b5a13dce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3575bf08e1564446a9d2ada5ed5dc40e', 'request_id': 'req-9aeefd4c-8aa0-4cdf-8935-d6f2b5a13dce'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:12.534183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9aeefd4c-8aa0-4cdf-8935-d6f2b5a13dce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3575bf08e1564446a9d2ada5ed5dc40e', 'request_id': 'req-9aeefd4c-8aa0-4cdf-8935-d6f2b5a13dce'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:12.558938 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9aeefd4c-8aa0-4cdf-8935-d6f2b5a13dce admin admin] The token cache is being invalidate because project 3575bf08e1564446a9d2ada5ed5dc40e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:12.559195 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9aeefd4c-8aa0-4cdf-8935-d6f2b5a13dce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:12.560005 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9aeefd4c-8aa0-4cdf-8935-d6f2b5a13dce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:12.563064 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 993/1981] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:12 2022] DELETE /identity/v3/projects/3575bf08e1564446a9d2ada5ed5dc40e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:12.564091 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeefd4c-8aa0-4cdf-8935-d6f2b5a13dce admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:12.567315 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9aeefd4c-8aa0-4cdf-8935-d6f2b5a13dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:12.601733 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68af8aa-2f50-4858-bbc3-56e4b4512f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:12.602623 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68af8aa-2f50-4858-bbc3-56e4b4512f3a admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:12.603191 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68af8aa-2f50-4858-bbc3-56e4b4512f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:12.603490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68af8aa-2f50-4858-bbc3-56e4b4512f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:12.604280 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68af8aa-2f50-4858-bbc3-56e4b4512f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:12.606777 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68af8aa-2f50-4858-bbc3-56e4b4512f3a admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:12.623953 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 989/1982] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:12.623953 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68af8aa-2f50-4858-bbc3-56e4b4512f3a admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:12.623953 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d68af8aa-2f50-4858-bbc3-56e4b4512f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:12.643366 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68af8aa-2f50-4858-bbc3-56e4b4512f3a admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:12.649002 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3e1fb-f00d-4fd0-832b-b2829f6fbfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:12.650836 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3e1fb-f00d-4fd0-832b-b2829f6fbfd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:12.651126 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3e1fb-f00d-4fd0-832b-b2829f6fbfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:12.651442 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3e1fb-f00d-4fd0-832b-b2829f6fbfd1 admin admin] PATH_INFO: `/v3/users/7598ba432b7d48248a7b6c9349fea8e8` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:12.652746 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3e1fb-f00d-4fd0-832b-b2829f6fbfd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7598ba432b7d48248a7b6c9349fea8e8)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:12.655223 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3e1fb-f00d-4fd0-832b-b2829f6fbfd1 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:12.672367 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeefd4c-8aa0-4cdf-8935-d6f2b5a13dce admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:12.678100 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fea537-46e3-478e-923c-bf20f060b09d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:12.679331 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fea537-46e3-478e-923c-bf20f060b09d service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:12.680003 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fea537-46e3-478e-923c-bf20f060b09d service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:12.680420 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fea537-46e3-478e-923c-bf20f060b09d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:12.683139 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-83fea537-46e3-478e-923c-bf20f060b09d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:12.698176 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fea537-46e3-478e-923c-bf20f060b09d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:12.700268 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fea537-46e3-478e-923c-bf20f060b09d service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:12.705218 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:12.712858 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 994/1983] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:12.713516 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fea537-46e3-478e-923c-bf20f060b09d service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:12.715058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-83fea537-46e3-478e-923c-bf20f060b09d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:12.728830 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fea537-46e3-478e-923c-bf20f060b09d service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:12.738514 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8df33-e0e2-4cde-9d0b-17f8e7bd3306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:12.741244 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8df33-e0e2-4cde-9d0b-17f8e7bd3306 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:12.741571 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8df33-e0e2-4cde-9d0b-17f8e7bd3306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:12.741848 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8df33-e0e2-4cde-9d0b-17f8e7bd3306 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:12.742609 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8df33-e0e2-4cde-9d0b-17f8e7bd3306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:12.745684 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8df33-e0e2-4cde-9d0b-17f8e7bd3306 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:12.758252 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ffc3e1fb-f00d-4fd0-832b-b2829f6fbfd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7598ba432b7d48248a7b6c9349fea8e8'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:12.760545 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ffc3e1fb-f00d-4fd0-832b-b2829f6fbfd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7598ba432b7d48248a7b6c9349fea8e8'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:12.766315 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 995/1984] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:12.767193 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8df33-e0e2-4cde-9d0b-17f8e7bd3306 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:12.773147 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2bd8df33-e0e2-4cde-9d0b-17f8e7bd3306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:12.790155 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ffc3e1fb-f00d-4fd0-832b-b2829f6fbfd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7598ba432b7d48248a7b6c9349fea8e8'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:12.804481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8df33-e0e2-4cde-9d0b-17f8e7bd3306 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:12.805867 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ffc3e1fb-f00d-4fd0-832b-b2829f6fbfd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7598ba432b7d48248a7b6c9349fea8e8'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:12.815060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca68dc11-22f6-43ce-af82-b18fa3be2965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:12.816013 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68dc11-22f6-43ce-af82-b18fa3be2965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:12.816303 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68dc11-22f6-43ce-af82-b18fa3be2965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:12.816829 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68dc11-22f6-43ce-af82-b18fa3be2965 admin admin] PATH_INFO: `/v3/projects/a64d7cd43b9342abb8247559feaf2b13` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:12.818528 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ffc3e1fb-f00d-4fd0-832b-b2829f6fbfd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7598ba432b7d48248a7b6c9349fea8e8'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:12.819504 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca68dc11-22f6-43ce-af82-b18fa3be2965 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a64d7cd43b9342abb8247559feaf2b13)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:12.826296 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca68dc11-22f6-43ce-af82-b18fa3be2965 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:12.831592 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 990/1985] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:12 2022] DELETE /identity/v3/users/7598ba432b7d48248a7b6c9349fea8e8 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:12.832504 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3e1fb-f00d-4fd0-832b-b2829f6fbfd1 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:12.834656 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-ffc3e1fb-f00d-4fd0-832b-b2829f6fbfd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:12.894280 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:12.912925 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ca68dc11-22f6-43ce-af82-b18fa3be2965 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a64d7cd43b9342abb8247559feaf2b13', 'request_id': 'req-ca68dc11-22f6-43ce-af82-b18fa3be2965'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:12.922316 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ca68dc11-22f6-43ce-af82-b18fa3be2965 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a64d7cd43b9342abb8247559feaf2b13', 'request_id': 'req-ca68dc11-22f6-43ce-af82-b18fa3be2965'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:12.934196 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ca68dc11-22f6-43ce-af82-b18fa3be2965 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a64d7cd43b9342abb8247559feaf2b13', 'request_id': 'req-ca68dc11-22f6-43ce-af82-b18fa3be2965'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:12.952433 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ca68dc11-22f6-43ce-af82-b18fa3be2965 admin admin] The token cache is being invalidate because project a64d7cd43b9342abb8247559feaf2b13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:12.952433 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ca68dc11-22f6-43ce-af82-b18fa3be2965 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:12.954103 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ca68dc11-22f6-43ce-af82-b18fa3be2965 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:12.958260 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 996/1986] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:12 2022] DELETE /identity/v3/projects/a64d7cd43b9342abb8247559feaf2b13 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:12.959910 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3e1fb-f00d-4fd0-832b-b2829f6fbfd1 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:12.961060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae81c27-3b27-4427-a3c7-d202c404091b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:12.962295 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae81c27-3b27-4427-a3c7-d202c404091b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:12.962727 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae81c27-3b27-4427-a3c7-d202c404091b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:12.987016 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-3ae81c27-3b27-4427-a3c7-d202c404091b None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:12.988605 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3ae81c27-3b27-4427-a3c7-d202c404091b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:13.075082 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb443f-0214-4be9-8555-28ab03ed45be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:13.076250 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb443f-0214-4be9-8555-28ab03ed45be admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:13.077524 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb443f-0214-4be9-8555-28ab03ed45be admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:13.078430 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb443f-0214-4be9-8555-28ab03ed45be admin admin] PATH_INFO: `/v3/projects/a8ba1c37cc3e48ae938dd9ed007bf661/users/c095c3b52d7148d889008d862e4370b8/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:13.080473 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 997/1987] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:13.082104 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d86761-762d-4fe5-95b8-3f5733494707 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:13.082401 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d86761-762d-4fe5-95b8-3f5733494707 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:13.084699 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d86761-762d-4fe5-95b8-3f5733494707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:13.099590 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb443f-0214-4be9-8555-28ab03ed45be admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8ba1c37cc3e48ae938dd9ed007bf661, user_id=c095c3b52d7148d889008d862e4370b8, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:13.102583 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb443f-0214-4be9-8555-28ab03ed45be admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:13.106293 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c8d86761-762d-4fe5-95b8-3f5733494707 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:13.108096 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c8d86761-762d-4fe5-95b8-3f5733494707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:13.123012 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 998/1988] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:13.123953 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d86761-762d-4fe5-95b8-3f5733494707 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:13.124401 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 991/1989] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:12 2022] PUT /identity/v3/projects/a8ba1c37cc3e48ae938dd9ed007bf661/users/c095c3b52d7148d889008d862e4370b8/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:13.135068 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d86761-762d-4fe5-95b8-3f5733494707 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:13.136222 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b56d8-6f87-46d9-a314-175f87b3bc7e None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:13.137255 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b56d8-6f87-46d9-a314-175f87b3bc7e None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:13.138322 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b56d8-6f87-46d9-a314-175f87b3bc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:13.189743 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-e28b56d8-6f87-46d9-a314-175f87b3bc7e None None] MFA Rules not processed for user `c095c3b52d7148d889008d862e4370b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:13.191023 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e28b56d8-6f87-46d9-a314-175f87b3bc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:13.239171 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:13.271600 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f650c5-906c-4446-a3d2-6a4e46a13258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:13.272314 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f650c5-906c-4446-a3d2-6a4e46a13258 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:13.272603 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f650c5-906c-4446-a3d2-6a4e46a13258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:13.273265 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f650c5-906c-4446-a3d2-6a4e46a13258 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:13.274039 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f650c5-906c-4446-a3d2-6a4e46a13258 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:28:13.274354 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f650c5-906c-4446-a3d2-6a4e46a13258 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:13.276008 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f650c5-906c-4446-a3d2-6a4e46a13258 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:13.296679 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 999/1990] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:28:13.296679 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f650c5-906c-4446-a3d2-6a4e46a13258 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:13.297161 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a3f650c5-906c-4446-a3d2-6a4e46a13258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:13.316385 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 992/1991] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:28:13.317330 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b56d8-6f87-46d9-a314-175f87b3bc7e None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:13.318739 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f650c5-906c-4446-a3d2-6a4e46a13258 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:13.330023 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91f577-1e97-4fb5-9fb1-55f9b357ecdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:13.330980 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91f577-1e97-4fb5-9fb1-55f9b357ecdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:13.331271 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91f577-1e97-4fb5-9fb1-55f9b357ecdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:13.331550 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91f577-1e97-4fb5-9fb1-55f9b357ecdc admin admin] PATH_INFO: `/v3/projects/bdd695ca007e4f0dbf2061a7451b6a07` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:13.332755 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91f577-1e97-4fb5-9fb1-55f9b357ecdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdd695ca007e4f0dbf2061a7451b6a07)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:13.334307 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b56d8-6f87-46d9-a314-175f87b3bc7e None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:13.334785 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91f577-1e97-4fb5-9fb1-55f9b357ecdc admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:13.340854 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136984d-7b23-4e61-8f40-0cf684df0c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:13.341525 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136984d-7b23-4e61-8f40-0cf684df0c8e admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:13.341815 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136984d-7b23-4e61-8f40-0cf684df0c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:13.342140 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136984d-7b23-4e61-8f40-0cf684df0c8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:13.342849 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136984d-7b23-4e61-8f40-0cf684df0c8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:13.344782 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136984d-7b23-4e61-8f40-0cf684df0c8e admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:13.394213 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:13.400382 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ea91f577-1e97-4fb5-9fb1-55f9b357ecdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdd695ca007e4f0dbf2061a7451b6a07', 'request_id': 'req-ea91f577-1e97-4fb5-9fb1-55f9b357ecdc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:13.406423 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 993/1992] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:28:13 2022] POST /identity/v3/projects => generated 375 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:13.408189 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136984d-7b23-4e61-8f40-0cf684df0c8e admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:13.410883 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e136984d-7b23-4e61-8f40-0cf684df0c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:13.411151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ea91f577-1e97-4fb5-9fb1-55f9b357ecdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdd695ca007e4f0dbf2061a7451b6a07', 'request_id': 'req-ea91f577-1e97-4fb5-9fb1-55f9b357ecdc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:13.425905 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ea91f577-1e97-4fb5-9fb1-55f9b357ecdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdd695ca007e4f0dbf2061a7451b6a07', 'request_id': 'req-ea91f577-1e97-4fb5-9fb1-55f9b357ecdc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:13.458300 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ea91f577-1e97-4fb5-9fb1-55f9b357ecdc admin admin] The token cache is being invalidate because project bdd695ca007e4f0dbf2061a7451b6a07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:13.458966 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ea91f577-1e97-4fb5-9fb1-55f9b357ecdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:13.462274 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ea91f577-1e97-4fb5-9fb1-55f9b357ecdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:13.466015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1000/1993] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:13 2022] DELETE /identity/v3/projects/bdd695ca007e4f0dbf2061a7451b6a07 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:13.466582 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91f577-1e97-4fb5-9fb1-55f9b357ecdc admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:13.473046 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ea91f577-1e97-4fb5-9fb1-55f9b357ecdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:13.565417 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136984d-7b23-4e61-8f40-0cf684df0c8e admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:13.570336 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9725ae-29c6-477a-b52a-0b9e9fbe48ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:13.571162 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9725ae-29c6-477a-b52a-0b9e9fbe48ff admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:13.571456 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9725ae-29c6-477a-b52a-0b9e9fbe48ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:13.571742 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9725ae-29c6-477a-b52a-0b9e9fbe48ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:13.572846 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9725ae-29c6-477a-b52a-0b9e9fbe48ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:13.575637 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9725ae-29c6-477a-b52a-0b9e9fbe48ff admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:13.598784 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91f577-1e97-4fb5-9fb1-55f9b357ecdc admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:13.605210 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d46b13-2e8d-43da-adf4-ba00b9bb7403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:13.606230 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d46b13-2e8d-43da-adf4-ba00b9bb7403 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:13.606750 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d46b13-2e8d-43da-adf4-ba00b9bb7403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:13.607200 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d46b13-2e8d-43da-adf4-ba00b9bb7403 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:13.608274 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d46b13-2e8d-43da-adf4-ba00b9bb7403 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:13.610759 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d46b13-2e8d-43da-adf4-ba00b9bb7403 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:13.638597 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 994/1994] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:28:13 2022] POST /identity/v3/projects => generated 373 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:13.639396 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9725ae-29c6-477a-b52a-0b9e9fbe48ff admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:13.647193 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-5c9725ae-29c6-477a-b52a-0b9e9fbe48ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:13.658000 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1001/1995] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:28:13 2022] POST /identity/v3/users => generated 288 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:13.658851 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d46b13-2e8d-43da-adf4-ba00b9bb7403 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:13.661082 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-18d46b13-2e8d-43da-adf4-ba00b9bb7403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:13.684449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d46b13-2e8d-43da-adf4-ba00b9bb7403 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:13.768375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4ebbc-708f-4ea6-ba3e-c731139e3c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:13.769924 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4ebbc-708f-4ea6-ba3e-c731139e3c3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:13.770353 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4ebbc-708f-4ea6-ba3e-c731139e3c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:13.770661 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4ebbc-708f-4ea6-ba3e-c731139e3c3e admin admin] PATH_INFO: `/v3/projects/4cc750abfda74c198d6a136f94c63445` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:13.771990 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4ebbc-708f-4ea6-ba3e-c731139e3c3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cc750abfda74c198d6a136f94c63445)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:13.774365 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4ebbc-708f-4ea6-ba3e-c731139e3c3e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:13.836256 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9725ae-29c6-477a-b52a-0b9e9fbe48ff admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:13.864660 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4ef4ebbc-708f-4ea6-ba3e-c731139e3c3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cc750abfda74c198d6a136f94c63445', 'request_id': 'req-4ef4ebbc-708f-4ea6-ba3e-c731139e3c3e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:13.885710 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4ef4ebbc-708f-4ea6-ba3e-c731139e3c3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cc750abfda74c198d6a136f94c63445', 'request_id': 'req-4ef4ebbc-708f-4ea6-ba3e-c731139e3c3e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:13.889105 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=84,keystone:DELETE=11,keystone:INSERT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:13.897439 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4ef4ebbc-708f-4ea6-ba3e-c731139e3c3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cc750abfda74c198d6a136f94c63445', 'request_id': 'req-4ef4ebbc-708f-4ea6-ba3e-c731139e3c3e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:13.912738 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:13.925026 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4ef4ebbc-708f-4ea6-ba3e-c731139e3c3e admin admin] The token cache is being invalidate because project 4cc750abfda74c198d6a136f94c63445 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:13.925697 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4ef4ebbc-708f-4ea6-ba3e-c731139e3c3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:13.926503 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4ef4ebbc-708f-4ea6-ba3e-c731139e3c3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:13.928980 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1002/1996] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:13 2022] DELETE /identity/v3/projects/4cc750abfda74c198d6a136f94c63445 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:13.931558 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4ebbc-708f-4ea6-ba3e-c731139e3c3e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:13.934735 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4ef4ebbc-708f-4ea6-ba3e-c731139e3c3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:13.946924 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9217f8-cf71-4d79-a104-8819ecbeceed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:13.948540 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9217f8-cf71-4d79-a104-8819ecbeceed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:13.948823 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9217f8-cf71-4d79-a104-8819ecbeceed admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:13.949166 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9217f8-cf71-4d79-a104-8819ecbeceed admin admin] PATH_INFO: `/v3/users/2b749f2db28441d0a36e43c4d7070c3f` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:13.950532 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9217f8-cf71-4d79-a104-8819ecbeceed admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b749f2db28441d0a36e43c4d7070c3f)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:13.952606 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9217f8-cf71-4d79-a104-8819ecbeceed admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:14.016425 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4ebbc-708f-4ea6-ba3e-c731139e3c3e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:14.021802 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a1dc0-4ecb-4e86-b05a-7a9ed948f6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:14.023326 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a1dc0-4ecb-4e86-b05a-7a9ed948f6a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:14.023724 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a1dc0-4ecb-4e86-b05a-7a9ed948f6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:14.024230 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a1dc0-4ecb-4e86-b05a-7a9ed948f6a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:14.025317 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a1dc0-4ecb-4e86-b05a-7a9ed948f6a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:14.027641 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a1dc0-4ecb-4e86-b05a-7a9ed948f6a3 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:14.027953 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-bb9217f8-cf71-4d79-a104-8819ecbeceed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b749f2db28441d0a36e43c4d7070c3f'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:14.029032 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-bb9217f8-cf71-4d79-a104-8819ecbeceed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b749f2db28441d0a36e43c4d7070c3f'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:14.056786 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1003/1997] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:28:13 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:14.056786 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a1dc0-4ecb-4e86-b05a-7a9ed948f6a3 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:14.058539 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-280a1dc0-4ecb-4e86-b05a-7a9ed948f6a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:14.061420 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-bb9217f8-cf71-4d79-a104-8819ecbeceed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b749f2db28441d0a36e43c4d7070c3f'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:14.072758 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-bb9217f8-cf71-4d79-a104-8819ecbeceed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b749f2db28441d0a36e43c4d7070c3f'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:14.074835 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a1dc0-4ecb-4e86-b05a-7a9ed948f6a3 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:14.081060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765356e3-0e51-4dcd-a650-8332b67d63b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:14.083032 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765356e3-0e51-4dcd-a650-8332b67d63b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:14.083461 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765356e3-0e51-4dcd-a650-8332b67d63b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:14.083843 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765356e3-0e51-4dcd-a650-8332b67d63b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:14.084989 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765356e3-0e51-4dcd-a650-8332b67d63b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:14.086781 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765356e3-0e51-4dcd-a650-8332b67d63b0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:14.087657 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-bb9217f8-cf71-4d79-a104-8819ecbeceed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b749f2db28441d0a36e43c4d7070c3f'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:14.098233 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 995/1998] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:13 2022] DELETE /identity/v3/users/2b749f2db28441d0a36e43c4d7070c3f => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:14.099768 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87981eaf-df3b-40c7-a82f-0f8aed0e1c7c None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:14.100526 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87981eaf-df3b-40c7-a82f-0f8aed0e1c7c None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:14.100643 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1004/1999] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:14.101088 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87981eaf-df3b-40c7-a82f-0f8aed0e1c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:14.101869 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765356e3-0e51-4dcd-a650-8332b67d63b0 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:14.103933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-765356e3-0e51-4dcd-a650-8332b67d63b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:14.118880 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765356e3-0e51-4dcd-a650-8332b67d63b0 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:14.124733 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-87981eaf-df3b-40c7-a82f-0f8aed0e1c7c None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:14.126066 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-87981eaf-df3b-40c7-a82f-0f8aed0e1c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:14.206362 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b57eb2-7720-4025-952e-b3cab2058ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:14.207269 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b57eb2-7720-4025-952e-b3cab2058ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:14.207639 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b57eb2-7720-4025-952e-b3cab2058ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:14.208010 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b57eb2-7720-4025-952e-b3cab2058ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:14.209114 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b57eb2-7720-4025-952e-b3cab2058ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:14.211037 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b57eb2-7720-4025-952e-b3cab2058ad6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:14.226925 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1005/2000] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:14.227935 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b57eb2-7720-4025-952e-b3cab2058ad6 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:14.241685 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b57eb2-7720-4025-952e-b3cab2058ad6 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:14.248191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae68630-ab0c-436c-a3d2-f42afc32ee30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:14.249003 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae68630-ab0c-436c-a3d2-f42afc32ee30 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:14.249391 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae68630-ab0c-436c-a3d2-f42afc32ee30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:14.249777 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae68630-ab0c-436c-a3d2-f42afc32ee30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:14.250715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae68630-ab0c-436c-a3d2-f42afc32ee30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:14.252519 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae68630-ab0c-436c-a3d2-f42afc32ee30 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:14.267743 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1006/2001] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:14.277535 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae68630-ab0c-436c-a3d2-f42afc32ee30 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:14.278174 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 996/2002] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:14.279958 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87981eaf-df3b-40c7-a82f-0f8aed0e1c7c None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:14.291430 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87981eaf-df3b-40c7-a82f-0f8aed0e1c7c None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:14.297911 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae68630-ab0c-436c-a3d2-f42afc32ee30 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:14.298320 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b2051-ef4a-4b37-aa5f-96c094de6179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:14.299539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b2051-ef4a-4b37-aa5f-96c094de6179 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:14.300114 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b2051-ef4a-4b37-aa5f-96c094de6179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:14.300529 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b2051-ef4a-4b37-aa5f-96c094de6179 admin admin] PATH_INFO: `/v3/projects/41ac18b5799f446aa868398b394cad3a/users/f21cb1c7b1a74b9793f2f4b5f83d1e70/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:14.310249 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c3e57-8c82-41c3-b170-d175458012e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:14.310249 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c3e57-8c82-41c3-b170-d175458012e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:14.310249 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c3e57-8c82-41c3-b170-d175458012e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:14.310249 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c3e57-8c82-41c3-b170-d175458012e9 admin admin] PATH_INFO: `/v3/projects/64b901129a7649a687308af4fec67ee2/users/4e474469d87f4a63b615ab36d2764b33/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:14.322641 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800b2051-ef4a-4b37-aa5f-96c094de6179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ac18b5799f446aa868398b394cad3a, user_id=f21cb1c7b1a74b9793f2f4b5f83d1e70, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:14.325583 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800b2051-ef4a-4b37-aa5f-96c094de6179 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:14.327466 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c3e57-8c82-41c3-b170-d175458012e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b901129a7649a687308af4fec67ee2, user_id=4e474469d87f4a63b615ab36d2764b33, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:14.347803 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 997/2003] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:14 2022] PUT /identity/v3/projects/41ac18b5799f446aa868398b394cad3a/users/f21cb1c7b1a74b9793f2f4b5f83d1e70/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:14.349449 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15c475-f197-47b5-a3fb-8e1100a9bf9c None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:14.350449 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15c475-f197-47b5-a3fb-8e1100a9bf9c None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:14.350824 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15c475-f197-47b5-a3fb-8e1100a9bf9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:14.372684 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-0f15c475-f197-47b5-a3fb-8e1100a9bf9c None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:14.374090 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-0f15c475-f197-47b5-a3fb-8e1100a9bf9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:14.376126 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c3e57-8c82-41c3-b170-d175458012e9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:14.405949 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1007/2004] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:14 2022] PUT /identity/v3/projects/64b901129a7649a687308af4fec67ee2/users/4e474469d87f4a63b615ab36d2764b33/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:14.408577 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fae5d0-b064-47d4-bc0c-3c3b9f424d45 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:14.408577 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fae5d0-b064-47d4-bc0c-3c3b9f424d45 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:14.408762 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fae5d0-b064-47d4-bc0c-3c3b9f424d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:14.414433 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:14.447026 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d6fae5d0-b064-47d4-bc0c-3c3b9f424d45 None None] MFA Rules not processed for user `f21cb1c7b1a74b9793f2f4b5f83d1e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:14.449273 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d6fae5d0-b064-47d4-bc0c-3c3b9f424d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:14.458981 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 998/2005] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:14.463528 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15c475-f197-47b5-a3fb-8e1100a9bf9c None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:14.472171 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:14.476462 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15c475-f197-47b5-a3fb-8e1100a9bf9c None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:14.545242 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1008/2006] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:14.546300 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fae5d0-b064-47d4-bc0c-3c3b9f424d45 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:14.572087 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883199f-a385-4614-a50f-beeb4d49fc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:14.573584 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883199f-a385-4614-a50f-beeb4d49fc96 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:14.573889 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883199f-a385-4614-a50f-beeb4d49fc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:14.574300 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883199f-a385-4614-a50f-beeb4d49fc96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:14.575233 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4883199f-a385-4614-a50f-beeb4d49fc96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:14.576870 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4883199f-a385-4614-a50f-beeb4d49fc96 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:14.600354 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 999/2007] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:14.605428 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883199f-a385-4614-a50f-beeb4d49fc96 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:14.607906 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-4883199f-a385-4614-a50f-beeb4d49fc96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:14.674968 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fae5d0-b064-47d4-bc0c-3c3b9f424d45 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:14.686243 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b4d73-9805-4557-9796-781cbb9f6d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:14.687088 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b4d73-9805-4557-9796-781cbb9f6d35 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:14.687430 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b4d73-9805-4557-9796-781cbb9f6d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:14.687712 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b4d73-9805-4557-9796-781cbb9f6d35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:14.688450 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b4d73-9805-4557-9796-781cbb9f6d35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:28:14.688763 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b4d73-9805-4557-9796-781cbb9f6d35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:14.691132 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b4d73-9805-4557-9796-781cbb9f6d35 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:14.710180 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1009/2008] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:28:14.710180 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b4d73-9805-4557-9796-781cbb9f6d35 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:14.723796 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883199f-a385-4614-a50f-beeb4d49fc96 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:14.724552 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b4d73-9805-4557-9796-781cbb9f6d35 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:14.727945 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6b7ad-9f8e-4c74-beb5-a3d592e10102 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac83171b9284163a71cc729cef076f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:14.730293 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574c24e-cb81-4573-990b-c1944ce37725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:14.730974 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6b7ad-9f8e-4c74-beb5-a3d592e10102 service glance] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:14.731270 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6b7ad-9f8e-4c74-beb5-a3d592e10102 service glance] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:14.731555 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6b7ad-9f8e-4c74-beb5-a3d592e10102 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:14.731908 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574c24e-cb81-4573-990b-c1944ce37725 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:14.732333 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574c24e-cb81-4573-990b-c1944ce37725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:14.733099 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574c24e-cb81-4573-990b-c1944ce37725 admin admin] PATH_INFO: `/v3/projects/64b901129a7649a687308af4fec67ee2/users/4e474469d87f4a63b615ab36d2764b33/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:14.735792 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6574c24e-cb81-4573-990b-c1944ce37725 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b901129a7649a687308af4fec67ee2, user_id=4e474469d87f4a63b615ab36d2764b33, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:14.740667 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6574c24e-cb81-4573-990b-c1944ce37725 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:14.742394 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6b7ad-9f8e-4c74-beb5-a3d592e10102 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:14.744395 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6b7ad-9f8e-4c74-beb5-a3d592e10102 service glance] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:14.755975 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1000/2009] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:14.756897 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6b7ad-9f8e-4c74-beb5-a3d592e10102 service glance] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:14.759183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1010/2010] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:14 2022] PUT /identity/v3/projects/64b901129a7649a687308af4fec67ee2/users/4e474469d87f4a63b615ab36d2764b33/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:14.771189 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14389b-dbbd-4251-b08c-921f8d91be7b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:14.772392 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14389b-dbbd-4251-b08c-921f8d91be7b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:14.773131 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14389b-dbbd-4251-b08c-921f8d91be7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:14.780057 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6b7ad-9f8e-4c74-beb5-a3d592e10102 service glance] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:14.850442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-3f14389b-dbbd-4251-b08c-921f8d91be7b None None] MFA Rules not processed for user `4e474469d87f4a63b615ab36d2764b33`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:14.852075 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3f14389b-dbbd-4251-b08c-921f8d91be7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:14.991095 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab5362-c66d-48a3-a116-35d8a892fee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:14.991778 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab5362-c66d-48a3-a116-35d8a892fee8 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:14.992074 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab5362-c66d-48a3-a116-35d8a892fee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:14.992356 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab5362-c66d-48a3-a116-35d8a892fee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:14.993063 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab5362-c66d-48a3-a116-35d8a892fee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:14.995536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab5362-c66d-48a3-a116-35d8a892fee8 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:15.049596 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1011/2011] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:28:15.050696 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:15.068948 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1001/2012] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:28:14 2022] POST /identity/v3/projects => generated 383 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:15.075112 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14389b-dbbd-4251-b08c-921f8d91be7b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:15.096445 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14389b-dbbd-4251-b08c-921f8d91be7b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:15.146766 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab5362-c66d-48a3-a116-35d8a892fee8 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:15.150786 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c4ab5362-c66d-48a3-a116-35d8a892fee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:15.201626 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:15.250939 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c086dc-b1c4-4f58-9aac-272e3e45da4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:15.256559 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c086dc-b1c4-4f58-9aac-272e3e45da4d admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:15.257088 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c086dc-b1c4-4f58-9aac-272e3e45da4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:15.257640 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c086dc-b1c4-4f58-9aac-272e3e45da4d admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:15.259073 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c086dc-b1c4-4f58-9aac-272e3e45da4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:15.261390 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c086dc-b1c4-4f58-9aac-272e3e45da4d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:15.292944 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1012/2013] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:28:15 2022] POST /identity/v3/users => generated 292 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:15.296197 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c086dc-b1c4-4f58-9aac-272e3e45da4d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:15.308418 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-68c086dc-b1c4-4f58-9aac-272e3e45da4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:15.332453 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab5362-c66d-48a3-a116-35d8a892fee8 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:15.338856 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016d01a-8659-48ad-93bb-0587137adb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:15.340037 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016d01a-8659-48ad-93bb-0587137adb01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:15.340552 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016d01a-8659-48ad-93bb-0587137adb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:15.340987 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016d01a-8659-48ad-93bb-0587137adb01 admin admin] PATH_INFO: `/v3/projects/a2e255dc0a804e6db89f2854a806087c` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:15.342489 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5016d01a-8659-48ad-93bb-0587137adb01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2e255dc0a804e6db89f2854a806087c)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:15.344651 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5016d01a-8659-48ad-93bb-0587137adb01 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:15.445386 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-5016d01a-8659-48ad-93bb-0587137adb01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2e255dc0a804e6db89f2854a806087c', 'request_id': 'req-5016d01a-8659-48ad-93bb-0587137adb01'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:15.450676 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c086dc-b1c4-4f58-9aac-272e3e45da4d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:15.457929 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-5016d01a-8659-48ad-93bb-0587137adb01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2e255dc0a804e6db89f2854a806087c', 'request_id': 'req-5016d01a-8659-48ad-93bb-0587137adb01'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:15.469881 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-5016d01a-8659-48ad-93bb-0587137adb01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2e255dc0a804e6db89f2854a806087c', 'request_id': 'req-5016d01a-8659-48ad-93bb-0587137adb01'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:15.502520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-5016d01a-8659-48ad-93bb-0587137adb01 admin admin] The token cache is being invalidate because project a2e255dc0a804e6db89f2854a806087c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:15.502959 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-5016d01a-8659-48ad-93bb-0587137adb01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:15.504839 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-5016d01a-8659-48ad-93bb-0587137adb01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:15.507899 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1002/2014] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:15 2022] DELETE /identity/v3/projects/a2e255dc0a804e6db89f2854a806087c => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:15.509441 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016d01a-8659-48ad-93bb-0587137adb01 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:15.512750 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-5016d01a-8659-48ad-93bb-0587137adb01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:15.559754 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba57cf9-8d32-4e8b-9810-c3d797aa36de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:15.560691 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba57cf9-8d32-4e8b-9810-c3d797aa36de service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:15.561181 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba57cf9-8d32-4e8b-9810-c3d797aa36de service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:15.561571 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba57cf9-8d32-4e8b-9810-c3d797aa36de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:15.563880 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7ba57cf9-8d32-4e8b-9810-c3d797aa36de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:15.650704 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016d01a-8659-48ad-93bb-0587137adb01 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:15.664286 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da991e-3435-41a5-8c0a-4444880e5816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:15.665011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da991e-3435-41a5-8c0a-4444880e5816 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:15.665300 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da991e-3435-41a5-8c0a-4444880e5816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:15.665581 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da991e-3435-41a5-8c0a-4444880e5816 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:15.666683 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da991e-3435-41a5-8c0a-4444880e5816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:15.670459 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da991e-3435-41a5-8c0a-4444880e5816 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:15.696819 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1003/2015] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:15.703310 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff0580-60f0-4f3c-ba0d-a0f67fbbde0b None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:15.703499 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff0580-60f0-4f3c-ba0d-a0f67fbbde0b None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:15.703624 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff0580-60f0-4f3c-ba0d-a0f67fbbde0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:15.717755 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba57cf9-8d32-4e8b-9810-c3d797aa36de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:15.719257 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba57cf9-8d32-4e8b-9810-c3d797aa36de service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:15.751523 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-17ff0580-60f0-4f3c-ba0d-a0f67fbbde0b None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:15.752751 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-17ff0580-60f0-4f3c-ba0d-a0f67fbbde0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:15.759193 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1013/2016] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:15.763086 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba57cf9-8d32-4e8b-9810-c3d797aa36de service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:15.782018 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1004/2017] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:15.786407 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69dc451-4225-4f96-9c6c-1100f44c145d None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:15.786818 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69dc451-4225-4f96-9c6c-1100f44c145d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:15.787213 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69dc451-4225-4f96-9c6c-1100f44c145d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:15.789913 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba57cf9-8d32-4e8b-9810-c3d797aa36de service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:15.799455 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807df6c6-ec0e-47d6-ba35-191bc700d096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:15.800248 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807df6c6-ec0e-47d6-ba35-191bc700d096 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:15.800430 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807df6c6-ec0e-47d6-ba35-191bc700d096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:15.800713 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807df6c6-ec0e-47d6-ba35-191bc700d096 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:15.801446 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807df6c6-ec0e-47d6-ba35-191bc700d096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:15.815190 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807df6c6-ec0e-47d6-ba35-191bc700d096 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:15.835796 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-a69dc451-4225-4f96-9c6c-1100f44c145d None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:15.837272 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1014/2018] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:15.841180 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a69dc451-4225-4f96-9c6c-1100f44c145d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:15.842002 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807df6c6-ec0e-47d6-ba35-191bc700d096 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:15.862395 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1005/2019] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:15.862599 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807df6c6-ec0e-47d6-ba35-191bc700d096 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:15.863915 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69dc451-4225-4f96-9c6c-1100f44c145d None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:15.874739 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5310b0a-c297-4693-8c43-26945785abff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:15.875809 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5310b0a-c297-4693-8c43-26945785abff admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:15.876103 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5310b0a-c297-4693-8c43-26945785abff admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:15.876390 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5310b0a-c297-4693-8c43-26945785abff admin admin] PATH_INFO: `/v3/projects/8dca9fa6a94644b1a6d774a3135dd9b6/users/cb71c0188293436489485d98c1c4cc68/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:15.880775 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69dc451-4225-4f96-9c6c-1100f44c145d None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:15.894734 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5410c-ee6d-418c-a358-f37ae9a9b50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:15.895470 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5410c-ee6d-418c-a358-f37ae9a9b50a admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:15.895852 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5410c-ee6d-418c-a358-f37ae9a9b50a admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:15.896230 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5410c-ee6d-418c-a358-f37ae9a9b50a admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:15.897064 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e5410c-ee6d-418c-a358-f37ae9a9b50a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:28:15.898175 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e5410c-ee6d-418c-a358-f37ae9a9b50a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:15.899263 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e5410c-ee6d-418c-a358-f37ae9a9b50a admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:15.905305 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:15.912147 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:15.922669 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5310b0a-c297-4693-8c43-26945785abff admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dca9fa6a94644b1a6d774a3135dd9b6, user_id=cb71c0188293436489485d98c1c4cc68, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:15.930032 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5310b0a-c297-4693-8c43-26945785abff admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:15.938018 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1006/2020] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:28:15.949241 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5410c-ee6d-418c-a358-f37ae9a9b50a admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:15.971444 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1015/2021] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:15 2022] PUT /identity/v3/projects/8dca9fa6a94644b1a6d774a3135dd9b6/users/cb71c0188293436489485d98c1c4cc68/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:28:15.981804 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742b859-ecd4-43a2-9e24-8a51e4bf0269 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:15.982136 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742b859-ecd4-43a2-9e24-8a51e4bf0269 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:15.984088 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742b859-ecd4-43a2-9e24-8a51e4bf0269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:15.985566 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5410c-ee6d-418c-a358-f37ae9a9b50a admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:16.078055 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a742b859-ecd4-43a2-9e24-8a51e4bf0269 None None] MFA Rules not processed for user `cb71c0188293436489485d98c1c4cc68`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:16.082120 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a742b859-ecd4-43a2-9e24-8a51e4bf0269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:16.202789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68835a-01ea-40d6-bd65-f831aa1f54a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:16.202789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68835a-01ea-40d6-bd65-f831aa1f54a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:16.202789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68835a-01ea-40d6-bd65-f831aa1f54a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:16.202789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68835a-01ea-40d6-bd65-f831aa1f54a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:16.203977 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68835a-01ea-40d6-bd65-f831aa1f54a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:16.209495 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68835a-01ea-40d6-bd65-f831aa1f54a9 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:16.351291 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1007/2022] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:28:15 2022] POST /identity/v3/projects => generated 385 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:16.356254 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68835a-01ea-40d6-bd65-f831aa1f54a9 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:16.371351 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1016/2023] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:28:16.399724 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742b859-ecd4-43a2-9e24-8a51e4bf0269 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:16.401843 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a742b859-ecd4-43a2-9e24-8a51e4bf0269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:16.535174 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68835a-01ea-40d6-bd65-f831aa1f54a9 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:16.542118 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279811e-0619-4ecf-8519-829277184aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:16.542868 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279811e-0619-4ecf-8519-829277184aae admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:16.543157 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279811e-0619-4ecf-8519-829277184aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:16.543504 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279811e-0619-4ecf-8519-829277184aae admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:16.544328 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279811e-0619-4ecf-8519-829277184aae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:16.548422 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279811e-0619-4ecf-8519-829277184aae admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:16.560101 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742b859-ecd4-43a2-9e24-8a51e4bf0269 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:16.585188 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1008/2024] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:28:16 2022] POST /identity/v3/users => generated 293 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:16.590976 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279811e-0619-4ecf-8519-829277184aae admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:16.607400 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279811e-0619-4ecf-8519-829277184aae admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:16.617884 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfb7f2-ee44-4789-9c87-65ec62d4c7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:16.619103 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfb7f2-ee44-4789-9c87-65ec62d4c7fb admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:16.619489 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfb7f2-ee44-4789-9c87-65ec62d4c7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:16.619861 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfb7f2-ee44-4789-9c87-65ec62d4c7fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:16.621578 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bfb7f2-ee44-4789-9c87-65ec62d4c7fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:16.624575 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bfb7f2-ee44-4789-9c87-65ec62d4c7fb admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:16.633238 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc43577-91dd-4747-95db-58a897ab0e95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:16.634703 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc43577-91dd-4747-95db-58a897ab0e95 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:16.634703 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc43577-91dd-4747-95db-58a897ab0e95 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:16.634905 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc43577-91dd-4747-95db-58a897ab0e95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:16.642092 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1009/2025] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:16.646619 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfb7f2-ee44-4789-9c87-65ec62d4c7fb admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:16.669464 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfb7f2-ee44-4789-9c87-65ec62d4c7fb admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:16.694128 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931cfbaa-96d8-4478-b85e-d29ed48df0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:16.694870 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cfbaa-96d8-4478-b85e-d29ed48df0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:16.695173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cfbaa-96d8-4478-b85e-d29ed48df0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:16.695433 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cfbaa-96d8-4478-b85e-d29ed48df0b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:16.696170 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931cfbaa-96d8-4478-b85e-d29ed48df0b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:16.698192 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931cfbaa-96d8-4478-b85e-d29ed48df0b9 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:16.714316 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1010/2026] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:16.718648 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931cfbaa-96d8-4478-b85e-d29ed48df0b9 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:16.735827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931cfbaa-96d8-4478-b85e-d29ed48df0b9 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:16.742424 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843d328-6fba-4ad9-b2e8-0a0f3d6026d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:16.745674 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843d328-6fba-4ad9-b2e8-0a0f3d6026d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:16.745674 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843d328-6fba-4ad9-b2e8-0a0f3d6026d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:16.746225 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843d328-6fba-4ad9-b2e8-0a0f3d6026d2 admin admin] PATH_INFO: `/v3/projects/2b8da7b8116a42ec8646a5c05e7d51cc/users/b4cb29ef2db0416fa1f82284166fa52c/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:16.777407 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843d328-6fba-4ad9-b2e8-0a0f3d6026d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b8da7b8116a42ec8646a5c05e7d51cc, user_id=b4cb29ef2db0416fa1f82284166fa52c, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:16.780416 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:16.782505 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843d328-6fba-4ad9-b2e8-0a0f3d6026d2 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:16.802687 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc43577-91dd-4747-95db-58a897ab0e95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:16.804824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc43577-91dd-4747-95db-58a897ab0e95 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:16.809901 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1011/2027] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:16 2022] PUT /identity/v3/projects/2b8da7b8116a42ec8646a5c05e7d51cc/users/b4cb29ef2db0416fa1f82284166fa52c/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:16.823883 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563eb33-da96-4509-b53f-d02eb0995e89 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:16.824212 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563eb33-da96-4509-b53f-d02eb0995e89 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:16.824452 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563eb33-da96-4509-b53f-d02eb0995e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:16.826853 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1017/2028] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:28:16.869800 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-5563eb33-da96-4509-b53f-d02eb0995e89 None None] MFA Rules not processed for user `b4cb29ef2db0416fa1f82284166fa52c`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:16.874818 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-5563eb33-da96-4509-b53f-d02eb0995e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:16.891139 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:16.970215 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1012/2029] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:16.975944 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc43577-91dd-4747-95db-58a897ab0e95 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:17.002115 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc43577-91dd-4747-95db-58a897ab0e95 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:17.097196 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc9e0a-cc2f-4930-8238-7ebbd30c359a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:17.097786 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc9e0a-cc2f-4930-8238-7ebbd30c359a admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:17.098105 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc9e0a-cc2f-4930-8238-7ebbd30c359a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:17.098386 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc9e0a-cc2f-4930-8238-7ebbd30c359a admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:17.099090 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc9e0a-cc2f-4930-8238-7ebbd30c359a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:17.101297 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc9e0a-cc2f-4930-8238-7ebbd30c359a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:17.137195 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1018/2030] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:28:16 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:17.141395 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563eb33-da96-4509-b53f-d02eb0995e89 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:17.183282 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563eb33-da96-4509-b53f-d02eb0995e89 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:17.285383 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19de24-2a39-46a6-bd47-cce166a911db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:17.287740 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19de24-2a39-46a6-bd47-cce166a911db admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:17.287740 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19de24-2a39-46a6-bd47-cce166a911db admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:17.287740 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19de24-2a39-46a6-bd47-cce166a911db admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:17.287740 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19de24-2a39-46a6-bd47-cce166a911db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:17.290063 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19de24-2a39-46a6-bd47-cce166a911db admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:17.318011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1013/2031] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:28:17 2022] POST /identity/v3/users => generated 299 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:17.320366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc9e0a-cc2f-4930-8238-7ebbd30c359a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:17.332647 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc9e0a-cc2f-4930-8238-7ebbd30c359a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:17.337813 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed3fcc-95ec-423c-b438-ba4028ce98f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:17.338616 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed3fcc-95ec-423c-b438-ba4028ce98f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:17.340066 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed3fcc-95ec-423c-b438-ba4028ce98f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:17.340398 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed3fcc-95ec-423c-b438-ba4028ce98f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:17.341356 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed3fcc-95ec-423c-b438-ba4028ce98f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:17.343486 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed3fcc-95ec-423c-b438-ba4028ce98f4 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:17.357557 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1019/2032] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:17.362280 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19de24-2a39-46a6-bd47-cce166a911db admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:17.372663 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19de24-2a39-46a6-bd47-cce166a911db admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:17.377547 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412aa3f5-b2ff-4ab5-b4a3-8c4a39808337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:17.378485 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412aa3f5-b2ff-4ab5-b4a3-8c4a39808337 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:17.378775 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412aa3f5-b2ff-4ab5-b4a3-8c4a39808337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:17.379056 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412aa3f5-b2ff-4ab5-b4a3-8c4a39808337 admin admin] PATH_INFO: `/v3/projects/b6be22ee02c345508210d89df6b02375/users/7bd699ad975c4c8b9f605e3ee8adbc48/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:17.395854 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412aa3f5-b2ff-4ab5-b4a3-8c4a39808337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6be22ee02c345508210d89df6b02375, user_id=7bd699ad975c4c8b9f605e3ee8adbc48, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:17.398623 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412aa3f5-b2ff-4ab5-b4a3-8c4a39808337 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:17.412059 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1014/2033] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:17 2022] PUT /identity/v3/projects/b6be22ee02c345508210d89df6b02375/users/7bd699ad975c4c8b9f605e3ee8adbc48/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:17.416119 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed3fcc-95ec-423c-b438-ba4028ce98f4 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:17.426853 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed3fcc-95ec-423c-b438-ba4028ce98f4 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:17.483695 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54048914-2b2a-4e5d-8472-6070a901acb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:17.484278 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54048914-2b2a-4e5d-8472-6070a901acb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:17.484566 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54048914-2b2a-4e5d-8472-6070a901acb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:17.484843 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54048914-2b2a-4e5d-8472-6070a901acb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:17.485562 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54048914-2b2a-4e5d-8472-6070a901acb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:17.487197 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54048914-2b2a-4e5d-8472-6070a901acb6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:17.497708 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1020/2034] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:17.502018 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412aa3f5-b2ff-4ab5-b4a3-8c4a39808337 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:17.512162 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412aa3f5-b2ff-4ab5-b4a3-8c4a39808337 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:17.516682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb4624-a07a-4ee8-98e3-fcfef6542236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:17.517549 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb4624-a07a-4ee8-98e3-fcfef6542236 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:17.517829 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb4624-a07a-4ee8-98e3-fcfef6542236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:17.518144 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb4624-a07a-4ee8-98e3-fcfef6542236 admin admin] PATH_INFO: `/v3/projects/b6be22ee02c345508210d89df6b02375/users/7bd699ad975c4c8b9f605e3ee8adbc48/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:17.520082 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb4624-a07a-4ee8-98e3-fcfef6542236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6be22ee02c345508210d89df6b02375, user_id=7bd699ad975c4c8b9f605e3ee8adbc48, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:17.522738 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb4624-a07a-4ee8-98e3-fcfef6542236 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:17.532813 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1015/2035] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:17 2022] PUT /identity/v3/projects/b6be22ee02c345508210d89df6b02375/users/7bd699ad975c4c8b9f605e3ee8adbc48/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:17.543270 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0322fb4-1a4f-41da-9688-d33b71b28ff9 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:17.543566 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0322fb4-1a4f-41da-9688-d33b71b28ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:17.543848 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0322fb4-1a4f-41da-9688-d33b71b28ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:17.570788 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-f0322fb4-1a4f-41da-9688-d33b71b28ff9 None None] MFA Rules not processed for user `7bd699ad975c4c8b9f605e3ee8adbc48`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:17.571988 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f0322fb4-1a4f-41da-9688-d33b71b28ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:17.621026 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:17.642222 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1021/2036] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:17.653622 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb4624-a07a-4ee8-98e3-fcfef6542236 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:17.715296 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb4624-a07a-4ee8-98e3-fcfef6542236 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:17.720499 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa61356-d74f-4fa5-abba-efe329eac5a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:17.721154 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa61356-d74f-4fa5-abba-efe329eac5a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:17.721435 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa61356-d74f-4fa5-abba-efe329eac5a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:17.721711 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa61356-d74f-4fa5-abba-efe329eac5a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:17.733629 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa61356-d74f-4fa5-abba-efe329eac5a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:17.735180 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa61356-d74f-4fa5-abba-efe329eac5a1 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:17.746021 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1016/2037] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:17.830099 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0322fb4-1a4f-41da-9688-d33b71b28ff9 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:18.000358 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0322fb4-1a4f-41da-9688-d33b71b28ff9 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:18.007240 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579269b-a085-4dfa-8232-6fc047ce31d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:18.008290 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579269b-a085-4dfa-8232-6fc047ce31d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:18.008776 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579269b-a085-4dfa-8232-6fc047ce31d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:18.009068 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579269b-a085-4dfa-8232-6fc047ce31d9 admin admin] PATH_INFO: `/v3/users/b4cb29ef2db0416fa1f82284166fa52c` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:18.010409 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579269b-a085-4dfa-8232-6fc047ce31d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4cb29ef2db0416fa1f82284166fa52c)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:18.012747 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579269b-a085-4dfa-8232-6fc047ce31d9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:18.083645 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7579269b-a085-4dfa-8232-6fc047ce31d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4cb29ef2db0416fa1f82284166fa52c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:18.084325 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7579269b-a085-4dfa-8232-6fc047ce31d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4cb29ef2db0416fa1f82284166fa52c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:18.100022 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7579269b-a085-4dfa-8232-6fc047ce31d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4cb29ef2db0416fa1f82284166fa52c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:18.108656 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7579269b-a085-4dfa-8232-6fc047ce31d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4cb29ef2db0416fa1f82284166fa52c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:18.109446 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7579269b-a085-4dfa-8232-6fc047ce31d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4cb29ef2db0416fa1f82284166fa52c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:18.124009 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1022/2038] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:17 2022] DELETE /identity/v3/users/b4cb29ef2db0416fa1f82284166fa52c => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:18.129963 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abd9c2-d599-4a58-8d27-c6be3d542eb8 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:18.130302 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abd9c2-d599-4a58-8d27-c6be3d542eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:18.130582 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abd9c2-d599-4a58-8d27-c6be3d542eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:18.150412 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-a6abd9c2-d599-4a58-8d27-c6be3d542eb8 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:18.151807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a6abd9c2-d599-4a58-8d27-c6be3d542eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:18.159370 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:18.241820 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1017/2039] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:28:18.252924 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579269b-a085-4dfa-8232-6fc047ce31d9 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:18.254537 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7579269b-a085-4dfa-8232-6fc047ce31d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:18.314509 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579269b-a085-4dfa-8232-6fc047ce31d9 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:18.318194 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5555f3-ec1d-4fba-88b4-f8845f4ce8ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:18.318843 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5555f3-ec1d-4fba-88b4-f8845f4ce8ff service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:18.319127 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5555f3-ec1d-4fba-88b4-f8845f4ce8ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:18.319403 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5555f3-ec1d-4fba-88b4-f8845f4ce8ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:18.329086 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5555f3-ec1d-4fba-88b4-f8845f4ce8ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:18.330554 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5555f3-ec1d-4fba-88b4-f8845f4ce8ff service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:18.340395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1023/2040] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:18.662980 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abd9c2-d599-4a58-8d27-c6be3d542eb8 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:18.664476 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a6abd9c2-d599-4a58-8d27-c6be3d542eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:18.687391 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abd9c2-d599-4a58-8d27-c6be3d542eb8 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:18.692414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c142447-46ce-463f-b1fb-0861d657eae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:18.693373 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c142447-46ce-463f-b1fb-0861d657eae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:18.693655 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c142447-46ce-463f-b1fb-0861d657eae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:18.693929 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c142447-46ce-463f-b1fb-0861d657eae3 admin admin] PATH_INFO: `/v3/projects/2b8da7b8116a42ec8646a5c05e7d51cc` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:18.695230 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c142447-46ce-463f-b1fb-0861d657eae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b8da7b8116a42ec8646a5c05e7d51cc)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:18.697276 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c142447-46ce-463f-b1fb-0861d657eae3 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:18.756188 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4c142447-46ce-463f-b1fb-0861d657eae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b8da7b8116a42ec8646a5c05e7d51cc', 'request_id': 'req-4c142447-46ce-463f-b1fb-0861d657eae3'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:18.764189 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4c142447-46ce-463f-b1fb-0861d657eae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b8da7b8116a42ec8646a5c05e7d51cc', 'request_id': 'req-4c142447-46ce-463f-b1fb-0861d657eae3'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:18.771611 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4c142447-46ce-463f-b1fb-0861d657eae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b8da7b8116a42ec8646a5c05e7d51cc', 'request_id': 'req-4c142447-46ce-463f-b1fb-0861d657eae3'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:18.786320 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4c142447-46ce-463f-b1fb-0861d657eae3 admin admin] The token cache is being invalidate because project 2b8da7b8116a42ec8646a5c05e7d51cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:18.786616 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4c142447-46ce-463f-b1fb-0861d657eae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:18.787314 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4c142447-46ce-463f-b1fb-0861d657eae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:18.788890 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1018/2041] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:18 2022] DELETE /identity/v3/projects/2b8da7b8116a42ec8646a5c05e7d51cc => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:18.793509 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5555f3-ec1d-4fba-88b4-f8845f4ce8ff service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:18.803582 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5555f3-ec1d-4fba-88b4-f8845f4ce8ff service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:18.808491 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:18.869852 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baaefe3-c7e8-4341-bc48-54c5bdcdb8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:18.870955 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baaefe3-c7e8-4341-bc48-54c5bdcdb8fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:18.871307 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baaefe3-c7e8-4341-bc48-54c5bdcdb8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:18.871640 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baaefe3-c7e8-4341-bc48-54c5bdcdb8fc admin admin] PATH_INFO: `/v3/users/7bd699ad975c4c8b9f605e3ee8adbc48` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:18.872969 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baaefe3-c7e8-4341-bc48-54c5bdcdb8fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bd699ad975c4c8b9f605e3ee8adbc48)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:18.875050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baaefe3-c7e8-4341-bc48-54c5bdcdb8fc admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:18.930481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8baaefe3-c7e8-4341-bc48-54c5bdcdb8fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bd699ad975c4c8b9f605e3ee8adbc48'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:18.931135 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8baaefe3-c7e8-4341-bc48-54c5bdcdb8fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bd699ad975c4c8b9f605e3ee8adbc48'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:18.942855 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8baaefe3-c7e8-4341-bc48-54c5bdcdb8fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bd699ad975c4c8b9f605e3ee8adbc48'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:18.956955 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8baaefe3-c7e8-4341-bc48-54c5bdcdb8fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bd699ad975c4c8b9f605e3ee8adbc48'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:18.957833 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8baaefe3-c7e8-4341-bc48-54c5bdcdb8fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bd699ad975c4c8b9f605e3ee8adbc48'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:18.973171 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1024/2042] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:18 2022] DELETE /identity/v3/users/7bd699ad975c4c8b9f605e3ee8adbc48 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:19.009963 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c142447-46ce-463f-b1fb-0861d657eae3 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:19.012238 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-4c142447-46ce-463f-b1fb-0861d657eae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:19.026079 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c142447-46ce-463f-b1fb-0861d657eae3 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:19.103580 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4123256-7b2a-4460-bcbb-d30aab817e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:19.104517 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4123256-7b2a-4460-bcbb-d30aab817e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:19.105456 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4123256-7b2a-4460-bcbb-d30aab817e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:19.105456 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4123256-7b2a-4460-bcbb-d30aab817e31 admin admin] PATH_INFO: `/v3/users/c095c3b52d7148d889008d862e4370b8` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:19.106515 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4123256-7b2a-4460-bcbb-d30aab817e31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c095c3b52d7148d889008d862e4370b8)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:19.108518 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4123256-7b2a-4460-bcbb-d30aab817e31 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:19.182692 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:19.203823 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b4123256-7b2a-4460-bcbb-d30aab817e31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c095c3b52d7148d889008d862e4370b8'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:19.204629 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b4123256-7b2a-4460-bcbb-d30aab817e31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c095c3b52d7148d889008d862e4370b8'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:19.237375 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b4123256-7b2a-4460-bcbb-d30aab817e31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c095c3b52d7148d889008d862e4370b8'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:19.253885 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b4123256-7b2a-4460-bcbb-d30aab817e31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c095c3b52d7148d889008d862e4370b8'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:19.268271 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b4123256-7b2a-4460-bcbb-d30aab817e31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c095c3b52d7148d889008d862e4370b8'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:19.286205 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1019/2043] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:19 2022] DELETE /identity/v3/users/c095c3b52d7148d889008d862e4370b8 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:19.290931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75f360-33c2-43a3-a65e-2ce8aa0bb66a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:19.291350 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75f360-33c2-43a3-a65e-2ce8aa0bb66a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:19.291733 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75f360-33c2-43a3-a65e-2ce8aa0bb66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:19.313034 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2c75f360-33c2-43a3-a65e-2ce8aa0bb66a None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:19.324014 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2c75f360-33c2-43a3-a65e-2ce8aa0bb66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:19.429316 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4123256-7b2a-4460-bcbb-d30aab817e31 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:19.431702 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-b4123256-7b2a-4460-bcbb-d30aab817e31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:19.464837 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1025/2044] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:28:19.480230 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75f360-33c2-43a3-a65e-2ce8aa0bb66a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:19.483641 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2c75f360-33c2-43a3-a65e-2ce8aa0bb66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:19.523957 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:19.554187 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4123256-7b2a-4460-bcbb-d30aab817e31 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:19.560313 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964a59b-f57b-4ada-bd20-cd9318c2e8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:19.561194 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964a59b-f57b-4ada-bd20-cd9318c2e8de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:19.561538 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964a59b-f57b-4ada-bd20-cd9318c2e8de admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:19.561890 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964a59b-f57b-4ada-bd20-cd9318c2e8de admin admin] PATH_INFO: `/v3/projects/b6be22ee02c345508210d89df6b02375` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:19.563255 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964a59b-f57b-4ada-bd20-cd9318c2e8de admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6be22ee02c345508210d89df6b02375)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:19.568924 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964a59b-f57b-4ada-bd20-cd9318c2e8de admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:19.569218 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75f360-33c2-43a3-a65e-2ce8aa0bb66a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:19.582722 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b0929-7369-483b-b057-9ada1068e802 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:19.583356 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b0929-7369-483b-b057-9ada1068e802 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:19.583655 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b0929-7369-483b-b057-9ada1068e802 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:19.583959 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b0929-7369-483b-b057-9ada1068e802 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:19.597135 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b0929-7369-483b-b057-9ada1068e802 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:19.598980 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b0929-7369-483b-b057-9ada1068e802 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:19.611555 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1026/2045] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:28:19.648060 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4964a59b-f57b-4ada-bd20-cd9318c2e8de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6be22ee02c345508210d89df6b02375', 'request_id': 'req-4964a59b-f57b-4ada-bd20-cd9318c2e8de'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:19.662684 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4964a59b-f57b-4ada-bd20-cd9318c2e8de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6be22ee02c345508210d89df6b02375', 'request_id': 'req-4964a59b-f57b-4ada-bd20-cd9318c2e8de'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:19.680308 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4964a59b-f57b-4ada-bd20-cd9318c2e8de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6be22ee02c345508210d89df6b02375', 'request_id': 'req-4964a59b-f57b-4ada-bd20-cd9318c2e8de'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:19.699506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4964a59b-f57b-4ada-bd20-cd9318c2e8de admin admin] The token cache is being invalidate because project b6be22ee02c345508210d89df6b02375 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:19.700107 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4964a59b-f57b-4ada-bd20-cd9318c2e8de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:19.700820 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4964a59b-f57b-4ada-bd20-cd9318c2e8de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:19.703450 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1020/2046] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:19 2022] DELETE /identity/v3/projects/b6be22ee02c345508210d89df6b02375 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:19.708773 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e84eb-40ed-4fd4-9ac0-151f571116ff None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:19.709061 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e84eb-40ed-4fd4-9ac0-151f571116ff None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:19.709343 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e84eb-40ed-4fd4-9ac0-151f571116ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:19.733892 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d61e84eb-40ed-4fd4-9ac0-151f571116ff None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:19.735358 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d61e84eb-40ed-4fd4-9ac0-151f571116ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:19.890048 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1027/2047] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:19.895939 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ada5e4-8720-477d-b7f7-8079f8d83e2a None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:19.896610 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ada5e4-8720-477d-b7f7-8079f8d83e2a None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:19.897189 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ada5e4-8720-477d-b7f7-8079f8d83e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:19.919141 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-47ada5e4-8720-477d-b7f7-8079f8d83e2a None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:19.920987 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-47ada5e4-8720-477d-b7f7-8079f8d83e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:19.937616 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1021/2048] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:19.941942 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e84eb-40ed-4fd4-9ac0-151f571116ff None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:19.953277 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e84eb-40ed-4fd4-9ac0-151f571116ff None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:19.958906 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcefdf8-f7f1-4ca9-96f4-a12356ce378f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:19.959648 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcefdf8-f7f1-4ca9-96f4-a12356ce378f admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:19.959972 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcefdf8-f7f1-4ca9-96f4-a12356ce378f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:19.960337 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcefdf8-f7f1-4ca9-96f4-a12356ce378f admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:19.961378 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcefdf8-f7f1-4ca9-96f4-a12356ce378f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:28:19.961758 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcefdf8-f7f1-4ca9-96f4-a12356ce378f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:19.963522 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcefdf8-f7f1-4ca9-96f4-a12356ce378f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:19.983169 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ada5e4-8720-477d-b7f7-8079f8d83e2a None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:19.986191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1028/2049] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:28:19.993510 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ada5e4-8720-477d-b7f7-8079f8d83e2a None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:19.999421 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a6bdc-604d-4020-b0c8-889742ed1fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:20.000100 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a6bdc-604d-4020-b0c8-889742ed1fff admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:20.000387 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a6bdc-604d-4020-b0c8-889742ed1fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:20.000672 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a6bdc-604d-4020-b0c8-889742ed1fff admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:20.001370 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a6bdc-604d-4020-b0c8-889742ed1fff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:20.003709 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a6bdc-604d-4020-b0c8-889742ed1fff admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:20.043550 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1022/2050] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:28:19 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:20.048584 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcefdf8-f7f1-4ca9-96f4-a12356ce378f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:20.050636 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a6bdc-604d-4020-b0c8-889742ed1fff admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:20.053481 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-133a6bdc-604d-4020-b0c8-889742ed1fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:20.064350 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcefdf8-f7f1-4ca9-96f4-a12356ce378f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:20.074646 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:20.152177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aae7c6-a768-49a7-bb32-956160173eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:20.152887 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aae7c6-a768-49a7-bb32-956160173eab admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:20.153236 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aae7c6-a768-49a7-bb32-956160173eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:20.153455 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aae7c6-a768-49a7-bb32-956160173eab admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:20.154294 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aae7c6-a768-49a7-bb32-956160173eab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:20.156463 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aae7c6-a768-49a7-bb32-956160173eab admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:20.160281 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a6bdc-604d-4020-b0c8-889742ed1fff admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:20.174121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5325c-65da-4ecf-96ed-91dd10d3a51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:20.175287 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5325c-65da-4ecf-96ed-91dd10d3a51c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:20.175578 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5325c-65da-4ecf-96ed-91dd10d3a51c admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:20.177657 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5325c-65da-4ecf-96ed-91dd10d3a51c admin admin] PATH_INFO: `/v3/projects/a8ba1c37cc3e48ae938dd9ed007bf661` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:20.178718 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca5325c-65da-4ecf-96ed-91dd10d3a51c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8ba1c37cc3e48ae938dd9ed007bf661)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:20.180832 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca5325c-65da-4ecf-96ed-91dd10d3a51c admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:20.196163 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1029/2051] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:28:20 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:20.200619 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aae7c6-a768-49a7-bb32-956160173eab admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:20.215395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aae7c6-a768-49a7-bb32-956160173eab admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:20.220693 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093cf0e-0acd-4c8f-ab01-042439abbe43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:20.221359 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093cf0e-0acd-4c8f-ab01-042439abbe43 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:20.221826 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093cf0e-0acd-4c8f-ab01-042439abbe43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:20.221938 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093cf0e-0acd-4c8f-ab01-042439abbe43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:20.222677 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093cf0e-0acd-4c8f-ab01-042439abbe43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:20.224318 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093cf0e-0acd-4c8f-ab01-042439abbe43 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:20.238418 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1030/2052] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 04:28:20.242010 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-cca5325c-65da-4ecf-96ed-91dd10d3a51c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8ba1c37cc3e48ae938dd9ed007bf661', 'request_id': 'req-cca5325c-65da-4ecf-96ed-91dd10d3a51c'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:20.242890 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093cf0e-0acd-4c8f-ab01-042439abbe43 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:20.251671 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-cca5325c-65da-4ecf-96ed-91dd10d3a51c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8ba1c37cc3e48ae938dd9ed007bf661', 'request_id': 'req-cca5325c-65da-4ecf-96ed-91dd10d3a51c'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:20.255359 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093cf0e-0acd-4c8f-ab01-042439abbe43 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:20.263032 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-cca5325c-65da-4ecf-96ed-91dd10d3a51c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8ba1c37cc3e48ae938dd9ed007bf661', 'request_id': 'req-cca5325c-65da-4ecf-96ed-91dd10d3a51c'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:20.277619 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-cca5325c-65da-4ecf-96ed-91dd10d3a51c admin admin] The token cache is being invalidate because project a8ba1c37cc3e48ae938dd9ed007bf661 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:20.278041 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-cca5325c-65da-4ecf-96ed-91dd10d3a51c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:20.278958 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-cca5325c-65da-4ecf-96ed-91dd10d3a51c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:20.280722 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1023/2053] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:20 2022] DELETE /identity/v3/projects/a8ba1c37cc3e48ae938dd9ed007bf661 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:20.284938 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5325c-65da-4ecf-96ed-91dd10d3a51c admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:20.287015 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-cca5325c-65da-4ecf-96ed-91dd10d3a51c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:20.300929 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:20.345046 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214154bd-0057-46aa-8ca8-92b8aa31d324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:20.346071 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214154bd-0057-46aa-8ca8-92b8aa31d324 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:20.346370 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214154bd-0057-46aa-8ca8-92b8aa31d324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:20.346675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214154bd-0057-46aa-8ca8-92b8aa31d324 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:20.347446 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214154bd-0057-46aa-8ca8-92b8aa31d324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:20.350077 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214154bd-0057-46aa-8ca8-92b8aa31d324 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:20.365897 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1031/2054] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 04:28:20.366830 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214154bd-0057-46aa-8ca8-92b8aa31d324 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:20.368556 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-214154bd-0057-46aa-8ca8-92b8aa31d324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:20.373619 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5325c-65da-4ecf-96ed-91dd10d3a51c admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:20.379748 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae89e6-3985-473b-bbaa-031a15cde502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:20.381005 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae89e6-3985-473b-bbaa-031a15cde502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:20.381169 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae89e6-3985-473b-bbaa-031a15cde502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:20.381542 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae89e6-3985-473b-bbaa-031a15cde502 admin admin] PATH_INFO: `/v3/users/4e474469d87f4a63b615ab36d2764b33` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:20.382409 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214154bd-0057-46aa-8ca8-92b8aa31d324 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:20.388057 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae89e6-3985-473b-bbaa-031a15cde502 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e474469d87f4a63b615ab36d2764b33)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:20.390298 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae89e6-3985-473b-bbaa-031a15cde502 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:20.395676 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702738b-150f-44ed-94d3-f475af9afdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:20.397358 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702738b-150f-44ed-94d3-f475af9afdbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:20.397675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702738b-150f-44ed-94d3-f475af9afdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:20.397967 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702738b-150f-44ed-94d3-f475af9afdbe admin admin] PATH_INFO: `/v3/projects/2d50c966697b44eca05374e249954e90/users/34aa6d2c457747ecbab4a80faa2748ec/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:20.419151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702738b-150f-44ed-94d3-f475af9afdbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d50c966697b44eca05374e249954e90, user_id=34aa6d2c457747ecbab4a80faa2748ec, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:20.422206 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702738b-150f-44ed-94d3-f475af9afdbe admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:20.453571 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1032/2055] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:20 2022] PUT /identity/v3/projects/2d50c966697b44eca05374e249954e90/users/34aa6d2c457747ecbab4a80faa2748ec/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:20.453571 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600bedc-4b7b-4298-9c25-66240f8075a8 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:20.453571 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600bedc-4b7b-4298-9c25-66240f8075a8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:20.453571 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600bedc-4b7b-4298-9c25-66240f8075a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:20.453869 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-15ae89e6-3985-473b-bbaa-031a15cde502 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e474469d87f4a63b615ab36d2764b33'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:20.453869 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-15ae89e6-3985-473b-bbaa-031a15cde502 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e474469d87f4a63b615ab36d2764b33'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:20.455057 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:20.478439 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-15ae89e6-3985-473b-bbaa-031a15cde502 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e474469d87f4a63b615ab36d2764b33'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:20.482513 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c600bedc-4b7b-4298-9c25-66240f8075a8 None None] MFA Rules not processed for user `34aa6d2c457747ecbab4a80faa2748ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:20.484152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c600bedc-4b7b-4298-9c25-66240f8075a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:20.500475 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-15ae89e6-3985-473b-bbaa-031a15cde502 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e474469d87f4a63b615ab36d2764b33'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:20.512182 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-15ae89e6-3985-473b-bbaa-031a15cde502 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e474469d87f4a63b615ab36d2764b33'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:20.519024 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1024/2056] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:20 2022] DELETE /identity/v3/users/4e474469d87f4a63b615ab36d2764b33 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:20.597259 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1033/2057] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:20.599607 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae89e6-3985-473b-bbaa-031a15cde502 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:20.602472 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-15ae89e6-3985-473b-bbaa-031a15cde502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:20.681009 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae89e6-3985-473b-bbaa-031a15cde502 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:20.690499 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c3f2e-35d2-4125-b123-cbf33144a5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:20.691229 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c3f2e-35d2-4125-b123-cbf33144a5cf admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:20.691613 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c3f2e-35d2-4125-b123-cbf33144a5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:20.692151 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c3f2e-35d2-4125-b123-cbf33144a5cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:20.693482 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c3f2e-35d2-4125-b123-cbf33144a5cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:20.696197 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c3f2e-35d2-4125-b123-cbf33144a5cf admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:20.737266 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1025/2058] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:28:20 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:20.738799 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600bedc-4b7b-4298-9c25-66240f8075a8 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:20.815840 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600bedc-4b7b-4298-9c25-66240f8075a8 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:20.868290 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:20.887281 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7b011-620e-4fc4-a145-3758ad86c025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:20.887998 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7b011-620e-4fc4-a145-3758ad86c025 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:20.888281 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7b011-620e-4fc4-a145-3758ad86c025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:20.888557 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7b011-620e-4fc4-a145-3758ad86c025 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:20.889911 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7b011-620e-4fc4-a145-3758ad86c025 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:20.892594 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7b011-620e-4fc4-a145-3758ad86c025 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:20.935975 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1034/2059] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:28:20 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:20.940242 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c3f2e-35d2-4125-b123-cbf33144a5cf admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:20.956980 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7b011-620e-4fc4-a145-3758ad86c025 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:20.960808 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7bf7b011-620e-4fc4-a145-3758ad86c025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:20.964418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c3f2e-35d2-4125-b123-cbf33144a5cf admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:20.975095 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7b011-620e-4fc4-a145-3758ad86c025 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:20.986369 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402e000-0dcb-4e40-9714-021ee3659220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:20.987190 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402e000-0dcb-4e40-9714-021ee3659220 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:20.987541 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402e000-0dcb-4e40-9714-021ee3659220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:20.987981 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402e000-0dcb-4e40-9714-021ee3659220 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:20.993349 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf0cc1-5570-426e-b016-8262f6797c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:20.994458 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf0cc1-5570-426e-b016-8262f6797c50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:20.995045 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf0cc1-5570-426e-b016-8262f6797c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:20.995507 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf0cc1-5570-426e-b016-8262f6797c50 admin admin] PATH_INFO: `/v3/projects/64b901129a7649a687308af4fec67ee2` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:20.997068 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf0cc1-5570-426e-b016-8262f6797c50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64b901129a7649a687308af4fec67ee2)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:20.999580 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402e000-0dcb-4e40-9714-021ee3659220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:20.999817 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf0cc1-5570-426e-b016-8262f6797c50 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:21.003153 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402e000-0dcb-4e40-9714-021ee3659220 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:21.024580 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1026/2060] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:21.028905 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402e000-0dcb-4e40-9714-021ee3659220 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:21.052857 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402e000-0dcb-4e40-9714-021ee3659220 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:21.075702 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-eedf0cc1-5570-426e-b016-8262f6797c50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64b901129a7649a687308af4fec67ee2', 'request_id': 'req-eedf0cc1-5570-426e-b016-8262f6797c50'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:21.089270 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-eedf0cc1-5570-426e-b016-8262f6797c50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64b901129a7649a687308af4fec67ee2', 'request_id': 'req-eedf0cc1-5570-426e-b016-8262f6797c50'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:21.098338 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-eedf0cc1-5570-426e-b016-8262f6797c50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64b901129a7649a687308af4fec67ee2', 'request_id': 'req-eedf0cc1-5570-426e-b016-8262f6797c50'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:21.125584 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-eedf0cc1-5570-426e-b016-8262f6797c50 admin admin] The token cache is being invalidate because project 64b901129a7649a687308af4fec67ee2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:21.125886 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-eedf0cc1-5570-426e-b016-8262f6797c50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:21.126733 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-eedf0cc1-5570-426e-b016-8262f6797c50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:21.131075 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1035/2061] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:20 2022] DELETE /identity/v3/projects/64b901129a7649a687308af4fec67ee2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:28:21.135471 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bc29a-ebe5-4b9b-ad79-b160e679711e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:21.136561 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bc29a-ebe5-4b9b-ad79-b160e679711e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:21.136561 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bc29a-ebe5-4b9b-ad79-b160e679711e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:21.158108 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-cf4bc29a-ebe5-4b9b-ad79-b160e679711e None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:21.158108 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cf4bc29a-ebe5-4b9b-ad79-b160e679711e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:21.169864 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d1570-3c6b-4216-9f54-553b5d6c0adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:21.170975 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d1570-3c6b-4216-9f54-553b5d6c0adf admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:21.171422 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d1570-3c6b-4216-9f54-553b5d6c0adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:21.172164 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d1570-3c6b-4216-9f54-553b5d6c0adf admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:21.172285 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1036/2062] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:21.173824 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d1570-3c6b-4216-9f54-553b5d6c0adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:21.175853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d1570-3c6b-4216-9f54-553b5d6c0adf admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:21.183044 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83d35c-4ba9-433c-b789-96e9d1abcf31 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:21.183286 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83d35c-4ba9-433c-b789-96e9d1abcf31 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:21.183575 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83d35c-4ba9-433c-b789-96e9d1abcf31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:21.197196 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1027/2063] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 04:28:21.198474 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d1570-3c6b-4216-9f54-553b5d6c0adf admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:21.200877 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-807d1570-3c6b-4216-9f54-553b5d6c0adf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:21.207144 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-4b83d35c-4ba9-433c-b789-96e9d1abcf31 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:21.208518 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4b83d35c-4ba9-433c-b789-96e9d1abcf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:21.216582 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d1570-3c6b-4216-9f54-553b5d6c0adf admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:21.222322 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1037/2064] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:21.223227 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3173b0-4296-4d1c-86ba-f76a4bf6a96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:21.223632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83d35c-4ba9-433c-b789-96e9d1abcf31 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:21.225171 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3173b0-4296-4d1c-86ba-f76a4bf6a96d admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:21.225635 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3173b0-4296-4d1c-86ba-f76a4bf6a96d admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:21.226789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3173b0-4296-4d1c-86ba-f76a4bf6a96d admin admin] PATH_INFO: `/v3/projects/b6b5c0146ae44affa32a9eda0ee0fb61/users/c799871b4b8240a09de2425c5b50d0fd/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:21.236841 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83d35c-4ba9-433c-b789-96e9d1abcf31 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:21.244379 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89e091-8d12-403e-bbb3-9d518f5a5208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:21.245797 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89e091-8d12-403e-bbb3-9d518f5a5208 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:21.246213 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89e091-8d12-403e-bbb3-9d518f5a5208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:21.246491 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89e091-8d12-403e-bbb3-9d518f5a5208 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:21.247358 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89e091-8d12-403e-bbb3-9d518f5a5208 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:28:21.247730 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89e091-8d12-403e-bbb3-9d518f5a5208 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:21.249549 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89e091-8d12-403e-bbb3-9d518f5a5208 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:21.258592 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3173b0-4296-4d1c-86ba-f76a4bf6a96d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6b5c0146ae44affa32a9eda0ee0fb61, user_id=c799871b4b8240a09de2425c5b50d0fd, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:21.261674 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3173b0-4296-4d1c-86ba-f76a4bf6a96d admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:21.271884 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1038/2065] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:28:21.276847 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89e091-8d12-403e-bbb3-9d518f5a5208 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:21.283525 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1028/2066] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:21 2022] PUT /identity/v3/projects/b6b5c0146ae44affa32a9eda0ee0fb61/users/c799871b4b8240a09de2425c5b50d0fd/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:21.289458 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89e091-8d12-403e-bbb3-9d518f5a5208 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:21.295231 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a88fe5-56f4-4630-aef6-5cc9180d78ae None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:21.296918 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a88fe5-56f4-4630-aef6-5cc9180d78ae None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:21.297282 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a88fe5-56f4-4630-aef6-5cc9180d78ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:21.330932 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:21.344677 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-62a88fe5-56f4-4630-aef6-5cc9180d78ae None None] MFA Rules not processed for user `c799871b4b8240a09de2425c5b50d0fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:21.346738 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-62a88fe5-56f4-4630-aef6-5cc9180d78ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:21.391285 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd759801-546f-46e5-94cb-37092af60e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:21.392060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd759801-546f-46e5-94cb-37092af60e3a admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:21.392475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd759801-546f-46e5-94cb-37092af60e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:21.392821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd759801-546f-46e5-94cb-37092af60e3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:21.393610 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd759801-546f-46e5-94cb-37092af60e3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:21.395577 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd759801-546f-46e5-94cb-37092af60e3a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:21.453683 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1039/2067] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:28:21 2022] POST /identity/v3/projects => generated 375 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:21.458909 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd759801-546f-46e5-94cb-37092af60e3a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:21.495576 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:21.507588 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1029/2068] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:21.512457 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a88fe5-56f4-4630-aef6-5cc9180d78ae None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:21.524424 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a88fe5-56f4-4630-aef6-5cc9180d78ae None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:21.553694 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd759801-546f-46e5-94cb-37092af60e3a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:21.563458 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5f3a5-4bd3-49db-97c6-710adb5acf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:21.564334 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5f3a5-4bd3-49db-97c6-710adb5acf4c admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:21.564675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5f3a5-4bd3-49db-97c6-710adb5acf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:21.565081 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5f3a5-4bd3-49db-97c6-710adb5acf4c admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:21.566055 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e5f3a5-4bd3-49db-97c6-710adb5acf4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:21.568939 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e5f3a5-4bd3-49db-97c6-710adb5acf4c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:21.606681 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1040/2069] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:28:21 2022] POST /identity/v3/users => generated 288 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:21.607396 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5f3a5-4bd3-49db-97c6-710adb5acf4c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:21.610682 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-51e5f3a5-4bd3-49db-97c6-710adb5acf4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:21.613010 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9e17a-df4c-4545-b1aa-4c30a3408312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:21.613683 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9e17a-df4c-4545-b1aa-4c30a3408312 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:21.614100 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9e17a-df4c-4545-b1aa-4c30a3408312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:21.614274 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9e17a-df4c-4545-b1aa-4c30a3408312 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:21.614972 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef9e17a-df4c-4545-b1aa-4c30a3408312 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:21.617057 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef9e17a-df4c-4545-b1aa-4c30a3408312 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:21.624263 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5f3a5-4bd3-49db-97c6-710adb5acf4c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:21.629371 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07183a4a-6bef-4527-815e-6d57a266e35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:21.630406 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07183a4a-6bef-4527-815e-6d57a266e35d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:21.630688 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07183a4a-6bef-4527-815e-6d57a266e35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:21.630993 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07183a4a-6bef-4527-815e-6d57a266e35d admin admin] PATH_INFO: `/v3/users/92606adbbaa946c0a32978316afb380f` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:21.632154 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07183a4a-6bef-4527-815e-6d57a266e35d admin admin] RBAC: Authorizing `identity:delete_user(user_id=92606adbbaa946c0a32978316afb380f)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:21.634250 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07183a4a-6bef-4527-815e-6d57a266e35d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:21.650473 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1030/2070] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:28:21 2022] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:21.652208 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9e17a-df4c-4545-b1aa-4c30a3408312 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:21.707088 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-07183a4a-6bef-4527-815e-6d57a266e35d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92606adbbaa946c0a32978316afb380f'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:21.714728 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-07183a4a-6bef-4527-815e-6d57a266e35d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92606adbbaa946c0a32978316afb380f'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:21.732680 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-07183a4a-6bef-4527-815e-6d57a266e35d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92606adbbaa946c0a32978316afb380f'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:21.741870 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9e17a-df4c-4545-b1aa-4c30a3408312 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:21.746329 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-07183a4a-6bef-4527-815e-6d57a266e35d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92606adbbaa946c0a32978316afb380f'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:21.747039 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-07183a4a-6bef-4527-815e-6d57a266e35d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92606adbbaa946c0a32978316afb380f'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:21.749241 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a633bd-1f86-46a3-bb7c-aaea8f6f2e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:21.750318 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a633bd-1f86-46a3-bb7c-aaea8f6f2e47 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:21.750599 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a633bd-1f86-46a3-bb7c-aaea8f6f2e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:21.750876 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a633bd-1f86-46a3-bb7c-aaea8f6f2e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:21.751677 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a633bd-1f86-46a3-bb7c-aaea8f6f2e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:21.754408 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a633bd-1f86-46a3-bb7c-aaea8f6f2e47 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:21.763679 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1041/2071] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:21 2022] DELETE /identity/v3/users/92606adbbaa946c0a32978316afb380f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:21.764201 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07183a4a-6bef-4527-815e-6d57a266e35d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:21.766044 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-07183a4a-6bef-4527-815e-6d57a266e35d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:21.779845 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1031/2072] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:21.784009 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a633bd-1f86-46a3-bb7c-aaea8f6f2e47 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:21.788381 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a4a633bd-1f86-46a3-bb7c-aaea8f6f2e47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:21.818421 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a633bd-1f86-46a3-bb7c-aaea8f6f2e47 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:21.860099 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:21.889211 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07183a4a-6bef-4527-815e-6d57a266e35d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:21.900107 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a4322-822c-409f-8af8-0be57906b086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:21.901719 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a4322-822c-409f-8af8-0be57906b086 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:21.902964 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a4322-822c-409f-8af8-0be57906b086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:21.903258 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a4322-822c-409f-8af8-0be57906b086 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:21.904172 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a4322-822c-409f-8af8-0be57906b086 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:21.906223 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a4322-822c-409f-8af8-0be57906b086 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:21.935794 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1042/2073] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:28:21 2022] POST /identity/v3/users => generated 300 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:21.936074 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2779c-9980-4592-b5b2-8c895a6c7716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:21.936074 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2779c-9980-4592-b5b2-8c895a6c7716 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:21.936273 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2779c-9980-4592-b5b2-8c895a6c7716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:21.936564 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2779c-9980-4592-b5b2-8c895a6c7716 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:21.937300 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e2779c-9980-4592-b5b2-8c895a6c7716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:21.939350 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a4322-822c-409f-8af8-0be57906b086 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:21.939758 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e2779c-9980-4592-b5b2-8c895a6c7716 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:21.953962 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a4322-822c-409f-8af8-0be57906b086 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:21.954186 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1032/2074] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 04:28:21.957873 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2779c-9980-4592-b5b2-8c895a6c7716 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:21.964363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb2adb-225e-4b31-bf2d-5e82e2540f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:21.965230 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb2adb-225e-4b31-bf2d-5e82e2540f24 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:21.965529 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb2adb-225e-4b31-bf2d-5e82e2540f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:21.965809 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb2adb-225e-4b31-bf2d-5e82e2540f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:21.966613 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb2adb-225e-4b31-bf2d-5e82e2540f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:21.968277 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb2adb-225e-4b31-bf2d-5e82e2540f24 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:21.969877 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2779c-9980-4592-b5b2-8c895a6c7716 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:21.970941 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=83,keystone:INSERT=7,keystone:DELETE=10 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:21.977437 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca96819-c226-412c-9e7f-8e43c9148f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:21.978846 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca96819-c226-412c-9e7f-8e43c9148f62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:21.979487 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca96819-c226-412c-9e7f-8e43c9148f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:21.979932 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca96819-c226-412c-9e7f-8e43c9148f62 admin admin] PATH_INFO: `/v3/projects/99f5ea9c750b4e33a34181837c38f4a6/users/cf42fa5a48334b8fa885944690aaecae/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:21.982131 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1043/2075] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:21.987401 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb2adb-225e-4b31-bf2d-5e82e2540f24 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:22.001816 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb2adb-225e-4b31-bf2d-5e82e2540f24 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:22.007783 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a290a-8776-4e80-af29-e8b697942149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:22.008123 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca96819-c226-412c-9e7f-8e43c9148f62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99f5ea9c750b4e33a34181837c38f4a6, user_id=cf42fa5a48334b8fa885944690aaecae, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:22.008990 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a290a-8776-4e80-af29-e8b697942149 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:22.009294 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a290a-8776-4e80-af29-e8b697942149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:22.009605 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a290a-8776-4e80-af29-e8b697942149 admin admin] PATH_INFO: `/v3/projects/5dbd9299c30e4cc8b9c30afd47487a49/users/8094f49b3ec84b56acda9a398b7e9cb6/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:22.011480 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca96819-c226-412c-9e7f-8e43c9148f62 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:22.035712 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1033/2076] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:21 2022] PUT /identity/v3/projects/99f5ea9c750b4e33a34181837c38f4a6/users/cf42fa5a48334b8fa885944690aaecae/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:22.036580 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca96819-c226-412c-9e7f-8e43c9148f62 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:22.046948 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-aca96819-c226-412c-9e7f-8e43c9148f62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:22.051111 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a290a-8776-4e80-af29-e8b697942149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dbd9299c30e4cc8b9c30afd47487a49, user_id=8094f49b3ec84b56acda9a398b7e9cb6, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:22.054200 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a290a-8776-4e80-af29-e8b697942149 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:22.069405 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1044/2077] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:21 2022] PUT /identity/v3/projects/5dbd9299c30e4cc8b9c30afd47487a49/users/8094f49b3ec84b56acda9a398b7e9cb6/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:28:22.070960 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584928c-bae4-4948-accd-efe8f7b17d73 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:22.071248 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584928c-bae4-4948-accd-efe8f7b17d73 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:22.071619 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584928c-bae4-4948-accd-efe8f7b17d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:22.102205 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-9584928c-bae4-4948-accd-efe8f7b17d73 None None] MFA Rules not processed for user `cf42fa5a48334b8fa885944690aaecae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:22.104600 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9584928c-bae4-4948-accd-efe8f7b17d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:22.125748 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca96819-c226-412c-9e7f-8e43c9148f62 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:22.183882 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1045/2078] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:22.184701 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584928c-bae4-4948-accd-efe8f7b17d73 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:22.195517 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec4127-a719-473c-a77d-1d4486b46d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:22.198601 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec4127-a719-473c-a77d-1d4486b46d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:22.199052 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec4127-a719-473c-a77d-1d4486b46d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:22.199342 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec4127-a719-473c-a77d-1d4486b46d0e admin admin] PATH_INFO: `/v3/projects/4f513fbb00a1495782e48de7ab0c8061` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:22.200646 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec4127-a719-473c-a77d-1d4486b46d0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f513fbb00a1495782e48de7ab0c8061)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:22.202630 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec4127-a719-473c-a77d-1d4486b46d0e admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:22.249745 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:22.257084 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7cec4127-a719-473c-a77d-1d4486b46d0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f513fbb00a1495782e48de7ab0c8061', 'request_id': 'req-7cec4127-a719-473c-a77d-1d4486b46d0e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:22.257712 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584928c-bae4-4948-accd-efe8f7b17d73 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:22.266050 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7cec4127-a719-473c-a77d-1d4486b46d0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f513fbb00a1495782e48de7ab0c8061', 'request_id': 'req-7cec4127-a719-473c-a77d-1d4486b46d0e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:22.272315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7cec4127-a719-473c-a77d-1d4486b46d0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f513fbb00a1495782e48de7ab0c8061', 'request_id': 'req-7cec4127-a719-473c-a77d-1d4486b46d0e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:22.284812 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7cec4127-a719-473c-a77d-1d4486b46d0e admin admin] The token cache is being invalidate because project 4f513fbb00a1495782e48de7ab0c8061 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:22.285157 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7cec4127-a719-473c-a77d-1d4486b46d0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:22.285876 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7cec4127-a719-473c-a77d-1d4486b46d0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:22.287586 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1034/2079] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:22 2022] DELETE /identity/v3/projects/4f513fbb00a1495782e48de7ab0c8061 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:22.290129 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec4127-a719-473c-a77d-1d4486b46d0e admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:22.290129 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7cec4127-a719-473c-a77d-1d4486b46d0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:22.328431 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770fa36-b4b6-49aa-b078-3dd5cfc1e8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:22.329245 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770fa36-b4b6-49aa-b078-3dd5cfc1e8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:22.329424 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770fa36-b4b6-49aa-b078-3dd5cfc1e8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:22.329704 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770fa36-b4b6-49aa-b078-3dd5cfc1e8c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:22.330472 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770fa36-b4b6-49aa-b078-3dd5cfc1e8c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:22.332087 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770fa36-b4b6-49aa-b078-3dd5cfc1e8c8 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:22.344597 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1046/2080] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:22.344597 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156982a6-1658-48b9-ae06-b44df4358fd7 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:22.344597 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156982a6-1658-48b9-ae06-b44df4358fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:22.344597 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156982a6-1658-48b9-ae06-b44df4358fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:22.358365 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:22.361203 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec4127-a719-473c-a77d-1d4486b46d0e admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:22.364128 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-156982a6-1658-48b9-ae06-b44df4358fd7 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:22.365616 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f9785-d2db-44f7-b0b0-2cc56673cb40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:22.365936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-156982a6-1658-48b9-ae06-b44df4358fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:22.366289 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f9785-d2db-44f7-b0b0-2cc56673cb40 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:22.366570 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f9785-d2db-44f7-b0b0-2cc56673cb40 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:22.366846 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f9785-d2db-44f7-b0b0-2cc56673cb40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:22.368696 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3f4f9785-d2db-44f7-b0b0-2cc56673cb40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:22.374888 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1047/2081] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:22.375663 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156982a6-1658-48b9-ae06-b44df4358fd7 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:22.376932 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-156982a6-1658-48b9-ae06-b44df4358fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:22.391180 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156982a6-1658-48b9-ae06-b44df4358fd7 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:22.396094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ca256-336f-4448-9d6f-5d3a31aef634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:22.397007 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ca256-336f-4448-9d6f-5d3a31aef634 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:22.397289 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ca256-336f-4448-9d6f-5d3a31aef634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:22.397572 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ca256-336f-4448-9d6f-5d3a31aef634 admin admin] PATH_INFO: `/v3/projects/5dbd9299c30e4cc8b9c30afd47487a49/users/8094f49b3ec84b56acda9a398b7e9cb6/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:22.399727 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ca256-336f-4448-9d6f-5d3a31aef634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dbd9299c30e4cc8b9c30afd47487a49, user_id=8094f49b3ec84b56acda9a398b7e9cb6, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:22.402519 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ca256-336f-4448-9d6f-5d3a31aef634 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:22.413716 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1048/2082] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:22 2022] PUT /identity/v3/projects/5dbd9299c30e4cc8b9c30afd47487a49/users/8094f49b3ec84b56acda9a398b7e9cb6/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:22.422477 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba38443-c735-440a-a003-da4155778453 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:22.422477 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba38443-c735-440a-a003-da4155778453 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:22.422477 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba38443-c735-440a-a003-da4155778453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:22.434845 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2ba38443-c735-440a-a003-da4155778453 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:22.436056 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2ba38443-c735-440a-a003-da4155778453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:22.460915 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f9785-d2db-44f7-b0b0-2cc56673cb40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:22.463069 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f9785-d2db-44f7-b0b0-2cc56673cb40 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:22.473073 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1035/2083] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:22.474450 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1f5ff-d93b-4070-be95-bc7cf9defdf3 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:22.474746 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1f5ff-d93b-4070-be95-bc7cf9defdf3 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:22.475026 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1f5ff-d93b-4070-be95-bc7cf9defdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:22.513127 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-7eb1f5ff-d93b-4070-be95-bc7cf9defdf3 None None] MFA Rules not processed for user `8094f49b3ec84b56acda9a398b7e9cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:22.514461 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7eb1f5ff-d93b-4070-be95-bc7cf9defdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:22.523434 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1049/2084] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:22.528041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba38443-c735-440a-a003-da4155778453 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:22.539953 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba38443-c735-440a-a003-da4155778453 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:22.552662 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4791e85-19d4-4deb-9e0e-53dc3c991eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:22.554358 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4791e85-19d4-4deb-9e0e-53dc3c991eaf admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:22.554650 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4791e85-19d4-4deb-9e0e-53dc3c991eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:22.554932 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4791e85-19d4-4deb-9e0e-53dc3c991eaf admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:22.555673 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4791e85-19d4-4deb-9e0e-53dc3c991eaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:28:22.555987 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4791e85-19d4-4deb-9e0e-53dc3c991eaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:22.558207 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4791e85-19d4-4deb-9e0e-53dc3c991eaf admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:22.591644 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1050/2085] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:28:22.592650 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4791e85-19d4-4deb-9e0e-53dc3c991eaf admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:22.615233 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4791e85-19d4-4deb-9e0e-53dc3c991eaf admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:22.622683 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c791705-696e-4274-8abd-8056ce5c6132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:22.623453 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c791705-696e-4274-8abd-8056ce5c6132 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:22.624394 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c791705-696e-4274-8abd-8056ce5c6132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:22.634537 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c791705-696e-4274-8abd-8056ce5c6132 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:22.636776 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c791705-696e-4274-8abd-8056ce5c6132 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:22.639270 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c791705-696e-4274-8abd-8056ce5c6132 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:22.640394 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1036/2086] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:22.674022 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1051/2087] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:28:22 2022] POST /identity/v3/projects => generated 389 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:22.677234 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1f5ff-d93b-4070-be95-bc7cf9defdf3 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:22.690810 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1f5ff-d93b-4070-be95-bc7cf9defdf3 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:22.695342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c791705-696e-4274-8abd-8056ce5c6132 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:22.696393 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:22.697290 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1c791705-696e-4274-8abd-8056ce5c6132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:22.778821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c791705-696e-4274-8abd-8056ce5c6132 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:22.780394 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd520a3-4666-4546-ace8-7f7db18e2461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:22.781747 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd520a3-4666-4546-ace8-7f7db18e2461 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:22.782475 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd520a3-4666-4546-ace8-7f7db18e2461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:22.782948 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd520a3-4666-4546-ace8-7f7db18e2461 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:22.783885 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd520a3-4666-4546-ace8-7f7db18e2461 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:22.784109 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbda15-98c2-4398-a311-e0546621773c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:22.784884 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbda15-98c2-4398-a311-e0546621773c service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:22.785225 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbda15-98c2-4398-a311-e0546621773c service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:22.785513 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbda15-98c2-4398-a311-e0546621773c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:22.787480 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd520a3-4666-4546-ace8-7f7db18e2461 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:22.827572 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1037/2088] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:28:22 2022] POST /identity/v3/users => generated 295 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:22.830048 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd520a3-4666-4546-ace8-7f7db18e2461 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:22.861528 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd520a3-4666-4546-ace8-7f7db18e2461 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:22.867465 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64438ba-e31f-4cf7-96f5-9db8094c136f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:22.868142 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64438ba-e31f-4cf7-96f5-9db8094c136f admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:22.868427 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64438ba-e31f-4cf7-96f5-9db8094c136f admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:22.868763 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64438ba-e31f-4cf7-96f5-9db8094c136f admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:22.869626 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64438ba-e31f-4cf7-96f5-9db8094c136f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:22.871652 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64438ba-e31f-4cf7-96f5-9db8094c136f admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:22.892433 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bbda15-98c2-4398-a311-e0546621773c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:22.895205 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bbda15-98c2-4398-a311-e0546621773c service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:22.898073 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1038/2089] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:22.899114 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64438ba-e31f-4cf7-96f5-9db8094c136f admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:22.912864 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64438ba-e31f-4cf7-96f5-9db8094c136f admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:22.925509 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388024eb-334e-49c6-b7d1-71369cdb981a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:22.926229 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388024eb-334e-49c6-b7d1-71369cdb981a admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:22.926517 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388024eb-334e-49c6-b7d1-71369cdb981a admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:22.926799 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388024eb-334e-49c6-b7d1-71369cdb981a admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:22.927540 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388024eb-334e-49c6-b7d1-71369cdb981a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:22.931894 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1052/2090] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:28:22.933061 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbda15-98c2-4398-a311-e0546621773c service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:22.939323 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388024eb-334e-49c6-b7d1-71369cdb981a admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:22.946809 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b9bbda15-98c2-4398-a311-e0546621773c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:22.962288 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:22.963597 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1039/2091] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:22.966526 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388024eb-334e-49c6-b7d1-71369cdb981a admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:22.987663 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388024eb-334e-49c6-b7d1-71369cdb981a admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:22.994784 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7cad3a-4209-4a5f-9b67-1636c8c289b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:22.996210 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cad3a-4209-4a5f-9b67-1636c8c289b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:22.996500 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cad3a-4209-4a5f-9b67-1636c8c289b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:22.996781 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cad3a-4209-4a5f-9b67-1636c8c289b8 admin admin] PATH_INFO: `/v3/projects/e007a22c150b4988983eaacfb5b9b2b8/users/d5a8390d1220475582b70d1347a1ef14/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:22.997777 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbda15-98c2-4398-a311-e0546621773c service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:23.021852 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0aaa6-23f2-457a-ad29-7c5fe917fc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:23.023476 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0aaa6-23f2-457a-ad29-7c5fe917fc42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:23.023880 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0aaa6-23f2-457a-ad29-7c5fe917fc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:23.024935 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0aaa6-23f2-457a-ad29-7c5fe917fc42 admin admin] PATH_INFO: `/v3/users/cb71c0188293436489485d98c1c4cc68` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:23.027460 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7cad3a-4209-4a5f-9b67-1636c8c289b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e007a22c150b4988983eaacfb5b9b2b8, user_id=d5a8390d1220475582b70d1347a1ef14, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:23.028205 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0aaa6-23f2-457a-ad29-7c5fe917fc42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb71c0188293436489485d98c1c4cc68)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:23.030474 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0aaa6-23f2-457a-ad29-7c5fe917fc42 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:23.031100 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7cad3a-4209-4a5f-9b67-1636c8c289b8 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:23.057096 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1040/2092] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:22 2022] PUT /identity/v3/projects/e007a22c150b4988983eaacfb5b9b2b8/users/d5a8390d1220475582b70d1347a1ef14/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:23.064336 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca58f0-b310-4ab7-95d0-a110bf98e18e None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:23.065966 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca58f0-b310-4ab7-95d0-a110bf98e18e None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:23.066575 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca58f0-b310-4ab7-95d0-a110bf98e18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:23.102654 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-90ca58f0-b310-4ab7-95d0-a110bf98e18e None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:23.103930 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-90ca58f0-b310-4ab7-95d0-a110bf98e18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:23.123925 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5fd0aaa6-23f2-457a-ad29-7c5fe917fc42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb71c0188293436489485d98c1c4cc68'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:23.125277 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5fd0aaa6-23f2-457a-ad29-7c5fe917fc42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb71c0188293436489485d98c1c4cc68'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:23.151866 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5fd0aaa6-23f2-457a-ad29-7c5fe917fc42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb71c0188293436489485d98c1c4cc68'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:23.172282 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5fd0aaa6-23f2-457a-ad29-7c5fe917fc42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb71c0188293436489485d98c1c4cc68'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:23.173262 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5fd0aaa6-23f2-457a-ad29-7c5fe917fc42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb71c0188293436489485d98c1c4cc68'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:23.208050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1053/2093] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:22 2022] DELETE /identity/v3/users/cb71c0188293436489485d98c1c4cc68 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:23.212142 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391b0f5-dfeb-497d-b007-0da6916c53f7 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:23.212786 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391b0f5-dfeb-497d-b007-0da6916c53f7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:23.213581 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391b0f5-dfeb-497d-b007-0da6916c53f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:23.247142 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-4391b0f5-dfeb-497d-b007-0da6916c53f7 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:23.248654 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4391b0f5-dfeb-497d-b007-0da6916c53f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:23.263994 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1041/2094] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:23.279736 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca58f0-b310-4ab7-95d0-a110bf98e18e None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:23.281353 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-90ca58f0-b310-4ab7-95d0-a110bf98e18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:23.342168 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1054/2095] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:28:23.352509 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391b0f5-dfeb-497d-b007-0da6916c53f7 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:23.357882 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca58f0-b310-4ab7-95d0-a110bf98e18e None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:23.363905 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:23.429734 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391b0f5-dfeb-497d-b007-0da6916c53f7 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:23.434958 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3477bf-4fed-40b0-8881-4f884cbc01d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:23.435623 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3477bf-4fed-40b0-8881-4f884cbc01d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:23.435950 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3477bf-4fed-40b0-8881-4f884cbc01d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:23.436192 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3477bf-4fed-40b0-8881-4f884cbc01d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:23.436977 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ecc9b-3607-4b39-aa8a-02f477fffade service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:23.438655 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ecc9b-3607-4b39-aa8a-02f477fffade service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:23.439042 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ecc9b-3607-4b39-aa8a-02f477fffade service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:23.439585 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ecc9b-3607-4b39-aa8a-02f477fffade service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:23.452357 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3477bf-4fed-40b0-8881-4f884cbc01d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:23.453653 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ecc9b-3607-4b39-aa8a-02f477fffade service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:23.453796 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3477bf-4fed-40b0-8881-4f884cbc01d8 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:23.455691 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ecc9b-3607-4b39-aa8a-02f477fffade service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:23.465378 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1055/2096] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:23.470104 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1042/2097] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:28:23.770834 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3477bf-4fed-40b0-8881-4f884cbc01d8 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:23.772549 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4d3477bf-4fed-40b0-8881-4f884cbc01d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:23.816073 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:23.868789 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3477bf-4fed-40b0-8881-4f884cbc01d8 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:23.873810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e658eb6-b122-4575-89bd-157cb0e872fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:23.874850 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e658eb6-b122-4575-89bd-157cb0e872fe service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:23.875131 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e658eb6-b122-4575-89bd-157cb0e872fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:23.875414 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e658eb6-b122-4575-89bd-157cb0e872fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:23.878487 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5e658eb6-b122-4575-89bd-157cb0e872fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:23.975768 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ecc9b-3607-4b39-aa8a-02f477fffade service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:23.977434 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-392ecc9b-3607-4b39-aa8a-02f477fffade service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:23.990551 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e658eb6-b122-4575-89bd-157cb0e872fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:23.993287 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e658eb6-b122-4575-89bd-157cb0e872fe service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:24.005625 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1056/2098] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:24.008106 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ecc9b-3607-4b39-aa8a-02f477fffade service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:24.013545 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37b23a-416b-4d8d-a7b5-7c107582401f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:24.014826 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37b23a-416b-4d8d-a7b5-7c107582401f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:24.015494 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37b23a-416b-4d8d-a7b5-7c107582401f admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:24.016071 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37b23a-416b-4d8d-a7b5-7c107582401f admin admin] PATH_INFO: `/v3/projects/8dca9fa6a94644b1a6d774a3135dd9b6` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:24.017524 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37b23a-416b-4d8d-a7b5-7c107582401f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dca9fa6a94644b1a6d774a3135dd9b6)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:24.019790 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37b23a-416b-4d8d-a7b5-7c107582401f admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:24.120251 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-5d37b23a-416b-4d8d-a7b5-7c107582401f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dca9fa6a94644b1a6d774a3135dd9b6', 'request_id': 'req-5d37b23a-416b-4d8d-a7b5-7c107582401f'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:24.132415 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-5d37b23a-416b-4d8d-a7b5-7c107582401f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dca9fa6a94644b1a6d774a3135dd9b6', 'request_id': 'req-5d37b23a-416b-4d8d-a7b5-7c107582401f'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:24.159033 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-5d37b23a-416b-4d8d-a7b5-7c107582401f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dca9fa6a94644b1a6d774a3135dd9b6', 'request_id': 'req-5d37b23a-416b-4d8d-a7b5-7c107582401f'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:24.181507 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-5d37b23a-416b-4d8d-a7b5-7c107582401f admin admin] The token cache is being invalidate because project 8dca9fa6a94644b1a6d774a3135dd9b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:24.181507 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-5d37b23a-416b-4d8d-a7b5-7c107582401f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:24.181507 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-5d37b23a-416b-4d8d-a7b5-7c107582401f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:24.187295 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1043/2099] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:23 2022] DELETE /identity/v3/projects/8dca9fa6a94644b1a6d774a3135dd9b6 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:24.187496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249607ae-10ba-492f-8437-8fb78ab2e406 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:24.187496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249607ae-10ba-492f-8437-8fb78ab2e406 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:24.187677 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249607ae-10ba-492f-8437-8fb78ab2e406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:24.218420 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-249607ae-10ba-492f-8437-8fb78ab2e406 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:24.233313 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-249607ae-10ba-492f-8437-8fb78ab2e406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:24.342511 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1057/2100] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:24.350499 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b402be-3684-4e13-a752-f1910b7ae4c5 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:24.350794 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b402be-3684-4e13-a752-f1910b7ae4c5 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:24.351076 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b402be-3684-4e13-a752-f1910b7ae4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:24.377425 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-f5b402be-3684-4e13-a752-f1910b7ae4c5 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:24.379353 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f5b402be-3684-4e13-a752-f1910b7ae4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:24.414105 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1044/2101] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:28:24.414951 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249607ae-10ba-492f-8437-8fb78ab2e406 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:24.432889 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249607ae-10ba-492f-8437-8fb78ab2e406 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:24.454602 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac67b42-6b41-4604-bb88-212bf57503c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:24.455402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac67b42-6b41-4604-bb88-212bf57503c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:24.455630 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac67b42-6b41-4604-bb88-212bf57503c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:24.456080 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac67b42-6b41-4604-bb88-212bf57503c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:24.456870 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac67b42-6b41-4604-bb88-212bf57503c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:28:24.457463 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac67b42-6b41-4604-bb88-212bf57503c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:24.460419 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac67b42-6b41-4604-bb88-212bf57503c6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:24.498138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1058/2102] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:28:24.499800 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b402be-3684-4e13-a752-f1910b7ae4c5 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:24.518294 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b402be-3684-4e13-a752-f1910b7ae4c5 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:24.538780 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681e0f5-a854-4b81-bc40-3a2ccf249ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:24.539478 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681e0f5-a854-4b81-bc40-3a2ccf249ff4 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:24.539797 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681e0f5-a854-4b81-bc40-3a2ccf249ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:24.540076 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681e0f5-a854-4b81-bc40-3a2ccf249ff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:24.540827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f681e0f5-a854-4b81-bc40-3a2ccf249ff4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:24.543639 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f681e0f5-a854-4b81-bc40-3a2ccf249ff4 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:24.587763 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1045/2103] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:28:24 2022] POST /identity/v3/projects => generated 361 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:24.593101 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac67b42-6b41-4604-bb88-212bf57503c6 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:24.615416 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac67b42-6b41-4604-bb88-212bf57503c6 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:24.714178 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6071bb-3fe3-45e3-93c3-86fe2610dd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:24.714925 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6071bb-3fe3-45e3-93c3-86fe2610dd58 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:24.715217 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6071bb-3fe3-45e3-93c3-86fe2610dd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:24.715528 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6071bb-3fe3-45e3-93c3-86fe2610dd58 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:24.716262 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6071bb-3fe3-45e3-93c3-86fe2610dd58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:24.718505 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6071bb-3fe3-45e3-93c3-86fe2610dd58 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:24.727839 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:24.741927 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1059/2104] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:28:24 2022] POST /identity/v3/users => generated 281 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:24.747409 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681e0f5-a854-4b81-bc40-3a2ccf249ff4 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:24.762484 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681e0f5-a854-4b81-bc40-3a2ccf249ff4 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:24.770832 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8247d-ad33-4095-a686-05ceb9dfc0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:24.771611 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8247d-ad33-4095-a686-05ceb9dfc0af admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:24.771949 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8247d-ad33-4095-a686-05ceb9dfc0af admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:24.772234 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8247d-ad33-4095-a686-05ceb9dfc0af admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:24.773070 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8247d-ad33-4095-a686-05ceb9dfc0af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:24.775023 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8247d-ad33-4095-a686-05ceb9dfc0af admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:24.796805 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1046/2105] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:24.797529 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6071bb-3fe3-45e3-93c3-86fe2610dd58 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:24.809396 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6071bb-3fe3-45e3-93c3-86fe2610dd58 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:24.814194 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c542045-1190-4e4b-a92a-301f9d9c27bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:24.814928 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c542045-1190-4e4b-a92a-301f9d9c27bd admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:24.815190 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c542045-1190-4e4b-a92a-301f9d9c27bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:24.815419 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c542045-1190-4e4b-a92a-301f9d9c27bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:24.816157 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c542045-1190-4e4b-a92a-301f9d9c27bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:24.818265 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c542045-1190-4e4b-a92a-301f9d9c27bd admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:24.834026 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1060/2106] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 04:28:24.836887 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8247d-ad33-4095-a686-05ceb9dfc0af admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:24.848179 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8247d-ad33-4095-a686-05ceb9dfc0af admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:24.853233 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b537e63-d8c5-4ef3-a323-7b776e5a9d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:24.854348 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b537e63-d8c5-4ef3-a323-7b776e5a9d28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:24.854781 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b537e63-d8c5-4ef3-a323-7b776e5a9d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:24.855132 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b537e63-d8c5-4ef3-a323-7b776e5a9d28 admin admin] PATH_INFO: `/v3/projects/8cfbfc9856eb4190bd479af1ecd90e22/users/e107f69b71924b5ca964e44d2b92f781/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:24.873693 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b537e63-d8c5-4ef3-a323-7b776e5a9d28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cfbfc9856eb4190bd479af1ecd90e22, user_id=e107f69b71924b5ca964e44d2b92f781, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:24.876506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b537e63-d8c5-4ef3-a323-7b776e5a9d28 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:24.894913 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1047/2107] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:24 2022] PUT /identity/v3/projects/8cfbfc9856eb4190bd479af1ecd90e22/users/e107f69b71924b5ca964e44d2b92f781/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:28:24.905913 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb7fac-e4e8-436d-8161-787d83c51f6b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:24.906749 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb7fac-e4e8-436d-8161-787d83c51f6b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:24.907248 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb7fac-e4e8-436d-8161-787d83c51f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:24.943102 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-bbeb7fac-e4e8-436d-8161-787d83c51f6b None None] MFA Rules not processed for user `e107f69b71924b5ca964e44d2b92f781`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:24.944838 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-bbeb7fac-e4e8-436d-8161-787d83c51f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:25.046898 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1061/2108] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:25.082915 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b537e63-d8c5-4ef3-a323-7b776e5a9d28 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:25.085275 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3b537e63-d8c5-4ef3-a323-7b776e5a9d28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:25.128047 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:25.160881 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b537e63-d8c5-4ef3-a323-7b776e5a9d28 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:25.165593 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6b4e5-a2fe-40ce-ac2c-7dcc0c80696c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:25.167436 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6b4e5-a2fe-40ce-ac2c-7dcc0c80696c service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:25.167436 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6b4e5-a2fe-40ce-ac2c-7dcc0c80696c service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:25.167629 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6b4e5-a2fe-40ce-ac2c-7dcc0c80696c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:25.177144 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6b4e5-a2fe-40ce-ac2c-7dcc0c80696c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:25.178648 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6b4e5-a2fe-40ce-ac2c-7dcc0c80696c service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:25.190229 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1048/2109] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:25 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:28:25.209373 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb7fac-e4e8-436d-8161-787d83c51f6b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:25.351932 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb7fac-e4e8-436d-8161-787d83c51f6b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:25.360839 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f2e66-6f37-4d5d-a5d1-d2cb34c045fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:25.361747 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f2e66-6f37-4d5d-a5d1-d2cb34c045fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:25.362220 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f2e66-6f37-4d5d-a5d1-d2cb34c045fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:25.362497 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f2e66-6f37-4d5d-a5d1-d2cb34c045fb admin admin] PATH_INFO: `/v3/users/e107f69b71924b5ca964e44d2b92f781` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:25.363789 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f2e66-6f37-4d5d-a5d1-d2cb34c045fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e107f69b71924b5ca964e44d2b92f781)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:25.365988 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f2e66-6f37-4d5d-a5d1-d2cb34c045fb admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:25.424224 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-059f2e66-6f37-4d5d-a5d1-d2cb34c045fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e107f69b71924b5ca964e44d2b92f781'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:25.426069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-059f2e66-6f37-4d5d-a5d1-d2cb34c045fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e107f69b71924b5ca964e44d2b92f781'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:25.448597 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-059f2e66-6f37-4d5d-a5d1-d2cb34c045fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e107f69b71924b5ca964e44d2b92f781'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:25.455917 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:25.466378 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-059f2e66-6f37-4d5d-a5d1-d2cb34c045fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e107f69b71924b5ca964e44d2b92f781'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:25.478104 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-059f2e66-6f37-4d5d-a5d1-d2cb34c045fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e107f69b71924b5ca964e44d2b92f781'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:25.494171 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1062/2110] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:25 2022] DELETE /identity/v3/users/e107f69b71924b5ca964e44d2b92f781 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:25.498999 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75766e-4298-47b2-abc4-92e1e2d267f7 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:25.499353 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75766e-4298-47b2-abc4-92e1e2d267f7 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:25.499598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75766e-4298-47b2-abc4-92e1e2d267f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:25.532422 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-3f75766e-4298-47b2-abc4-92e1e2d267f7 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:25.533687 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3f75766e-4298-47b2-abc4-92e1e2d267f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:25.642419 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1049/2111] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:25.655199 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f2e66-6f37-4d5d-a5d1-d2cb34c045fb admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:25.656922 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-059f2e66-6f37-4d5d-a5d1-d2cb34c045fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:25.834777 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f2e66-6f37-4d5d-a5d1-d2cb34c045fb admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:25.838867 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e639b9-0346-4b93-9b1b-0d7799ae6a27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:25.839888 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e639b9-0346-4b93-9b1b-0d7799ae6a27 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:25.840432 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e639b9-0346-4b93-9b1b-0d7799ae6a27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:25.841283 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e639b9-0346-4b93-9b1b-0d7799ae6a27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:25.871698 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e639b9-0346-4b93-9b1b-0d7799ae6a27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:25.873579 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e639b9-0346-4b93-9b1b-0d7799ae6a27 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:25.902217 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1063/2112] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:26.283788 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f75766e-4298-47b2-abc4-92e1e2d267f7 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:26.286501 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3f75766e-4298-47b2-abc4-92e1e2d267f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:26.301134 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f75766e-4298-47b2-abc4-92e1e2d267f7 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:26.306357 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcbfc9f-30d9-4741-b495-39774d3ea890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:26.307788 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbfc9f-30d9-4741-b495-39774d3ea890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:26.308078 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbfc9f-30d9-4741-b495-39774d3ea890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:26.308578 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbfc9f-30d9-4741-b495-39774d3ea890 admin admin] PATH_INFO: `/v3/projects/8cfbfc9856eb4190bd479af1ecd90e22` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:26.310157 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcbfc9f-30d9-4741-b495-39774d3ea890 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cfbfc9856eb4190bd479af1ecd90e22)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:26.312187 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcbfc9f-30d9-4741-b495-39774d3ea890 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:26.400988 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-2bcbfc9f-30d9-4741-b495-39774d3ea890 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cfbfc9856eb4190bd479af1ecd90e22', 'request_id': 'req-2bcbfc9f-30d9-4741-b495-39774d3ea890'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:26.412868 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-2bcbfc9f-30d9-4741-b495-39774d3ea890 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cfbfc9856eb4190bd479af1ecd90e22', 'request_id': 'req-2bcbfc9f-30d9-4741-b495-39774d3ea890'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:26.424704 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-2bcbfc9f-30d9-4741-b495-39774d3ea890 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cfbfc9856eb4190bd479af1ecd90e22', 'request_id': 'req-2bcbfc9f-30d9-4741-b495-39774d3ea890'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:26.439517 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-2bcbfc9f-30d9-4741-b495-39774d3ea890 admin admin] The token cache is being invalidate because project 8cfbfc9856eb4190bd479af1ecd90e22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:26.439829 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-2bcbfc9f-30d9-4741-b495-39774d3ea890 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:26.440691 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-2bcbfc9f-30d9-4741-b495-39774d3ea890 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:26.443050 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1050/2113] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:26 2022] DELETE /identity/v3/projects/8cfbfc9856eb4190bd479af1ecd90e22 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:26.450994 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d513f6-220c-427e-bb2e-fe6f2868a3b7 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:26.451621 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d513f6-220c-427e-bb2e-fe6f2868a3b7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:26.451621 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d513f6-220c-427e-bb2e-fe6f2868a3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:26.478451 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d6d513f6-220c-427e-bb2e-fe6f2868a3b7 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:26.480505 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d6d513f6-220c-427e-bb2e-fe6f2868a3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:26.553037 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1064/2114] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:26.563304 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4b8d6-c184-4362-a4dc-c2e987c01de6 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:26.563860 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4b8d6-c184-4362-a4dc-c2e987c01de6 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:26.564297 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4b8d6-c184-4362-a4dc-c2e987c01de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:26.584786 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-b1d4b8d6-c184-4362-a4dc-c2e987c01de6 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:26.586373 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-b1d4b8d6-c184-4362-a4dc-c2e987c01de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:26.596394 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1051/2115] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:26.601457 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d513f6-220c-427e-bb2e-fe6f2868a3b7 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:26.613586 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d513f6-220c-427e-bb2e-fe6f2868a3b7 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:26.618951 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca00ed-f720-442c-a63e-dea023e0d8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:26.619813 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca00ed-f720-442c-a63e-dea023e0d8ce admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:26.620171 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca00ed-f720-442c-a63e-dea023e0d8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:26.620518 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca00ed-f720-442c-a63e-dea023e0d8ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:26.621364 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca00ed-f720-442c-a63e-dea023e0d8ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:28:26.621784 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca00ed-f720-442c-a63e-dea023e0d8ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:26.623559 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca00ed-f720-442c-a63e-dea023e0d8ce admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:26.642019 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1065/2116] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:28:26.643849 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4b8d6-c184-4362-a4dc-c2e987c01de6 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:26.656798 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4b8d6-c184-4362-a4dc-c2e987c01de6 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:26.663185 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0df32-83ea-4aa8-a72c-e3a364fad299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:26.663882 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0df32-83ea-4aa8-a72c-e3a364fad299 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:26.664168 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0df32-83ea-4aa8-a72c-e3a364fad299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:26.664444 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0df32-83ea-4aa8-a72c-e3a364fad299 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:26.665172 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb0df32-83ea-4aa8-a72c-e3a364fad299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:26.670701 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb0df32-83ea-4aa8-a72c-e3a364fad299 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:26.714350 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1052/2117] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:28:26 2022] POST /identity/v3/projects => generated 375 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:26.717240 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca00ed-f720-442c-a63e-dea023e0d8ce admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:26.727670 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca00ed-f720-442c-a63e-dea023e0d8ce admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:26.800862 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09dec1-b8c2-4757-a73a-d58b8326d6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:26.801903 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09dec1-b8c2-4757-a73a-d58b8326d6ae admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:26.801903 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09dec1-b8c2-4757-a73a-d58b8326d6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:26.802411 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09dec1-b8c2-4757-a73a-d58b8326d6ae admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:26.803208 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09dec1-b8c2-4757-a73a-d58b8326d6ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:26.805252 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09dec1-b8c2-4757-a73a-d58b8326d6ae admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:26.832201 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1066/2118] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:28:26 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:26.838295 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0df32-83ea-4aa8-a72c-e3a364fad299 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:26.852502 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0df32-83ea-4aa8-a72c-e3a364fad299 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:26.857379 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0998c6b-4eea-49a4-9ed0-588f65d2a229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:26.858070 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0998c6b-4eea-49a4-9ed0-588f65d2a229 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:26.858351 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0998c6b-4eea-49a4-9ed0-588f65d2a229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:26.858633 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0998c6b-4eea-49a4-9ed0-588f65d2a229 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:26.859358 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0998c6b-4eea-49a4-9ed0-588f65d2a229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:26.860950 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0998c6b-4eea-49a4-9ed0-588f65d2a229 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:26.873711 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1053/2119] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 04:28:26.877839 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09dec1-b8c2-4757-a73a-d58b8326d6ae admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:26.902397 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09dec1-b8c2-4757-a73a-d58b8326d6ae admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:26.910826 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eff54b-681a-45b8-b058-ad1f45f8efba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:26.911404 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eff54b-681a-45b8-b058-ad1f45f8efba admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:26.911795 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eff54b-681a-45b8-b058-ad1f45f8efba admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:26.912287 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eff54b-681a-45b8-b058-ad1f45f8efba admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:26.913198 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eff54b-681a-45b8-b058-ad1f45f8efba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:26.915629 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eff54b-681a-45b8-b058-ad1f45f8efba admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:26.919063 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:26.933521 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1067/2120] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:26.954804 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0998c6b-4eea-49a4-9ed0-588f65d2a229 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:26.984792 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0998c6b-4eea-49a4-9ed0-588f65d2a229 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:26.998700 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae2403-be09-4d4b-acac-adf67c5df2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:27.000727 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae2403-be09-4d4b-acac-adf67c5df2b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:27.002553 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae2403-be09-4d4b-acac-adf67c5df2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:27.003030 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae2403-be09-4d4b-acac-adf67c5df2b9 admin admin] PATH_INFO: `/v3/projects/8e2d2644e40c4b78a75ef2cdcb4eb777/users/fcc229a08bf04e7fa7405c93dcfda708/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:27.036519 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae2403-be09-4d4b-acac-adf67c5df2b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e2d2644e40c4b78a75ef2cdcb4eb777, user_id=fcc229a08bf04e7fa7405c93dcfda708, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:27.039428 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae2403-be09-4d4b-acac-adf67c5df2b9 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:27.043115 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:27.078654 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1054/2121] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:26 2022] PUT /identity/v3/projects/8e2d2644e40c4b78a75ef2cdcb4eb777/users/fcc229a08bf04e7fa7405c93dcfda708/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:27.093188 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370cd32c-3ba1-47b2-b7fa-adf235fdc7e5 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:27.093582 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370cd32c-3ba1-47b2-b7fa-adf235fdc7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:27.093961 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370cd32c-3ba1-47b2-b7fa-adf235fdc7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:27.186350 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-370cd32c-3ba1-47b2-b7fa-adf235fdc7e5 None None] MFA Rules not processed for user `fcc229a08bf04e7fa7405c93dcfda708`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:27.187746 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-370cd32c-3ba1-47b2-b7fa-adf235fdc7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:27.345160 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1068/2122] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:27.519367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae2403-be09-4d4b-acac-adf67c5df2b9 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:27.522375 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e7ae2403-be09-4d4b-acac-adf67c5df2b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:27.649362 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae2403-be09-4d4b-acac-adf67c5df2b9 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:27.656871 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c28dac-0729-483c-b4ff-aabca0880c28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:27.657834 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c28dac-0729-483c-b4ff-aabca0880c28 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:27.658491 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c28dac-0729-483c-b4ff-aabca0880c28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:27.658927 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c28dac-0729-483c-b4ff-aabca0880c28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:27.675484 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c28dac-0729-483c-b4ff-aabca0880c28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:27.685686 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c28dac-0729-483c-b4ff-aabca0880c28 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:27.718494 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1055/2123] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:29.796525 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370cd32c-3ba1-47b2-b7fa-adf235fdc7e5 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:29.811333 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370cd32c-3ba1-47b2-b7fa-adf235fdc7e5 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:29.816631 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45742a-c2d8-472f-a836-98dcfe4e48c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:29.817462 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45742a-c2d8-472f-a836-98dcfe4e48c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:29.818144 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45742a-c2d8-472f-a836-98dcfe4e48c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:29.818537 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45742a-c2d8-472f-a836-98dcfe4e48c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:29.821290 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ad45742a-c2d8-472f-a836-98dcfe4e48c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:29.980851 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45742a-c2d8-472f-a836-98dcfe4e48c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:29.982552 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45742a-c2d8-472f-a836-98dcfe4e48c5 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:30.000963 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1069/2124] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:30.031224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2f0ea-e625-4adc-b24f-cedae52f0c58 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:30.032406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2f0ea-e625-4adc-b24f-cedae52f0c58 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:30.032877 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2f0ea-e625-4adc-b24f-cedae52f0c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:30.120373 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-95e2f0ea-e625-4adc-b24f-cedae52f0c58 None None] MFA Rules not processed for user `d5a8390d1220475582b70d1347a1ef14`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:30.122461 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-95e2f0ea-e625-4adc-b24f-cedae52f0c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:30.310481 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1056/2125] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:30.332733 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45742a-c2d8-472f-a836-98dcfe4e48c5 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:30.335637 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ad45742a-c2d8-472f-a836-98dcfe4e48c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:30.492614 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45742a-c2d8-472f-a836-98dcfe4e48c5 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:30.504273 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6ffe8-0f55-4215-8940-6f396a970577 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:30.504961 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6ffe8-0f55-4215-8940-6f396a970577 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:30.505249 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6ffe8-0f55-4215-8940-6f396a970577 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:30.505533 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6ffe8-0f55-4215-8940-6f396a970577 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:30.515570 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6ffe8-0f55-4215-8940-6f396a970577 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:30.517295 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6ffe8-0f55-4215-8940-6f396a970577 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:30.529677 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1070/2126] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:28:32.968817 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbec1af-6706-4659-a190-ed050a52e079 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:32.969432 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbec1af-6706-4659-a190-ed050a52e079 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:32.969432 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbec1af-6706-4659-a190-ed050a52e079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:32.999145 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-cdbec1af-6706-4659-a190-ed050a52e079 None None] MFA Rules not processed for user `d5a8390d1220475582b70d1347a1ef14`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:33.013268 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-cdbec1af-6706-4659-a190-ed050a52e079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:33.014036 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1057/2127] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:34.519809 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6ffe8-0f55-4215-8940-6f396a970577 service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:34.521488 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-efb6ffe8-0f55-4215-8940-6f396a970577 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:34.550397 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:34.659266 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6ffe8-0f55-4215-8940-6f396a970577 service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:34.667703 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e6bd2-0808-4744-9774-c2f1b6ce6157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:34.669200 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e6bd2-0808-4744-9774-c2f1b6ce6157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:34.669733 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e6bd2-0808-4744-9774-c2f1b6ce6157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:34.670249 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e6bd2-0808-4744-9774-c2f1b6ce6157 admin admin] PATH_INFO: `/v3/users/34aa6d2c457747ecbab4a80faa2748ec` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:34.673949 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e6bd2-0808-4744-9774-c2f1b6ce6157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34aa6d2c457747ecbab4a80faa2748ec)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:34.676927 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e6bd2-0808-4744-9774-c2f1b6ce6157 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:34.756648 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-281e6bd2-0808-4744-9774-c2f1b6ce6157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34aa6d2c457747ecbab4a80faa2748ec'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:34.757464 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-281e6bd2-0808-4744-9774-c2f1b6ce6157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34aa6d2c457747ecbab4a80faa2748ec'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:34.776514 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-281e6bd2-0808-4744-9774-c2f1b6ce6157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34aa6d2c457747ecbab4a80faa2748ec'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:34.794384 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-281e6bd2-0808-4744-9774-c2f1b6ce6157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34aa6d2c457747ecbab4a80faa2748ec'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:34.795861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-281e6bd2-0808-4744-9774-c2f1b6ce6157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34aa6d2c457747ecbab4a80faa2748ec'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:34.818033 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1071/2128] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:34 2022] DELETE /identity/v3/users/34aa6d2c457747ecbab4a80faa2748ec => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:34.823119 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e42ef-d333-4f71-91b3-5467af125016 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:34.823935 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e42ef-d333-4f71-91b3-5467af125016 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:34.823935 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e42ef-d333-4f71-91b3-5467af125016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:34.867170 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-e46e42ef-d333-4f71-91b3-5467af125016 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:34.869156 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e46e42ef-d333-4f71-91b3-5467af125016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:35.018093 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1058/2129] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:35.030540 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e6bd2-0808-4744-9774-c2f1b6ce6157 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:35.034761 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-281e6bd2-0808-4744-9774-c2f1b6ce6157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:35.186241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e6bd2-0808-4744-9774-c2f1b6ce6157 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:35.193648 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b3030-f933-4186-bee3-a7f0b1a58e09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:35.194710 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b3030-f933-4186-bee3-a7f0b1a58e09 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:35.194710 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b3030-f933-4186-bee3-a7f0b1a58e09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:35.195173 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b3030-f933-4186-bee3-a7f0b1a58e09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:35.208377 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b3030-f933-4186-bee3-a7f0b1a58e09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:35.212443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b3030-f933-4186-bee3-a7f0b1a58e09 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:35.228578 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1072/2130] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:35.842403 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e42ef-d333-4f71-91b3-5467af125016 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:35.846027 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e46e42ef-d333-4f71-91b3-5467af125016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:35.879144 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e42ef-d333-4f71-91b3-5467af125016 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:35.894711 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee30c8-0b62-4462-a5c0-314d0994dbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:35.896036 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee30c8-0b62-4462-a5c0-314d0994dbd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:35.896533 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee30c8-0b62-4462-a5c0-314d0994dbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:35.897015 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee30c8-0b62-4462-a5c0-314d0994dbd8 admin admin] PATH_INFO: `/v3/projects/2d50c966697b44eca05374e249954e90` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:35.900772 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee30c8-0b62-4462-a5c0-314d0994dbd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d50c966697b44eca05374e249954e90)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:35.905928 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee30c8-0b62-4462-a5c0-314d0994dbd8 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:35.961204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:36.094771 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-30ee30c8-0b62-4462-a5c0-314d0994dbd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d50c966697b44eca05374e249954e90', 'request_id': 'req-30ee30c8-0b62-4462-a5c0-314d0994dbd8'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:36.112606 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-30ee30c8-0b62-4462-a5c0-314d0994dbd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d50c966697b44eca05374e249954e90', 'request_id': 'req-30ee30c8-0b62-4462-a5c0-314d0994dbd8'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:36.135863 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-30ee30c8-0b62-4462-a5c0-314d0994dbd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d50c966697b44eca05374e249954e90', 'request_id': 'req-30ee30c8-0b62-4462-a5c0-314d0994dbd8'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:36.153130 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-30ee30c8-0b62-4462-a5c0-314d0994dbd8 admin admin] The token cache is being invalidate because project 2d50c966697b44eca05374e249954e90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:36.153586 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-30ee30c8-0b62-4462-a5c0-314d0994dbd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:36.154411 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-30ee30c8-0b62-4462-a5c0-314d0994dbd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:36.156361 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1059/2131] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:35 2022] DELETE /identity/v3/projects/2d50c966697b44eca05374e249954e90 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:36.161738 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b3030-f933-4186-bee3-a7f0b1a58e09 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:36.186766 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b3030-f933-4186-bee3-a7f0b1a58e09 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:36.312005 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:36.350643 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbccf86-9893-4d4a-8063-ac425c91f495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:36.351567 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbccf86-9893-4d4a-8063-ac425c91f495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:36.352001 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbccf86-9893-4d4a-8063-ac425c91f495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:36.352702 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbccf86-9893-4d4a-8063-ac425c91f495 admin admin] PATH_INFO: `/v3/users/c799871b4b8240a09de2425c5b50d0fd` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:36.354188 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbccf86-9893-4d4a-8063-ac425c91f495 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c799871b4b8240a09de2425c5b50d0fd)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:36.356895 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbccf86-9893-4d4a-8063-ac425c91f495 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:36.422144 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4fbccf86-9893-4d4a-8063-ac425c91f495 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c799871b4b8240a09de2425c5b50d0fd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:36.423441 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4fbccf86-9893-4d4a-8063-ac425c91f495 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c799871b4b8240a09de2425c5b50d0fd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:36.443331 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4fbccf86-9893-4d4a-8063-ac425c91f495 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c799871b4b8240a09de2425c5b50d0fd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:36.454267 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4fbccf86-9893-4d4a-8063-ac425c91f495 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c799871b4b8240a09de2425c5b50d0fd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:36.454992 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4fbccf86-9893-4d4a-8063-ac425c91f495 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c799871b4b8240a09de2425c5b50d0fd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:36.471210 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1073/2132] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:36 2022] DELETE /identity/v3/users/c799871b4b8240a09de2425c5b50d0fd => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:36.921578 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee30c8-0b62-4462-a5c0-314d0994dbd8 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:36.934667 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-30ee30c8-0b62-4462-a5c0-314d0994dbd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:36.973943 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee30c8-0b62-4462-a5c0-314d0994dbd8 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:37.101239 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587b9eb-9ce3-4d1f-b315-3638a9b6e732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:37.102177 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587b9eb-9ce3-4d1f-b315-3638a9b6e732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:37.102502 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587b9eb-9ce3-4d1f-b315-3638a9b6e732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:37.102784 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587b9eb-9ce3-4d1f-b315-3638a9b6e732 admin admin] PATH_INFO: `/v3/projects/b6b5c0146ae44affa32a9eda0ee0fb61` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:37.104082 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a587b9eb-9ce3-4d1f-b315-3638a9b6e732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6b5c0146ae44affa32a9eda0ee0fb61)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:37.106753 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a587b9eb-9ce3-4d1f-b315-3638a9b6e732 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:37.203413 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-a587b9eb-9ce3-4d1f-b315-3638a9b6e732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6b5c0146ae44affa32a9eda0ee0fb61', 'request_id': 'req-a587b9eb-9ce3-4d1f-b315-3638a9b6e732'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:37.217954 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-a587b9eb-9ce3-4d1f-b315-3638a9b6e732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6b5c0146ae44affa32a9eda0ee0fb61', 'request_id': 'req-a587b9eb-9ce3-4d1f-b315-3638a9b6e732'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:37.233547 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-a587b9eb-9ce3-4d1f-b315-3638a9b6e732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6b5c0146ae44affa32a9eda0ee0fb61', 'request_id': 'req-a587b9eb-9ce3-4d1f-b315-3638a9b6e732'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:37.260613 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-a587b9eb-9ce3-4d1f-b315-3638a9b6e732 admin admin] The token cache is being invalidate because project b6b5c0146ae44affa32a9eda0ee0fb61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:37.261194 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-a587b9eb-9ce3-4d1f-b315-3638a9b6e732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:37.262556 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-a587b9eb-9ce3-4d1f-b315-3638a9b6e732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:37.265300 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1060/2133] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:36 2022] DELETE /identity/v3/projects/b6b5c0146ae44affa32a9eda0ee0fb61 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:37.269320 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbccf86-9893-4d4a-8063-ac425c91f495 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:37.270944 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4fbccf86-9893-4d4a-8063-ac425c91f495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:37.297230 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbccf86-9893-4d4a-8063-ac425c91f495 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:37.435091 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ad2aa-ca29-42da-aac0-640c4fda6c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:37.435992 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ad2aa-ca29-42da-aac0-640c4fda6c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:37.436276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ad2aa-ca29-42da-aac0-640c4fda6c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:37.436555 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ad2aa-ca29-42da-aac0-640c4fda6c34 admin admin] PATH_INFO: `/v3/users/8094f49b3ec84b56acda9a398b7e9cb6` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:37.437829 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ad2aa-ca29-42da-aac0-640c4fda6c34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8094f49b3ec84b56acda9a398b7e9cb6)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:37.439987 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ad2aa-ca29-42da-aac0-640c4fda6c34 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:37.541504 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5c6ad2aa-ca29-42da-aac0-640c4fda6c34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8094f49b3ec84b56acda9a398b7e9cb6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:37.542476 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5c6ad2aa-ca29-42da-aac0-640c4fda6c34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8094f49b3ec84b56acda9a398b7e9cb6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:37.549619 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:37.561450 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5c6ad2aa-ca29-42da-aac0-640c4fda6c34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8094f49b3ec84b56acda9a398b7e9cb6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:37.581143 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5c6ad2aa-ca29-42da-aac0-640c4fda6c34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8094f49b3ec84b56acda9a398b7e9cb6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:37.582132 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5c6ad2aa-ca29-42da-aac0-640c4fda6c34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8094f49b3ec84b56acda9a398b7e9cb6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:37.609648 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1074/2134] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:37 2022] DELETE /identity/v3/users/8094f49b3ec84b56acda9a398b7e9cb6 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:38.083059 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587b9eb-9ce3-4d1f-b315-3638a9b6e732 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:38.085369 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a587b9eb-9ce3-4d1f-b315-3638a9b6e732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:38.133727 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587b9eb-9ce3-4d1f-b315-3638a9b6e732 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:38.258338 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:38.309817 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549758b7-b6c5-4596-94fa-03270e48a01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:38.310942 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549758b7-b6c5-4596-94fa-03270e48a01e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:38.311477 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549758b7-b6c5-4596-94fa-03270e48a01e admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:38.312004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549758b7-b6c5-4596-94fa-03270e48a01e admin admin] PATH_INFO: `/v3/projects/5dbd9299c30e4cc8b9c30afd47487a49` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:38.313897 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549758b7-b6c5-4596-94fa-03270e48a01e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dbd9299c30e4cc8b9c30afd47487a49)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:38.316676 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549758b7-b6c5-4596-94fa-03270e48a01e admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:38.410174 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-549758b7-b6c5-4596-94fa-03270e48a01e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dbd9299c30e4cc8b9c30afd47487a49', 'request_id': 'req-549758b7-b6c5-4596-94fa-03270e48a01e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:38.439704 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-549758b7-b6c5-4596-94fa-03270e48a01e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dbd9299c30e4cc8b9c30afd47487a49', 'request_id': 'req-549758b7-b6c5-4596-94fa-03270e48a01e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:38.462554 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-549758b7-b6c5-4596-94fa-03270e48a01e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dbd9299c30e4cc8b9c30afd47487a49', 'request_id': 'req-549758b7-b6c5-4596-94fa-03270e48a01e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:38.478024 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-549758b7-b6c5-4596-94fa-03270e48a01e admin admin] The token cache is being invalidate because project 5dbd9299c30e4cc8b9c30afd47487a49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:38.479438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-549758b7-b6c5-4596-94fa-03270e48a01e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:38.480723 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-549758b7-b6c5-4596-94fa-03270e48a01e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:38.488393 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1061/2135] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:38 2022] DELETE /identity/v3/projects/5dbd9299c30e4cc8b9c30afd47487a49 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:38.492430 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a174f-7384-4cfd-9064-8c88dba6377a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:38.492928 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a174f-7384-4cfd-9064-8c88dba6377a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:38.493064 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a174f-7384-4cfd-9064-8c88dba6377a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:38.527379 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b38a174f-7384-4cfd-9064-8c88dba6377a None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:38.528670 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b38a174f-7384-4cfd-9064-8c88dba6377a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:38.672522 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1075/2136] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:38.681537 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f7acd-d0d9-4ee1-9238-28ccb721f350 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:38.682740 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f7acd-d0d9-4ee1-9238-28ccb721f350 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:38.683170 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f7acd-d0d9-4ee1-9238-28ccb721f350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:38.710985 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-bd0f7acd-d0d9-4ee1-9238-28ccb721f350 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:38.713081 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-bd0f7acd-d0d9-4ee1-9238-28ccb721f350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:38.723556 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1062/2137] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:38.727532 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a174f-7384-4cfd-9064-8c88dba6377a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:38.743988 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a174f-7384-4cfd-9064-8c88dba6377a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:38.754265 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9c427-61ca-4335-b880-636bb6463f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:38.758226 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9c427-61ca-4335-b880-636bb6463f16 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:38.758690 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9c427-61ca-4335-b880-636bb6463f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:38.759130 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9c427-61ca-4335-b880-636bb6463f16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:38.760310 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de9c427-61ca-4335-b880-636bb6463f16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:28:38.760631 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de9c427-61ca-4335-b880-636bb6463f16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:38.762447 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de9c427-61ca-4335-b880-636bb6463f16 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:38.778358 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1076/2138] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:28:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:28:38.780439 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f7acd-d0d9-4ee1-9238-28ccb721f350 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:38.807587 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f7acd-d0d9-4ee1-9238-28ccb721f350 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:38.819298 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ceddb-701f-44d0-bb83-0bbc37bd4aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:38.819562 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ceddb-701f-44d0-bb83-0bbc37bd4aac admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:38.819845 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ceddb-701f-44d0-bb83-0bbc37bd4aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:38.820350 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ceddb-701f-44d0-bb83-0bbc37bd4aac admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:38.821065 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ceddb-701f-44d0-bb83-0bbc37bd4aac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:38.824316 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ceddb-701f-44d0-bb83-0bbc37bd4aac admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:38.858468 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1063/2139] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:28:38 2022] POST /identity/v3/projects => generated 407 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:38.862325 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9c427-61ca-4335-b880-636bb6463f16 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:38.876046 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9c427-61ca-4335-b880-636bb6463f16 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:38.957495 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373ad94-bc96-4b23-b719-690e4f9ba406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:38.958639 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373ad94-bc96-4b23-b719-690e4f9ba406 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:38.959105 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373ad94-bc96-4b23-b719-690e4f9ba406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:38.959559 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373ad94-bc96-4b23-b719-690e4f9ba406 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:38.960514 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373ad94-bc96-4b23-b719-690e4f9ba406 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:38.963499 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373ad94-bc96-4b23-b719-690e4f9ba406 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:38.996330 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1077/2140] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:28:38 2022] POST /identity/v3/users => generated 304 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:28:38.997521 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ceddb-701f-44d0-bb83-0bbc37bd4aac admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:39.008715 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ceddb-701f-44d0-bb83-0bbc37bd4aac admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:39.017338 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fcae9f-0b58-4d01-89ed-727dbcd15f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:39.018150 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcae9f-0b58-4d01-89ed-727dbcd15f20 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:39.018436 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcae9f-0b58-4d01-89ed-727dbcd15f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:39.018772 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcae9f-0b58-4d01-89ed-727dbcd15f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:39.019517 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fcae9f-0b58-4d01-89ed-727dbcd15f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:39.021512 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fcae9f-0b58-4d01-89ed-727dbcd15f20 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:39.037148 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1064/2141] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:39.039438 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373ad94-bc96-4b23-b719-690e4f9ba406 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:39.052804 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373ad94-bc96-4b23-b719-690e4f9ba406 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:39.058540 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f7baa-07ec-4500-95b2-ea270da70f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:39.059528 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f7baa-07ec-4500-95b2-ea270da70f6b admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:39.059889 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f7baa-07ec-4500-95b2-ea270da70f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:39.060169 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f7baa-07ec-4500-95b2-ea270da70f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:39.060936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f7baa-07ec-4500-95b2-ea270da70f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:39.064033 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f7baa-07ec-4500-95b2-ea270da70f6b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:39.078153 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1078/2142] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:39.080893 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fcae9f-0b58-4d01-89ed-727dbcd15f20 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:39.093089 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fcae9f-0b58-4d01-89ed-727dbcd15f20 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:39.098273 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e245c9-4a9b-49e1-b4ec-7fa292d05d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:39.099259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e245c9-4a9b-49e1-b4ec-7fa292d05d06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:39.099549 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e245c9-4a9b-49e1-b4ec-7fa292d05d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:39.100010 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e245c9-4a9b-49e1-b4ec-7fa292d05d06 admin admin] PATH_INFO: `/v3/projects/3096d9446c774c519ef81e7c8ee6ad35/users/ef4af76aa42c4a61a0b863c09f84fc3c/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:39.118228 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e245c9-4a9b-49e1-b4ec-7fa292d05d06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3096d9446c774c519ef81e7c8ee6ad35, user_id=ef4af76aa42c4a61a0b863c09f84fc3c, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:39.121115 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e245c9-4a9b-49e1-b4ec-7fa292d05d06 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:39.136164 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1065/2143] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:39 2022] PUT /identity/v3/projects/3096d9446c774c519ef81e7c8ee6ad35/users/ef4af76aa42c4a61a0b863c09f84fc3c/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:39.147942 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c00818-3264-4845-8512-6438841fcae9 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:39.148353 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c00818-3264-4845-8512-6438841fcae9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:39.148710 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c00818-3264-4845-8512-6438841fcae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:39.183723 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-34c00818-3264-4845-8512-6438841fcae9 None None] MFA Rules not processed for user `ef4af76aa42c4a61a0b863c09f84fc3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:39.185208 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-34c00818-3264-4845-8512-6438841fcae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:39.218394 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:39.273345 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1079/2144] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:39 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:28:39.278639 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e245c9-4a9b-49e1-b4ec-7fa292d05d06 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:39.347343 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e245c9-4a9b-49e1-b4ec-7fa292d05d06 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:39.352841 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b352b-6f02-4631-affe-185d449ff828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:39.353760 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b352b-6f02-4631-affe-185d449ff828 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:39.354101 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b352b-6f02-4631-affe-185d449ff828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:39.354430 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b352b-6f02-4631-affe-185d449ff828 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:39.355065 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b352b-6f02-4631-affe-185d449ff828 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:39.357369 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b352b-6f02-4631-affe-185d449ff828 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:39.362339 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:39.405006 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1066/2145] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:28:39 2022] POST /identity/v3/projects => generated 407 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:39.409786 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c00818-3264-4845-8512-6438841fcae9 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:39.420822 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c00818-3264-4845-8512-6438841fcae9 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:39.490588 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7dc678-e20f-402b-8a20-67fdb6fdd2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:39.491265 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7dc678-e20f-402b-8a20-67fdb6fdd2cb admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:39.491551 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7dc678-e20f-402b-8a20-67fdb6fdd2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:39.491829 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7dc678-e20f-402b-8a20-67fdb6fdd2cb admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:39.492530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7dc678-e20f-402b-8a20-67fdb6fdd2cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:39.494962 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7dc678-e20f-402b-8a20-67fdb6fdd2cb admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:39.515471 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1080/2146] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:28:39 2022] POST /identity/v3/users => generated 310 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:28:39.519812 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b352b-6f02-4631-affe-185d449ff828 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:39.534192 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b352b-6f02-4631-affe-185d449ff828 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:39.539832 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021975e-18d3-491f-9cd3-871c103a262c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:39.540541 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021975e-18d3-491f-9cd3-871c103a262c admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:39.540879 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021975e-18d3-491f-9cd3-871c103a262c admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:39.541329 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021975e-18d3-491f-9cd3-871c103a262c admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:39.542209 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021975e-18d3-491f-9cd3-871c103a262c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:39.543930 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021975e-18d3-491f-9cd3-871c103a262c admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:39.555055 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1067/2147] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 04:28:39.559874 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7dc678-e20f-402b-8a20-67fdb6fdd2cb admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:39.569900 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7dc678-e20f-402b-8a20-67fdb6fdd2cb admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:39.575545 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ddf03-c876-405a-bd5b-6151776f7c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:39.576443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ddf03-c876-405a-bd5b-6151776f7c05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:39.576725 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ddf03-c876-405a-bd5b-6151776f7c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:39.577000 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ddf03-c876-405a-bd5b-6151776f7c05 admin admin] PATH_INFO: `/v3/projects/bf1fe42d17da40d8b041581f8a644401/users/b200b5d77c3145bebe4065261d776d53/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:39.593157 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ddf03-c876-405a-bd5b-6151776f7c05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf1fe42d17da40d8b041581f8a644401, user_id=b200b5d77c3145bebe4065261d776d53, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:39.595873 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ddf03-c876-405a-bd5b-6151776f7c05 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:39.609990 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1081/2148] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:39 2022] PUT /identity/v3/projects/bf1fe42d17da40d8b041581f8a644401/users/b200b5d77c3145bebe4065261d776d53/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:39.614129 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021975e-18d3-491f-9cd3-871c103a262c admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:39.624174 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021975e-18d3-491f-9cd3-871c103a262c admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:39.683618 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc08f8c-7ab9-46de-94b4-50a01ae027e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:39.684296 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc08f8c-7ab9-46de-94b4-50a01ae027e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:39.684696 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc08f8c-7ab9-46de-94b4-50a01ae027e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:39.684910 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc08f8c-7ab9-46de-94b4-50a01ae027e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:39.685614 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc08f8c-7ab9-46de-94b4-50a01ae027e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:39.687264 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc08f8c-7ab9-46de-94b4-50a01ae027e5 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:39.698636 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1068/2149] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:39.703217 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ddf03-c876-405a-bd5b-6151776f7c05 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:39.714197 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ddf03-c876-405a-bd5b-6151776f7c05 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:39.720290 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2932c632-1b92-4b8f-b00d-67c1d07de112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:39.721159 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932c632-1b92-4b8f-b00d-67c1d07de112 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:39.721449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932c632-1b92-4b8f-b00d-67c1d07de112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:39.721733 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932c632-1b92-4b8f-b00d-67c1d07de112 admin admin] PATH_INFO: `/v3/projects/bf1fe42d17da40d8b041581f8a644401/users/b200b5d77c3145bebe4065261d776d53/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:39.723782 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2932c632-1b92-4b8f-b00d-67c1d07de112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf1fe42d17da40d8b041581f8a644401, user_id=b200b5d77c3145bebe4065261d776d53, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:39.726523 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2932c632-1b92-4b8f-b00d-67c1d07de112 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:39.738219 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1082/2150] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:39 2022] PUT /identity/v3/projects/bf1fe42d17da40d8b041581f8a644401/users/b200b5d77c3145bebe4065261d776d53/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:39.752021 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953dd599-6565-491c-9d3b-5dd0f0d4cbbc None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:39.752314 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953dd599-6565-491c-9d3b-5dd0f0d4cbbc None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:39.752598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953dd599-6565-491c-9d3b-5dd0f0d4cbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:39.784991 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-953dd599-6565-491c-9d3b-5dd0f0d4cbbc None None] MFA Rules not processed for user `b200b5d77c3145bebe4065261d776d53`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:39.786176 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-953dd599-6565-491c-9d3b-5dd0f0d4cbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:39.808931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2932c632-1b92-4b8f-b00d-67c1d07de112 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:39.811154 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2932c632-1b92-4b8f-b00d-67c1d07de112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:39.879412 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1069/2151] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:39 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:39.898173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953dd599-6565-491c-9d3b-5dd0f0d4cbbc None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:39.904063 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-953dd599-6565-491c-9d3b-5dd0f0d4cbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:39.904686 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2932c632-1b92-4b8f-b00d-67c1d07de112 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:39.909732 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfddfb15-1d50-47df-b8f5-1396b86e5be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:39.910655 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddfb15-1d50-47df-b8f5-1396b86e5be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:39.910941 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddfb15-1d50-47df-b8f5-1396b86e5be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:39.911221 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddfb15-1d50-47df-b8f5-1396b86e5be5 admin admin] PATH_INFO: `/v3/users/cf42fa5a48334b8fa885944690aaecae` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:39.913308 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfddfb15-1d50-47df-b8f5-1396b86e5be5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf42fa5a48334b8fa885944690aaecae)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:39.916040 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfddfb15-1d50-47df-b8f5-1396b86e5be5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:39.956672 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:40.002717 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cfddfb15-1d50-47df-b8f5-1396b86e5be5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf42fa5a48334b8fa885944690aaecae'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:40.003602 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cfddfb15-1d50-47df-b8f5-1396b86e5be5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf42fa5a48334b8fa885944690aaecae'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:40.037228 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953dd599-6565-491c-9d3b-5dd0f0d4cbbc None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:40.039459 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cfddfb15-1d50-47df-b8f5-1396b86e5be5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf42fa5a48334b8fa885944690aaecae'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:40.046285 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0898e-83c4-4ca4-9182-752e0412a2b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:40.047118 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0898e-83c4-4ca4-9182-752e0412a2b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:40.047518 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0898e-83c4-4ca4-9182-752e0412a2b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:40.048117 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0898e-83c4-4ca4-9182-752e0412a2b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:40.053616 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-ceb0898e-83c4-4ca4-9182-752e0412a2b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:40.059965 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cfddfb15-1d50-47df-b8f5-1396b86e5be5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf42fa5a48334b8fa885944690aaecae'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:40.060462 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cfddfb15-1d50-47df-b8f5-1396b86e5be5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf42fa5a48334b8fa885944690aaecae'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:40.084283 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb0898e-83c4-4ca4-9182-752e0412a2b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:40.090234 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1083/2152] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:39 2022] DELETE /identity/v3/users/cf42fa5a48334b8fa885944690aaecae => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:28:40.090362 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb0898e-83c4-4ca4-9182-752e0412a2b1 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:40.091562 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32b44e-e8fd-4aa2-8dd1-61902b6cb4ff None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:40.091936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32b44e-e8fd-4aa2-8dd1-61902b6cb4ff None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:40.092315 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32b44e-e8fd-4aa2-8dd1-61902b6cb4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:40.092780 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:40.106063 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1070/2153] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:39 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:28:40.116182 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-8b32b44e-e8fd-4aa2-8dd1-61902b6cb4ff None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:40.117413 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8b32b44e-e8fd-4aa2-8dd1-61902b6cb4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:40.194806 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1084/2154] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:28:40.207101 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0898e-83c4-4ca4-9182-752e0412a2b1 service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:40.208550 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-ceb0898e-83c4-4ca4-9182-752e0412a2b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:40.289562 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0898e-83c4-4ca4-9182-752e0412a2b1 service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:40.366777 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647e108-eaed-4e23-9928-7752a7eb6c1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:40.367770 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647e108-eaed-4e23-9928-7752a7eb6c1a service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:40.368431 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647e108-eaed-4e23-9928-7752a7eb6c1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:40.368917 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647e108-eaed-4e23-9928-7752a7eb6c1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:40.371142 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32b44e-e8fd-4aa2-8dd1-61902b6cb4ff None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:40.372557 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8b32b44e-e8fd-4aa2-8dd1-61902b6cb4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:40.383870 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c647e108-eaed-4e23-9928-7752a7eb6c1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:40.386587 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c647e108-eaed-4e23-9928-7752a7eb6c1a service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:40.422673 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1071/2155] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:40.462798 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32b44e-e8fd-4aa2-8dd1-61902b6cb4ff None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:40.469158 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c199ca-fece-4f37-bb49-084c39c88bed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:40.470266 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c199ca-fece-4f37-bb49-084c39c88bed service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:40.470839 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c199ca-fece-4f37-bb49-084c39c88bed service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:40.471734 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c199ca-fece-4f37-bb49-084c39c88bed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:40.474263 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-37c199ca-fece-4f37-bb49-084c39c88bed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:40.552763 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:40.571054 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c199ca-fece-4f37-bb49-084c39c88bed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:40.574487 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c199ca-fece-4f37-bb49-084c39c88bed service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:40.591075 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1085/2156] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:40 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:41.024941 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647e108-eaed-4e23-9928-7752a7eb6c1a service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:41.027125 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c647e108-eaed-4e23-9928-7752a7eb6c1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:41.048277 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647e108-eaed-4e23-9928-7752a7eb6c1a service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:41.056347 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66446252-918f-4faf-9453-d28a25b73e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:41.057835 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66446252-918f-4faf-9453-d28a25b73e88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:41.058131 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66446252-918f-4faf-9453-d28a25b73e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:41.058543 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66446252-918f-4faf-9453-d28a25b73e88 admin admin] PATH_INFO: `/v3/projects/99f5ea9c750b4e33a34181837c38f4a6` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:41.060698 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66446252-918f-4faf-9453-d28a25b73e88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99f5ea9c750b4e33a34181837c38f4a6)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:41.062632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66446252-918f-4faf-9453-d28a25b73e88 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:41.120442 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-66446252-918f-4faf-9453-d28a25b73e88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99f5ea9c750b4e33a34181837c38f4a6', 'request_id': 'req-66446252-918f-4faf-9453-d28a25b73e88'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:41.130660 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-66446252-918f-4faf-9453-d28a25b73e88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99f5ea9c750b4e33a34181837c38f4a6', 'request_id': 'req-66446252-918f-4faf-9453-d28a25b73e88'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:41.138832 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-66446252-918f-4faf-9453-d28a25b73e88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99f5ea9c750b4e33a34181837c38f4a6', 'request_id': 'req-66446252-918f-4faf-9453-d28a25b73e88'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:41.156858 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-66446252-918f-4faf-9453-d28a25b73e88 admin admin] The token cache is being invalidate because project 99f5ea9c750b4e33a34181837c38f4a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:41.158016 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-66446252-918f-4faf-9453-d28a25b73e88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:41.162169 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-66446252-918f-4faf-9453-d28a25b73e88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:41.163955 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1072/2157] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:41 2022] DELETE /identity/v3/projects/99f5ea9c750b4e33a34181837c38f4a6 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:41.169258 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787009e-cce1-4012-82f0-b68c69751f6a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:41.169602 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787009e-cce1-4012-82f0-b68c69751f6a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:41.169900 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787009e-cce1-4012-82f0-b68c69751f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:41.189999 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7787009e-cce1-4012-82f0-b68c69751f6a None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:41.191244 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7787009e-cce1-4012-82f0-b68c69751f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:41.262006 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1086/2158] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:41.269588 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f00454-1253-49e1-9dd1-bb126edef6fd None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:41.269880 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f00454-1253-49e1-9dd1-bb126edef6fd None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:41.270187 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f00454-1253-49e1-9dd1-bb126edef6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:41.289186 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-57f00454-1253-49e1-9dd1-bb126edef6fd None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:41.290466 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-57f00454-1253-49e1-9dd1-bb126edef6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:41.299099 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1073/2159] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:41.303374 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7787009e-cce1-4012-82f0-b68c69751f6a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:41.314348 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7787009e-cce1-4012-82f0-b68c69751f6a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:41.319632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9e2ef-a975-4ed4-b0c2-e5ba348f195e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:41.320380 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9e2ef-a975-4ed4-b0c2-e5ba348f195e admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:41.320667 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9e2ef-a975-4ed4-b0c2-e5ba348f195e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:41.320942 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9e2ef-a975-4ed4-b0c2-e5ba348f195e admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:41.321672 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9e2ef-a975-4ed4-b0c2-e5ba348f195e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:28:41.321992 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9e2ef-a975-4ed4-b0c2-e5ba348f195e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:41.323934 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9e2ef-a975-4ed4-b0c2-e5ba348f195e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:41.336422 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1087/2160] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:28:41.341123 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f00454-1253-49e1-9dd1-bb126edef6fd None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:41.350621 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f00454-1253-49e1-9dd1-bb126edef6fd None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:41.355875 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7fc43-a12c-4e67-9b48-8779a9494779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:41.356533 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7fc43-a12c-4e67-9b48-8779a9494779 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:41.356817 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7fc43-a12c-4e67-9b48-8779a9494779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:41.357215 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7fc43-a12c-4e67-9b48-8779a9494779 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:41.357937 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7fc43-a12c-4e67-9b48-8779a9494779 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:41.359885 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7fc43-a12c-4e67-9b48-8779a9494779 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:41.389260 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1074/2161] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:28:41 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:41.395679 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9e2ef-a975-4ed4-b0c2-e5ba348f195e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:41.396607 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7fc43-a12c-4e67-9b48-8779a9494779 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:41.398888 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-1ef7fc43-a12c-4e67-9b48-8779a9494779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:41.405572 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9e2ef-a975-4ed4-b0c2-e5ba348f195e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:41.412526 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:41.468458 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde47154-1abc-49b9-9823-fe8fcf3a746a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:41.469140 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde47154-1abc-49b9-9823-fe8fcf3a746a admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:41.469431 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde47154-1abc-49b9-9823-fe8fcf3a746a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:41.469716 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde47154-1abc-49b9-9823-fe8fcf3a746a admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:41.470452 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde47154-1abc-49b9-9823-fe8fcf3a746a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:41.471662 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7fc43-a12c-4e67-9b48-8779a9494779 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:41.472407 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde47154-1abc-49b9-9823-fe8fcf3a746a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:41.476547 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a537e86-4ba7-4d01-963b-3c26329eb332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:41.477428 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a537e86-4ba7-4d01-963b-3c26329eb332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:41.477721 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a537e86-4ba7-4d01-963b-3c26329eb332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:41.478067 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a537e86-4ba7-4d01-963b-3c26329eb332 admin admin] PATH_INFO: `/v3/users/f21cb1c7b1a74b9793f2f4b5f83d1e70` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:41.479844 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a537e86-4ba7-4d01-963b-3c26329eb332 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f21cb1c7b1a74b9793f2f4b5f83d1e70)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:41.481770 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a537e86-4ba7-4d01-963b-3c26329eb332 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:41.498357 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1088/2162] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:28:41 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:41.499495 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde47154-1abc-49b9-9823-fe8fcf3a746a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:41.510345 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde47154-1abc-49b9-9823-fe8fcf3a746a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:41.515692 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0406bc-3128-49f3-89bb-9859525e4cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:41.516514 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0406bc-3128-49f3-89bb-9859525e4cfc admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:41.516901 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0406bc-3128-49f3-89bb-9859525e4cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:41.517329 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0406bc-3128-49f3-89bb-9859525e4cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:41.518144 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0406bc-3128-49f3-89bb-9859525e4cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:41.519801 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0406bc-3128-49f3-89bb-9859525e4cfc admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:41.530466 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1089/2163] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:41.534343 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0406bc-3128-49f3-89bb-9859525e4cfc admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:41.535931 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4a537e86-4ba7-4d01-963b-3c26329eb332 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f21cb1c7b1a74b9793f2f4b5f83d1e70'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:41.536645 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4a537e86-4ba7-4d01-963b-3c26329eb332 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f21cb1c7b1a74b9793f2f4b5f83d1e70'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:41.544730 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0406bc-3128-49f3-89bb-9859525e4cfc admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:41.549511 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3130279-1e05-47ba-acc7-d41b5f1f38b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:41.549841 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4a537e86-4ba7-4d01-963b-3c26329eb332 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f21cb1c7b1a74b9793f2f4b5f83d1e70'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:41.550285 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3130279-1e05-47ba-acc7-d41b5f1f38b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:41.550578 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3130279-1e05-47ba-acc7-d41b5f1f38b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:41.551974 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3130279-1e05-47ba-acc7-d41b5f1f38b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:41.552725 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3130279-1e05-47ba-acc7-d41b5f1f38b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:41.554394 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3130279-1e05-47ba-acc7-d41b5f1f38b4 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:41.557571 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4a537e86-4ba7-4d01-963b-3c26329eb332 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f21cb1c7b1a74b9793f2f4b5f83d1e70'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:41.565570 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4a537e86-4ba7-4d01-963b-3c26329eb332 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f21cb1c7b1a74b9793f2f4b5f83d1e70'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:41.567485 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1090/2164] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 04:28:41.572949 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3130279-1e05-47ba-acc7-d41b5f1f38b4 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:41.573185 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1075/2165] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:41 2022] DELETE /identity/v3/users/f21cb1c7b1a74b9793f2f4b5f83d1e70 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:28:41.576230 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a3130279-1e05-47ba-acc7-d41b5f1f38b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:41.578112 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdec8a9-3044-4303-836d-8cc605f4a169 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:41.578406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdec8a9-3044-4303-836d-8cc605f4a169 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:41.578698 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdec8a9-3044-4303-836d-8cc605f4a169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:41.587944 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3130279-1e05-47ba-acc7-d41b5f1f38b4 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:41.598552 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-ebdec8a9-3044-4303-836d-8cc605f4a169 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:41.599777 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-ebdec8a9-3044-4303-836d-8cc605f4a169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:41.642999 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:41.660993 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2458588-b91f-440f-bddc-591b83dd5617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:41.662070 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2458588-b91f-440f-bddc-591b83dd5617 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:41.662423 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2458588-b91f-440f-bddc-591b83dd5617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:41.662722 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2458588-b91f-440f-bddc-591b83dd5617 admin admin] PATH_INFO: `/v3/projects/ea68f4e3118c4b7597a6c986e29f0202/users/84258fe182884bf58c4d364769e0516d/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:41.668277 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1076/2166] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:28:41.677868 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdec8a9-3044-4303-836d-8cc605f4a169 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:41.680107 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-ebdec8a9-3044-4303-836d-8cc605f4a169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:41.683501 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2458588-b91f-440f-bddc-591b83dd5617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea68f4e3118c4b7597a6c986e29f0202, user_id=84258fe182884bf58c4d364769e0516d, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:41.686676 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2458588-b91f-440f-bddc-591b83dd5617 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:41.702480 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1091/2167] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:41 2022] PUT /identity/v3/projects/ea68f4e3118c4b7597a6c986e29f0202/users/84258fe182884bf58c4d364769e0516d/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:28:41.712894 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d90f6c-3727-462b-8ccf-1324da1d0e5e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:41.713577 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d90f6c-3727-462b-8ccf-1324da1d0e5e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:41.713860 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d90f6c-3727-462b-8ccf-1324da1d0e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:41.720203 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:41.746253 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-00d90f6c-3727-462b-8ccf-1324da1d0e5e None None] MFA Rules not processed for user `84258fe182884bf58c4d364769e0516d`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:41.747476 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-00d90f6c-3727-462b-8ccf-1324da1d0e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:41.751997 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdec8a9-3044-4303-836d-8cc605f4a169 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:41.811796 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332b0f7-609e-4fd8-a8cf-fd86634826b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:41.812457 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332b0f7-609e-4fd8-a8cf-fd86634826b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:41.812747 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332b0f7-609e-4fd8-a8cf-fd86634826b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:41.813032 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332b0f7-609e-4fd8-a8cf-fd86634826b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:41.831185 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1092/2168] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:28:41.835702 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d90f6c-3727-462b-8ccf-1324da1d0e5e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:41.888523 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332b0f7-609e-4fd8-a8cf-fd86634826b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:41.890086 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332b0f7-609e-4fd8-a8cf-fd86634826b1 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:41.901100 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1077/2169] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:28:41.907951 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d90f6c-3727-462b-8ccf-1324da1d0e5e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:41.913940 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb272fb-d6e8-4430-a71a-e81cb7ca020f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:41.914635 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb272fb-d6e8-4430-a71a-e81cb7ca020f admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:41.914967 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb272fb-d6e8-4430-a71a-e81cb7ca020f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:41.915201 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb272fb-d6e8-4430-a71a-e81cb7ca020f admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:41.916224 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb272fb-d6e8-4430-a71a-e81cb7ca020f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:41.916388 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332b0f7-609e-4fd8-a8cf-fd86634826b1 service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:41.918159 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb272fb-d6e8-4430-a71a-e81cb7ca020f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:41.918534 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6332b0f7-609e-4fd8-a8cf-fd86634826b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:41.939611 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332b0f7-609e-4fd8-a8cf-fd86634826b1 service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:41.947947 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9851d97-6cb5-4a11-9e68-d5b8807348e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:41.950250 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9851d97-6cb5-4a11-9e68-d5b8807348e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:41.951619 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9851d97-6cb5-4a11-9e68-d5b8807348e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:41.952663 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9851d97-6cb5-4a11-9e68-d5b8807348e6 admin admin] PATH_INFO: `/v3/users/fcc229a08bf04e7fa7405c93dcfda708` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:41.954923 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9851d97-6cb5-4a11-9e68-d5b8807348e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcc229a08bf04e7fa7405c93dcfda708)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:41.957555 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9851d97-6cb5-4a11-9e68-d5b8807348e6 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:41.962421 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1093/2170] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:28:41 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:28:41.967817 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb272fb-d6e8-4430-a71a-e81cb7ca020f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:42.053767 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:42.065669 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-e9851d97-6cb5-4a11-9e68-d5b8807348e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcc229a08bf04e7fa7405c93dcfda708'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:42.066926 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-e9851d97-6cb5-4a11-9e68-d5b8807348e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcc229a08bf04e7fa7405c93dcfda708'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:42.084078 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-e9851d97-6cb5-4a11-9e68-d5b8807348e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcc229a08bf04e7fa7405c93dcfda708'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:42.091610 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb272fb-d6e8-4430-a71a-e81cb7ca020f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:42.094652 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-e9851d97-6cb5-4a11-9e68-d5b8807348e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcc229a08bf04e7fa7405c93dcfda708'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:42.105303 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-e9851d97-6cb5-4a11-9e68-d5b8807348e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcc229a08bf04e7fa7405c93dcfda708'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:42.106130 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544705a1-114c-4727-92fc-857f4e6a8172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:42.106839 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544705a1-114c-4727-92fc-857f4e6a8172 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:42.107127 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544705a1-114c-4727-92fc-857f4e6a8172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:42.107483 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544705a1-114c-4727-92fc-857f4e6a8172 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:42.108250 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544705a1-114c-4727-92fc-857f4e6a8172 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:42.110314 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544705a1-114c-4727-92fc-857f4e6a8172 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:42.121052 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1078/2171] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:41 2022] DELETE /identity/v3/users/fcc229a08bf04e7fa7405c93dcfda708 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:28:42.123233 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a0ca0-11f0-4110-897b-3a245dfa74ce None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:42.123531 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a0ca0-11f0-4110-897b-3a245dfa74ce None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:42.123813 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a0ca0-11f0-4110-897b-3a245dfa74ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:42.155283 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1094/2172] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:28:41 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:28:42.159346 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544705a1-114c-4727-92fc-857f4e6a8172 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:42.159713 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-dd6a0ca0-11f0-4110-897b-3a245dfa74ce None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:42.160998 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-dd6a0ca0-11f0-4110-897b-3a245dfa74ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:42.167093 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:42.167281 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-544705a1-114c-4727-92fc-857f4e6a8172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:42.189266 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544705a1-114c-4727-92fc-857f4e6a8172 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:42.268118 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1079/2173] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:42.279707 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a0ca0-11f0-4110-897b-3a245dfa74ce None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:42.282191 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-dd6a0ca0-11f0-4110-897b-3a245dfa74ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:42.306402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07122e-b0d4-437b-b917-f87ddd6ad149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:42.308471 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07122e-b0d4-437b-b917-f87ddd6ad149 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:42.309347 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07122e-b0d4-437b-b917-f87ddd6ad149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:42.309821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07122e-b0d4-437b-b917-f87ddd6ad149 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:42.310912 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07122e-b0d4-437b-b917-f87ddd6ad149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:42.312891 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07122e-b0d4-437b-b917-f87ddd6ad149 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:42.334286 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1095/2174] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:42.335686 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07122e-b0d4-437b-b917-f87ddd6ad149 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:42.350149 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07122e-b0d4-437b-b917-f87ddd6ad149 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:42.356165 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5323323-4021-4fc9-a80c-03904d0b0c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:42.357586 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5323323-4021-4fc9-a80c-03904d0b0c15 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:42.358080 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a0ca0-11f0-4110-897b-3a245dfa74ce None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:42.358817 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5323323-4021-4fc9-a80c-03904d0b0c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:42.359321 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5323323-4021-4fc9-a80c-03904d0b0c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:42.362218 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5323323-4021-4fc9-a80c-03904d0b0c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:42.364206 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5323323-4021-4fc9-a80c-03904d0b0c15 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:42.368191 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f84a5-148e-4fb7-bce3-b79199d95b7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:42.369269 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f84a5-148e-4fb7-bce3-b79199d95b7d service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:42.369906 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f84a5-148e-4fb7-bce3-b79199d95b7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:42.370357 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f84a5-148e-4fb7-bce3-b79199d95b7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:42.382679 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f84a5-148e-4fb7-bce3-b79199d95b7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:42.384198 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f84a5-148e-4fb7-bce3-b79199d95b7d service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:42.389923 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1096/2175] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:42.390872 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5323323-4021-4fc9-a80c-03904d0b0c15 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:42.404340 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5323323-4021-4fc9-a80c-03904d0b0c15 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:42.405822 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1080/2176] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:28:42.411591 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602af91-9a60-4f3c-84ef-0c2ddba178fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:42.412900 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602af91-9a60-4f3c-84ef-0c2ddba178fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:42.412900 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602af91-9a60-4f3c-84ef-0c2ddba178fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:42.413441 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602af91-9a60-4f3c-84ef-0c2ddba178fa admin admin] PATH_INFO: `/v3/projects/85095203270c4cbc8eca736ef833259e/users/d7abae1b32004fb8885035bcc4862c2b/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:42.442297 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602af91-9a60-4f3c-84ef-0c2ddba178fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=85095203270c4cbc8eca736ef833259e, user_id=d7abae1b32004fb8885035bcc4862c2b, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:42.446003 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602af91-9a60-4f3c-84ef-0c2ddba178fa admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:42.472924 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1097/2177] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:42 2022] PUT /identity/v3/projects/85095203270c4cbc8eca736ef833259e/users/d7abae1b32004fb8885035bcc4862c2b/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:42.484589 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0b404-c6d9-4a67-a4d6-afb398ef0757 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:42.485205 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0b404-c6d9-4a67-a4d6-afb398ef0757 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:42.485671 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0b404-c6d9-4a67-a4d6-afb398ef0757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:42.517472 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602af91-9a60-4f3c-84ef-0c2ddba178fa admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:42.519561 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6602af91-9a60-4f3c-84ef-0c2ddba178fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:42.529261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-3ea0b404-c6d9-4a67-a4d6-afb398ef0757 None None] MFA Rules not processed for user `d7abae1b32004fb8885035bcc4862c2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:42.530821 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3ea0b404-c6d9-4a67-a4d6-afb398ef0757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:42.649446 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602af91-9a60-4f3c-84ef-0c2ddba178fa admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:42.653787 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1081/2178] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:42.656898 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91adac12-4de7-499b-85e2-5bb9ec234d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:42.658418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0b404-c6d9-4a67-a4d6-afb398ef0757 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:42.658647 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91adac12-4de7-499b-85e2-5bb9ec234d9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:42.658647 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91adac12-4de7-499b-85e2-5bb9ec234d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:42.659073 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91adac12-4de7-499b-85e2-5bb9ec234d9e admin admin] PATH_INFO: `/v3/projects/41ac18b5799f446aa868398b394cad3a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:42.660820 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91adac12-4de7-499b-85e2-5bb9ec234d9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=41ac18b5799f446aa868398b394cad3a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:42.662807 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91adac12-4de7-499b-85e2-5bb9ec234d9e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:42.674488 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0b404-c6d9-4a67-a4d6-afb398ef0757 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:42.679683 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dadcc0-db97-4138-96ca-39c4305af059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:42.680466 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dadcc0-db97-4138-96ca-39c4305af059 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:42.680956 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dadcc0-db97-4138-96ca-39c4305af059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:42.681305 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dadcc0-db97-4138-96ca-39c4305af059 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:42.682846 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dadcc0-db97-4138-96ca-39c4305af059 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:42.684929 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dadcc0-db97-4138-96ca-39c4305af059 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:42.722643 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:42.730919 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1082/2179] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:28:42 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:28:42.736274 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dadcc0-db97-4138-96ca-39c4305af059 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:42.754197 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-91adac12-4de7-499b-85e2-5bb9ec234d9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41ac18b5799f446aa868398b394cad3a', 'request_id': 'req-91adac12-4de7-499b-85e2-5bb9ec234d9e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:42.765582 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-91adac12-4de7-499b-85e2-5bb9ec234d9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41ac18b5799f446aa868398b394cad3a', 'request_id': 'req-91adac12-4de7-499b-85e2-5bb9ec234d9e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:42.775710 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-91adac12-4de7-499b-85e2-5bb9ec234d9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41ac18b5799f446aa868398b394cad3a', 'request_id': 'req-91adac12-4de7-499b-85e2-5bb9ec234d9e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:42.778078 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:42.789898 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-91adac12-4de7-499b-85e2-5bb9ec234d9e admin admin] The token cache is being invalidate because project 41ac18b5799f446aa868398b394cad3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:42.790597 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-91adac12-4de7-499b-85e2-5bb9ec234d9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:42.792140 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-91adac12-4de7-499b-85e2-5bb9ec234d9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:42.794079 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1098/2180] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:42 2022] DELETE /identity/v3/projects/41ac18b5799f446aa868398b394cad3a => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:28:42.798868 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee666389-8d01-45ca-91c8-5ff7cd617cd8 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:42.799791 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee666389-8d01-45ca-91c8-5ff7cd617cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:42.800351 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee666389-8d01-45ca-91c8-5ff7cd617cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:42.826580 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-ee666389-8d01-45ca-91c8-5ff7cd617cd8 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:42.828276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ee666389-8d01-45ca-91c8-5ff7cd617cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:42.872457 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dadcc0-db97-4138-96ca-39c4305af059 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:42.877604 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7457b177-0722-4084-bd89-2218df1e4e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:42.878493 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457b177-0722-4084-bd89-2218df1e4e4f admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:42.878793 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457b177-0722-4084-bd89-2218df1e4e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:42.879084 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457b177-0722-4084-bd89-2218df1e4e4f admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:42.879777 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7457b177-0722-4084-bd89-2218df1e4e4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:42.882368 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7457b177-0722-4084-bd89-2218df1e4e4f admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:42.916746 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1083/2181] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:28:42 2022] POST /identity/v3/users => generated 298 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:42.920615 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7457b177-0722-4084-bd89-2218df1e4e4f admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:42.924330 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7457b177-0722-4084-bd89-2218df1e4e4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:42.939624 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7457b177-0722-4084-bd89-2218df1e4e4f admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:42.949805 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dff761-6b3b-410e-a191-a04eee1f9507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:42.950897 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dff761-6b3b-410e-a191-a04eee1f9507 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:42.951500 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dff761-6b3b-410e-a191-a04eee1f9507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:42.952063 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1099/2182] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:28:42.952496 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dff761-6b3b-410e-a191-a04eee1f9507 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:42.953503 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dff761-6b3b-410e-a191-a04eee1f9507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:42.955340 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dff761-6b3b-410e-a191-a04eee1f9507 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:42.960544 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35d615-4036-49fc-8bae-bc9ea151aac2 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:42.960971 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35d615-4036-49fc-8bae-bc9ea151aac2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:42.961359 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35d615-4036-49fc-8bae-bc9ea151aac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:42.972899 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1084/2183] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 04:28:42.973723 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dff761-6b3b-410e-a191-a04eee1f9507 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:42.975759 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-02dff761-6b3b-410e-a191-a04eee1f9507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:42.990804 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-ed35d615-4036-49fc-8bae-bc9ea151aac2 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:42.992378 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ed35d615-4036-49fc-8bae-bc9ea151aac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:42.993214 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dff761-6b3b-410e-a191-a04eee1f9507 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:42.999537 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ba716-8e18-4eff-ae39-ddec167cc8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:43.000939 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ba716-8e18-4eff-ae39-ddec167cc8a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:43.000939 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ba716-8e18-4eff-ae39-ddec167cc8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:43.001182 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ba716-8e18-4eff-ae39-ddec167cc8a5 admin admin] PATH_INFO: `/v3/projects/8e2d2644e40c4b78a75ef2cdcb4eb777` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:43.002529 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ba716-8e18-4eff-ae39-ddec167cc8a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e2d2644e40c4b78a75ef2cdcb4eb777)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:43.005265 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ba716-8e18-4eff-ae39-ddec167cc8a5 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:43.015438 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1100/2184] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:43.016682 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35d615-4036-49fc-8bae-bc9ea151aac2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:43.031014 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35d615-4036-49fc-8bae-bc9ea151aac2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:43.036787 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae522228-74bc-45ab-9bbd-60bfc477e568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:43.037708 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae522228-74bc-45ab-9bbd-60bfc477e568 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:43.038271 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae522228-74bc-45ab-9bbd-60bfc477e568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:43.038573 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae522228-74bc-45ab-9bbd-60bfc477e568 admin admin] PATH_INFO: `/v3/projects/bf1565060e8b46a7adf5f788e74e85d5/users/7bc3ac09302e453fac60dc3eeebe6c2c/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:43.060420 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae522228-74bc-45ab-9bbd-60bfc477e568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf1565060e8b46a7adf5f788e74e85d5, user_id=7bc3ac09302e453fac60dc3eeebe6c2c, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:43.063296 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae522228-74bc-45ab-9bbd-60bfc477e568 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:43.075342 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9e2ba716-8e18-4eff-ae39-ddec167cc8a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e2d2644e40c4b78a75ef2cdcb4eb777', 'request_id': 'req-9e2ba716-8e18-4eff-ae39-ddec167cc8a5'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:43.083350 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1101/2185] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:43 2022] PUT /identity/v3/projects/bf1565060e8b46a7adf5f788e74e85d5/users/7bc3ac09302e453fac60dc3eeebe6c2c/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:43.084267 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae522228-74bc-45ab-9bbd-60bfc477e568 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:43.086101 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9e2ba716-8e18-4eff-ae39-ddec167cc8a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e2d2644e40c4b78a75ef2cdcb4eb777', 'request_id': 'req-9e2ba716-8e18-4eff-ae39-ddec167cc8a5'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:43.092931 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9e2ba716-8e18-4eff-ae39-ddec167cc8a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e2d2644e40c4b78a75ef2cdcb4eb777', 'request_id': 'req-9e2ba716-8e18-4eff-ae39-ddec167cc8a5'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:43.106207 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9e2ba716-8e18-4eff-ae39-ddec167cc8a5 admin admin] The token cache is being invalidate because project 8e2d2644e40c4b78a75ef2cdcb4eb777 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:43.106497 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9e2ba716-8e18-4eff-ae39-ddec167cc8a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:43.107172 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9e2ba716-8e18-4eff-ae39-ddec167cc8a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:43.110045 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1085/2186] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:42 2022] DELETE /identity/v3/projects/8e2d2644e40c4b78a75ef2cdcb4eb777 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:43.110045 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ba716-8e18-4eff-ae39-ddec167cc8a5 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:43.111542 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-9e2ba716-8e18-4eff-ae39-ddec167cc8a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:43.154896 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae522228-74bc-45ab-9bbd-60bfc477e568 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:43.160229 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e692357-3444-4bb0-8000-ccc9ac563e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:43.163309 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e692357-3444-4bb0-8000-ccc9ac563e70 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:43.163406 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e692357-3444-4bb0-8000-ccc9ac563e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:43.163636 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e692357-3444-4bb0-8000-ccc9ac563e70 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:43.164418 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e692357-3444-4bb0-8000-ccc9ac563e70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:28:43.164735 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e692357-3444-4bb0-8000-ccc9ac563e70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:43.167014 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e692357-3444-4bb0-8000-ccc9ac563e70 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:43.183529 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1102/2187] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:28:43.188311 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e692357-3444-4bb0-8000-ccc9ac563e70 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:43.190311 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3e692357-3444-4bb0-8000-ccc9ac563e70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:43.203089 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ba716-8e18-4eff-ae39-ddec167cc8a5 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:43.208941 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e692357-3444-4bb0-8000-ccc9ac563e70 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:43.212745 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39787811-5782-4376-9f21-7378c8265118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:43.213447 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39787811-5782-4376-9f21-7378c8265118 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:43.213730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39787811-5782-4376-9f21-7378c8265118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:43.214052 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39787811-5782-4376-9f21-7378c8265118 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:43.214796 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39787811-5782-4376-9f21-7378c8265118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:43.216458 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39787811-5782-4376-9f21-7378c8265118 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:43.218946 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c7a1c-d2eb-4ecb-8479-04c9e88a9537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:43.220892 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c7a1c-d2eb-4ecb-8479-04c9e88a9537 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:43.221602 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c7a1c-d2eb-4ecb-8479-04c9e88a9537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:43.222274 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c7a1c-d2eb-4ecb-8479-04c9e88a9537 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:43.223480 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c7a1c-d2eb-4ecb-8479-04c9e88a9537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:43.226449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c7a1c-d2eb-4ecb-8479-04c9e88a9537 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:43.228133 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1086/2188] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:43.233153 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39787811-5782-4376-9f21-7378c8265118 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:43.244701 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39787811-5782-4376-9f21-7378c8265118 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:43.249996 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca2805-65f5-4c3e-85a6-7bb0fb284812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:43.250929 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca2805-65f5-4c3e-85a6-7bb0fb284812 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:43.251355 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca2805-65f5-4c3e-85a6-7bb0fb284812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:43.251518 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca2805-65f5-4c3e-85a6-7bb0fb284812 admin admin] PATH_INFO: `/v3/projects/bf1565060e8b46a7adf5f788e74e85d5/users/7bc3ac09302e453fac60dc3eeebe6c2c/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:43.254210 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca2805-65f5-4c3e-85a6-7bb0fb284812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf1565060e8b46a7adf5f788e74e85d5, user_id=7bc3ac09302e453fac60dc3eeebe6c2c, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:43.256972 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca2805-65f5-4c3e-85a6-7bb0fb284812 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:43.273325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1087/2189] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:43 2022] PUT /identity/v3/projects/bf1565060e8b46a7adf5f788e74e85d5/users/7bc3ac09302e453fac60dc3eeebe6c2c/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:43.273859 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1103/2190] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:28:43 2022] POST /identity/v3/projects => generated 377 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:28:43.282499 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca2805-65f5-4c3e-85a6-7bb0fb284812 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:43.288394 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1b611-07ba-4c3f-a5e2-61101e6df25b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:43.288817 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1b611-07ba-4c3f-a5e2-61101e6df25b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:43.289817 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1b611-07ba-4c3f-a5e2-61101e6df25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:43.289938 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:43.308301 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:43.336624 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-fac1b611-07ba-4c3f-a5e2-61101e6df25b None None] MFA Rules not processed for user `7bc3ac09302e453fac60dc3eeebe6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:43.336624 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-fac1b611-07ba-4c3f-a5e2-61101e6df25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:43.370616 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca2805-65f5-4c3e-85a6-7bb0fb284812 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:43.444961 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1104/2191] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:28:43.452412 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7df13a-319e-4272-8571-cfacbbffb3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:43.453268 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7df13a-319e-4272-8571-cfacbbffb3ae admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:43.453558 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7df13a-319e-4272-8571-cfacbbffb3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:43.453833 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7df13a-319e-4272-8571-cfacbbffb3ae admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:43.454602 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7df13a-319e-4272-8571-cfacbbffb3ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:43.458762 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7df13a-319e-4272-8571-cfacbbffb3ae admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:43.466236 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1b611-07ba-4c3f-a5e2-61101e6df25b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:43.468370 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-fac1b611-07ba-4c3f-a5e2-61101e6df25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:43.491799 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1088/2192] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:28:43 2022] POST /identity/v3/users => generated 289 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:43.493018 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7df13a-319e-4272-8571-cfacbbffb3ae admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:43.506314 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7df13a-319e-4272-8571-cfacbbffb3ae admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:43.513533 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208218e-26ce-416a-9a6f-ceb97c0f71e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:43.515496 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208218e-26ce-416a-9a6f-ceb97c0f71e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:43.515903 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208218e-26ce-416a-9a6f-ceb97c0f71e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:43.516249 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208218e-26ce-416a-9a6f-ceb97c0f71e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:43.517656 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208218e-26ce-416a-9a6f-ceb97c0f71e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:43.520387 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208218e-26ce-416a-9a6f-ceb97c0f71e0 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:43.546024 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1089/2193] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:43.548064 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208218e-26ce-416a-9a6f-ceb97c0f71e0 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:43.559295 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208218e-26ce-416a-9a6f-ceb97c0f71e0 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:43.561818 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1b611-07ba-4c3f-a5e2-61101e6df25b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:43.564761 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b3fce-59b0-45ec-95bd-b85451a7db1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:43.565577 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0a85e-7067-4d90-9226-53da7667e8c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:43.565822 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b3fce-59b0-45ec-95bd-b85451a7db1a admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:43.566244 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b3fce-59b0-45ec-95bd-b85451a7db1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:43.566358 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0a85e-7067-4d90-9226-53da7667e8c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:43.566532 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0a85e-7067-4d90-9226-53da7667e8c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:43.566816 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0a85e-7067-4d90-9226-53da7667e8c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:43.567065 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b3fce-59b0-45ec-95bd-b85451a7db1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:43.567936 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b3fce-59b0-45ec-95bd-b85451a7db1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:43.568973 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-63c0a85e-7067-4d90-9226-53da7667e8c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:43.569891 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b3fce-59b0-45ec-95bd-b85451a7db1a admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:43.584352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1090/2194] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:43.589010 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b3fce-59b0-45ec-95bd-b85451a7db1a admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:43.601278 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b3fce-59b0-45ec-95bd-b85451a7db1a admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:43.612241 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3dda96-765c-4800-97af-faff7c2bce5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:43.613303 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3dda96-765c-4800-97af-faff7c2bce5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:43.613715 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3dda96-765c-4800-97af-faff7c2bce5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:43.614231 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3dda96-765c-4800-97af-faff7c2bce5a admin admin] PATH_INFO: `/v3/projects/99249a9f25d047bfa09b23a0cdf576d3/users/ddd7f998e6cd4820b396f51f210dcb4c/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:43.646553 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0a85e-7067-4d90-9226-53da7667e8c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:43.648416 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0a85e-7067-4d90-9226-53da7667e8c5 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:43.654008 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3dda96-765c-4800-97af-faff7c2bce5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=99249a9f25d047bfa09b23a0cdf576d3, user_id=ddd7f998e6cd4820b396f51f210dcb4c, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:43.656770 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3dda96-765c-4800-97af-faff7c2bce5a admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:43.659975 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1105/2195] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:28:43.682517 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1091/2196] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:43 2022] PUT /identity/v3/projects/99249a9f25d047bfa09b23a0cdf576d3/users/ddd7f998e6cd4820b396f51f210dcb4c/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:43.693292 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d94d6c-c6c1-4158-8ad0-554e5480c151 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:43.694410 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d94d6c-c6c1-4158-8ad0-554e5480c151 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:43.694938 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d94d6c-c6c1-4158-8ad0-554e5480c151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:43.738904 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-91d94d6c-c6c1-4158-8ad0-554e5480c151 None None] MFA Rules not processed for user `ddd7f998e6cd4820b396f51f210dcb4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:43.740315 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-91d94d6c-c6c1-4158-8ad0-554e5480c151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:43.786343 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:43.849792 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1106/2197] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:43.853775 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3dda96-765c-4800-97af-faff7c2bce5a admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:43.961686 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:43.968018 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3dda96-765c-4800-97af-faff7c2bce5a admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:43.980849 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72d54b-236f-4136-9f9b-87515b4b667d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:43.981664 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72d54b-236f-4136-9f9b-87515b4b667d admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:43.981991 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72d54b-236f-4136-9f9b-87515b4b667d admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:43.982277 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72d54b-236f-4136-9f9b-87515b4b667d admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:43.983053 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de72d54b-236f-4136-9f9b-87515b4b667d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:43.985136 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de72d54b-236f-4136-9f9b-87515b4b667d admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:44.021329 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1092/2198] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:28:43 2022] POST /identity/v3/projects => generated 375 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:28:44.026060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d94d6c-c6c1-4158-8ad0-554e5480c151 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:44.040264 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d94d6c-c6c1-4158-8ad0-554e5480c151 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:44.182774 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621543e1-4eae-4d7e-92a8-996547e39470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:44.183461 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621543e1-4eae-4d7e-92a8-996547e39470 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:44.183742 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621543e1-4eae-4d7e-92a8-996547e39470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:44.184016 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621543e1-4eae-4d7e-92a8-996547e39470 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:44.184726 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621543e1-4eae-4d7e-92a8-996547e39470 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:44.193475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621543e1-4eae-4d7e-92a8-996547e39470 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:44.225204 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1107/2199] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:28:44 2022] POST /identity/v3/users => generated 288 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:44.228999 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72d54b-236f-4136-9f9b-87515b4b667d admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:44.239865 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72d54b-236f-4136-9f9b-87515b4b667d admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:44.246059 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb8641-3495-499a-9660-deaa46d31232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:44.246924 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb8641-3495-499a-9660-deaa46d31232 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:44.247357 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb8641-3495-499a-9660-deaa46d31232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:44.247540 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb8641-3495-499a-9660-deaa46d31232 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:44.248316 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb8641-3495-499a-9660-deaa46d31232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:44.250160 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb8641-3495-499a-9660-deaa46d31232 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:44.262554 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1093/2200] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:44.266442 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621543e1-4eae-4d7e-92a8-996547e39470 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:44.277283 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621543e1-4eae-4d7e-92a8-996547e39470 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:44.282643 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61c4c0-5500-4eba-99e5-18217da6aa8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:44.283318 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61c4c0-5500-4eba-99e5-18217da6aa8b admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:44.283602 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61c4c0-5500-4eba-99e5-18217da6aa8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:44.283879 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61c4c0-5500-4eba-99e5-18217da6aa8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:44.284608 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61c4c0-5500-4eba-99e5-18217da6aa8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:44.286247 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61c4c0-5500-4eba-99e5-18217da6aa8b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:44.300521 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1108/2201] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:44.302428 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb8641-3495-499a-9660-deaa46d31232 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:44.313633 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb8641-3495-499a-9660-deaa46d31232 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:44.326406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c07c1-5c8e-44ba-89bb-dade21ada18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:44.328074 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c07c1-5c8e-44ba-89bb-dade21ada18d admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:44.328363 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c07c1-5c8e-44ba-89bb-dade21ada18d admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:44.328645 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c07c1-5c8e-44ba-89bb-dade21ada18d admin admin] PATH_INFO: `/v3/projects/d77cc6a8f357424ab93f36b36d880313/users/7478b0b9725a469ebe2e8a88c97d6919/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:44.344941 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c07c1-5c8e-44ba-89bb-dade21ada18d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d77cc6a8f357424ab93f36b36d880313, user_id=7478b0b9725a469ebe2e8a88c97d6919, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:44.350400 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c07c1-5c8e-44ba-89bb-dade21ada18d admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:44.363605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1094/2202] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:44 2022] PUT /identity/v3/projects/d77cc6a8f357424ab93f36b36d880313/users/7478b0b9725a469ebe2e8a88c97d6919/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:44.375229 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55828744-2928-4005-813e-2acd832e49ec None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:44.375625 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55828744-2928-4005-813e-2acd832e49ec None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:44.375835 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55828744-2928-4005-813e-2acd832e49ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:44.404457 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-55828744-2928-4005-813e-2acd832e49ec None None] MFA Rules not processed for user `7478b0b9725a469ebe2e8a88c97d6919`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:44.405772 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-55828744-2928-4005-813e-2acd832e49ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:44.467820 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c07c1-5c8e-44ba-89bb-dade21ada18d admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:44.469668 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-bc1c07c1-5c8e-44ba-89bb-dade21ada18d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:44.478054 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1109/2203] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:44.483038 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55828744-2928-4005-813e-2acd832e49ec None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:44.535635 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:44.538411 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c07c1-5c8e-44ba-89bb-dade21ada18d admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:44.544380 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4416e90-fa02-4763-a5e0-6338e42aebff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:44.545262 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4416e90-fa02-4763-a5e0-6338e42aebff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:44.545542 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4416e90-fa02-4763-a5e0-6338e42aebff admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:44.545818 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4416e90-fa02-4763-a5e0-6338e42aebff admin admin] PATH_INFO: `/v3/users/abde4aabbb074da29b9ab091d86f2ec0` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:44.547401 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4416e90-fa02-4763-a5e0-6338e42aebff admin admin] RBAC: Authorizing `identity:delete_user(user_id=abde4aabbb074da29b9ab091d86f2ec0)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:44.549328 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4416e90-fa02-4763-a5e0-6338e42aebff admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:44.554791 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55828744-2928-4005-813e-2acd832e49ec None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:44.560233 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bae0a2-3080-4bf7-baf5-9cb459d9f441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:44.560888 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bae0a2-3080-4bf7-baf5-9cb459d9f441 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:44.561176 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bae0a2-3080-4bf7-baf5-9cb459d9f441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:44.561454 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bae0a2-3080-4bf7-baf5-9cb459d9f441 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:44.562183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bae0a2-3080-4bf7-baf5-9cb459d9f441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:44.564112 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bae0a2-3080-4bf7-baf5-9cb459d9f441 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:44.591084 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1110/2204] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:28:44 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:28:44.595292 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bae0a2-3080-4bf7-baf5-9cb459d9f441 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:44.605850 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-a4416e90-fa02-4763-a5e0-6338e42aebff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abde4aabbb074da29b9ab091d86f2ec0'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:44.606571 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-a4416e90-fa02-4763-a5e0-6338e42aebff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abde4aabbb074da29b9ab091d86f2ec0'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:44.619609 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-a4416e90-fa02-4763-a5e0-6338e42aebff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abde4aabbb074da29b9ab091d86f2ec0'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:44.627396 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-a4416e90-fa02-4763-a5e0-6338e42aebff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abde4aabbb074da29b9ab091d86f2ec0'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:44.639008 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-a4416e90-fa02-4763-a5e0-6338e42aebff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abde4aabbb074da29b9ab091d86f2ec0'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:44.650873 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1095/2205] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:44 2022] DELETE /identity/v3/users/abde4aabbb074da29b9ab091d86f2ec0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:44.655967 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08edd34-628f-45b6-a6d5-ba8d20d22bb6 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:44.656342 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08edd34-628f-45b6-a6d5-ba8d20d22bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:44.656972 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08edd34-628f-45b6-a6d5-ba8d20d22bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:44.676580 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bae0a2-3080-4bf7-baf5-9cb459d9f441 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:44.679050 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-a08edd34-628f-45b6-a6d5-ba8d20d22bb6 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:44.680888 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a08edd34-628f-45b6-a6d5-ba8d20d22bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:44.707371 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:44.744143 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe70983-f903-48f8-b9de-01ac893ab772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:44.744870 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe70983-f903-48f8-b9de-01ac893ab772 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:44.745149 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe70983-f903-48f8-b9de-01ac893ab772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:44.745427 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe70983-f903-48f8-b9de-01ac893ab772 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:44.746140 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe70983-f903-48f8-b9de-01ac893ab772 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:44.748062 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe70983-f903-48f8-b9de-01ac893ab772 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:44.754013 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1096/2206] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:28:44.768097 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08edd34-628f-45b6-a6d5-ba8d20d22bb6 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:44.770199 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a08edd34-628f-45b6-a6d5-ba8d20d22bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:44.777692 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1111/2207] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:28:44 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:28:44.785963 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe70983-f903-48f8-b9de-01ac893ab772 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:44.788716 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2fe70983-f903-48f8-b9de-01ac893ab772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:44.808199 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe70983-f903-48f8-b9de-01ac893ab772 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:44.816719 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67157b-8ef5-42c6-94f0-0a45bb9c3c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:44.817853 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67157b-8ef5-42c6-94f0-0a45bb9c3c26 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:44.818316 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67157b-8ef5-42c6-94f0-0a45bb9c3c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:44.818735 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67157b-8ef5-42c6-94f0-0a45bb9c3c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:44.819843 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67157b-8ef5-42c6-94f0-0a45bb9c3c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:44.823810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67157b-8ef5-42c6-94f0-0a45bb9c3c26 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:44.838677 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1112/2208] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:44.842856 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67157b-8ef5-42c6-94f0-0a45bb9c3c26 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:44.853398 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67157b-8ef5-42c6-94f0-0a45bb9c3c26 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:44.860046 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08edd34-628f-45b6-a6d5-ba8d20d22bb6 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:44.860768 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286c1d4-9bfe-499d-9fff-63039449f1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:44.861940 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286c1d4-9bfe-499d-9fff-63039449f1df admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:44.862408 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286c1d4-9bfe-499d-9fff-63039449f1df admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:44.862806 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286c1d4-9bfe-499d-9fff-63039449f1df admin admin] PATH_INFO: `/v3/projects/2c3e265b3c934f859a834082c0b9e8b3/users/ecf4239ef72e4f4294e91f9ca44dfce3/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:44.864786 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd5b05-6613-4350-9650-c0ac52c23cfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:44.865470 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd5b05-6613-4350-9650-c0ac52c23cfd service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:44.865760 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd5b05-6613-4350-9650-c0ac52c23cfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:44.866068 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd5b05-6613-4350-9650-c0ac52c23cfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:44.877615 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd5b05-6613-4350-9650-c0ac52c23cfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:44.879060 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd5b05-6613-4350-9650-c0ac52c23cfd service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:44.883024 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286c1d4-9bfe-499d-9fff-63039449f1df admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c3e265b3c934f859a834082c0b9e8b3, user_id=ecf4239ef72e4f4294e91f9ca44dfce3, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:44.886497 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286c1d4-9bfe-499d-9fff-63039449f1df admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:44.891931 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1097/2209] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:44.906199 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1113/2210] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:44 2022] PUT /identity/v3/projects/2c3e265b3c934f859a834082c0b9e8b3/users/ecf4239ef72e4f4294e91f9ca44dfce3/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:28:44.910716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd5b05-6613-4350-9650-c0ac52c23cfd service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:44.923313 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd5b05-6613-4350-9650-c0ac52c23cfd service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:44.999144 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d28690-94df-4b88-b46a-46929e4e1be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:45.000144 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d28690-94df-4b88-b46a-46929e4e1be5 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:45.000586 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d28690-94df-4b88-b46a-46929e4e1be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:45.001015 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d28690-94df-4b88-b46a-46929e4e1be5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:45.002041 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d28690-94df-4b88-b46a-46929e4e1be5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:45.004322 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d28690-94df-4b88-b46a-46929e4e1be5 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:45.022668 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1098/2211] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:45.024340 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286c1d4-9bfe-499d-9fff-63039449f1df admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:45.036501 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286c1d4-9bfe-499d-9fff-63039449f1df admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:45.041649 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e382078-18aa-43cc-97fb-c98446ee68a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:45.042243 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e382078-18aa-43cc-97fb-c98446ee68a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:45.042665 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e382078-18aa-43cc-97fb-c98446ee68a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:45.042955 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e382078-18aa-43cc-97fb-c98446ee68a7 admin admin] PATH_INFO: `/v3/projects/2c3e265b3c934f859a834082c0b9e8b3/users/ecf4239ef72e4f4294e91f9ca44dfce3/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:45.045408 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e382078-18aa-43cc-97fb-c98446ee68a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c3e265b3c934f859a834082c0b9e8b3, user_id=ecf4239ef72e4f4294e91f9ca44dfce3, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:45.048431 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e382078-18aa-43cc-97fb-c98446ee68a7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:45.068031 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1114/2212] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:45 2022] PUT /identity/v3/projects/2c3e265b3c934f859a834082c0b9e8b3/users/ecf4239ef72e4f4294e91f9ca44dfce3/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:28:45.082014 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8e61f-5fd5-466b-b38b-3dd7068d13a8 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:45.082325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8e61f-5fd5-466b-b38b-3dd7068d13a8 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:45.082616 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8e61f-5fd5-466b-b38b-3dd7068d13a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:45.117355 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-dea8e61f-5fd5-466b-b38b-3dd7068d13a8 None None] MFA Rules not processed for user `ecf4239ef72e4f4294e91f9ca44dfce3`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:45.120583 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-dea8e61f-5fd5-466b-b38b-3dd7068d13a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:45.189082 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:45.243484 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1099/2213] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:45 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:45.260958 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e382078-18aa-43cc-97fb-c98446ee68a7 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:45.262726 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3e382078-18aa-43cc-97fb-c98446ee68a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:45.298947 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:45.322693 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8e61f-5fd5-466b-b38b-3dd7068d13a8 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:45.324359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-dea8e61f-5fd5-466b-b38b-3dd7068d13a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:45.369574 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e382078-18aa-43cc-97fb-c98446ee68a7 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:45.375895 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06edfb-285b-4860-9d3e-d149ef74768b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:45.376952 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06edfb-285b-4860-9d3e-d149ef74768b service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:45.377357 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06edfb-285b-4860-9d3e-d149ef74768b service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:45.377943 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06edfb-285b-4860-9d3e-d149ef74768b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:45.380256 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9b06edfb-285b-4860-9d3e-d149ef74768b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:45.430723 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8e61f-5fd5-466b-b38b-3dd7068d13a8 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:45.437352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f747a2-5fe0-48f1-a973-531febc3bd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:45.438294 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f747a2-5fe0-48f1-a973-531febc3bd70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:45.438582 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f747a2-5fe0-48f1-a973-531febc3bd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:45.438929 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f747a2-5fe0-48f1-a973-531febc3bd70 admin admin] PATH_INFO: `/v3/projects/0c6a5738b20343bda30f2c1ebca3004c` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:45.440212 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f747a2-5fe0-48f1-a973-531febc3bd70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c6a5738b20343bda30f2c1ebca3004c)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:45.442794 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f747a2-5fe0-48f1-a973-531febc3bd70 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:45.540344 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-96f747a2-5fe0-48f1-a973-531febc3bd70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c6a5738b20343bda30f2c1ebca3004c', 'request_id': 'req-96f747a2-5fe0-48f1-a973-531febc3bd70'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:45.551407 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-96f747a2-5fe0-48f1-a973-531febc3bd70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c6a5738b20343bda30f2c1ebca3004c', 'request_id': 'req-96f747a2-5fe0-48f1-a973-531febc3bd70'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:45.560462 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06edfb-285b-4860-9d3e-d149ef74768b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:45.560676 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-96f747a2-5fe0-48f1-a973-531febc3bd70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c6a5738b20343bda30f2c1ebca3004c', 'request_id': 'req-96f747a2-5fe0-48f1-a973-531febc3bd70'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:45.562693 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06edfb-285b-4860-9d3e-d149ef74768b service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:45.586256 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-96f747a2-5fe0-48f1-a973-531febc3bd70 admin admin] The token cache is being invalidate because project 0c6a5738b20343bda30f2c1ebca3004c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:45.587080 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-96f747a2-5fe0-48f1-a973-531febc3bd70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:45.590927 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-96f747a2-5fe0-48f1-a973-531febc3bd70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:45.594283 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1115/2214] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:45.595545 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1100/2215] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:45 2022] DELETE /identity/v3/projects/0c6a5738b20343bda30f2c1ebca3004c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:28:45.599596 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f747a2-5fe0-48f1-a973-531febc3bd70 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:45.601075 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-96f747a2-5fe0-48f1-a973-531febc3bd70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:45.607791 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06edfb-285b-4860-9d3e-d149ef74768b service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:45.612680 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9b06edfb-285b-4860-9d3e-d149ef74768b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:45.640418 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06edfb-285b-4860-9d3e-d149ef74768b service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:45.720590 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f747a2-5fe0-48f1-a973-531febc3bd70 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:45.723893 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330e9c6-7e5f-45ed-a4c1-5fb9d2c11fc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:45.724631 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330e9c6-7e5f-45ed-a4c1-5fb9d2c11fc9 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:45.724916 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330e9c6-7e5f-45ed-a4c1-5fb9d2c11fc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:45.725284 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330e9c6-7e5f-45ed-a4c1-5fb9d2c11fc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:45.726663 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9bc3f-097a-42c0-ae37-611a3e2f1abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:45.727261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5330e9c6-7e5f-45ed-a4c1-5fb9d2c11fc9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:45.727825 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9bc3f-097a-42c0-ae37-611a3e2f1abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:45.729276 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9bc3f-097a-42c0-ae37-611a3e2f1abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:45.729788 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9bc3f-097a-42c0-ae37-611a3e2f1abb admin admin] PATH_INFO: `/v3/users/31a1ca96a09844668c366773ab660d4d` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:45.731414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9bc3f-097a-42c0-ae37-611a3e2f1abb admin admin] RBAC: Authorizing `identity:delete_user(user_id=31a1ca96a09844668c366773ab660d4d)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:45.733728 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9bc3f-097a-42c0-ae37-611a3e2f1abb admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:45.759829 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:45.797947 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3ea9bc3f-097a-42c0-ae37-611a3e2f1abb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31a1ca96a09844668c366773ab660d4d'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:45.799036 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3ea9bc3f-097a-42c0-ae37-611a3e2f1abb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31a1ca96a09844668c366773ab660d4d'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:45.820257 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3ea9bc3f-097a-42c0-ae37-611a3e2f1abb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31a1ca96a09844668c366773ab660d4d'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:45.824367 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330e9c6-7e5f-45ed-a4c1-5fb9d2c11fc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:45.825994 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330e9c6-7e5f-45ed-a4c1-5fb9d2c11fc9 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:45.828390 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3ea9bc3f-097a-42c0-ae37-611a3e2f1abb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31a1ca96a09844668c366773ab660d4d'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:45.836596 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1116/2216] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:45.850682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3ea9bc3f-097a-42c0-ae37-611a3e2f1abb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31a1ca96a09844668c366773ab660d4d'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:45.863233 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1101/2217] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:45 2022] DELETE /identity/v3/users/31a1ca96a09844668c366773ab660d4d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:46.275145 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330e9c6-7e5f-45ed-a4c1-5fb9d2c11fc9 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:46.287823 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330e9c6-7e5f-45ed-a4c1-5fb9d2c11fc9 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:46.318022 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:46.357624 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3d61c-c840-4dbc-a5b1-cea369b8bd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:46.358686 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3d61c-c840-4dbc-a5b1-cea369b8bd10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:46.358919 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3d61c-c840-4dbc-a5b1-cea369b8bd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:46.359326 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3d61c-c840-4dbc-a5b1-cea369b8bd10 admin admin] PATH_INFO: `/v3/projects/6a9a55903378420d89803e5fc54c31ec` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:46.360541 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce3d61c-c840-4dbc-a5b1-cea369b8bd10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a9a55903378420d89803e5fc54c31ec)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:46.362531 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce3d61c-c840-4dbc-a5b1-cea369b8bd10 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:46.415962 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3ce3d61c-c840-4dbc-a5b1-cea369b8bd10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a9a55903378420d89803e5fc54c31ec', 'request_id': 'req-3ce3d61c-c840-4dbc-a5b1-cea369b8bd10'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:46.421649 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3ce3d61c-c840-4dbc-a5b1-cea369b8bd10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a9a55903378420d89803e5fc54c31ec', 'request_id': 'req-3ce3d61c-c840-4dbc-a5b1-cea369b8bd10'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:46.430916 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3ce3d61c-c840-4dbc-a5b1-cea369b8bd10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a9a55903378420d89803e5fc54c31ec', 'request_id': 'req-3ce3d61c-c840-4dbc-a5b1-cea369b8bd10'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:46.449290 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3ce3d61c-c840-4dbc-a5b1-cea369b8bd10 admin admin] The token cache is being invalidate because project 6a9a55903378420d89803e5fc54c31ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:46.450416 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3ce3d61c-c840-4dbc-a5b1-cea369b8bd10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:46.450690 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3ce3d61c-c840-4dbc-a5b1-cea369b8bd10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:46.452482 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1117/2218] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:46 2022] DELETE /identity/v3/projects/6a9a55903378420d89803e5fc54c31ec => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:46.457546 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b8294-8539-462b-90b6-e739275ac0e4 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:46.458097 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b8294-8539-462b-90b6-e739275ac0e4 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:46.458193 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b8294-8539-462b-90b6-e739275ac0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:46.480124 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-633b8294-8539-462b-90b6-e739275ac0e4 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:46.481427 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-633b8294-8539-462b-90b6-e739275ac0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:46.557436 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1102/2219] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:28:46.565941 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe6dfa-1a7b-4478-bb53-14eaa2224159 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:46.566900 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe6dfa-1a7b-4478-bb53-14eaa2224159 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:46.567263 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe6dfa-1a7b-4478-bb53-14eaa2224159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:46.592117 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-9bbe6dfa-1a7b-4478-bb53-14eaa2224159 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:46.593358 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9bbe6dfa-1a7b-4478-bb53-14eaa2224159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:46.604553 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1118/2220] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:46.608616 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b8294-8539-462b-90b6-e739275ac0e4 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:46.618998 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b8294-8539-462b-90b6-e739275ac0e4 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:46.623844 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6038b6-6dd2-4f90-b6ce-4121f01c7dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:46.624688 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6038b6-6dd2-4f90-b6ce-4121f01c7dea admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:46.624808 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6038b6-6dd2-4f90-b6ce-4121f01c7dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:46.625057 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6038b6-6dd2-4f90-b6ce-4121f01c7dea admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:46.625791 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6038b6-6dd2-4f90-b6ce-4121f01c7dea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:28:46.626155 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6038b6-6dd2-4f90-b6ce-4121f01c7dea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:46.627851 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6038b6-6dd2-4f90-b6ce-4121f01c7dea admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:46.645545 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1103/2221] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:28:46.646024 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe6dfa-1a7b-4478-bb53-14eaa2224159 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:46.658146 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe6dfa-1a7b-4478-bb53-14eaa2224159 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:46.664081 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efdb69f-dad4-4099-b0c6-80c37feeb12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:46.664608 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdb69f-dad4-4099-b0c6-80c37feeb12a admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:46.664931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdb69f-dad4-4099-b0c6-80c37feeb12a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:46.665221 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdb69f-dad4-4099-b0c6-80c37feeb12a admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:46.666570 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efdb69f-dad4-4099-b0c6-80c37feeb12a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:46.668425 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efdb69f-dad4-4099-b0c6-80c37feeb12a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:46.679213 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6038b6-6dd2-4f90-b6ce-4121f01c7dea admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:46.686792 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-2b6038b6-6dd2-4f90-b6ce-4121f01c7dea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:46.703420 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1119/2222] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:28:46 2022] POST /identity/v3/projects => generated 351 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:28:46.704233 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efdb69f-dad4-4099-b0c6-80c37feeb12a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:46.708788 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7efdb69f-dad4-4099-b0c6-80c37feeb12a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:46.757177 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6038b6-6dd2-4f90-b6ce-4121f01c7dea admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:46.800152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efdb69f-dad4-4099-b0c6-80c37feeb12a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:46.801238 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:46.807431 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf21c13-6446-4425-8ded-61c8dbf711e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:46.808434 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf21c13-6446-4425-8ded-61c8dbf711e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:46.808728 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf21c13-6446-4425-8ded-61c8dbf711e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:46.809016 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf21c13-6446-4425-8ded-61c8dbf711e7 admin admin] PATH_INFO: `/v3/users/ef4af76aa42c4a61a0b863c09f84fc3c` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:46.810435 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf21c13-6446-4425-8ded-61c8dbf711e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef4af76aa42c4a61a0b863c09f84fc3c)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:46.812882 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf21c13-6446-4425-8ded-61c8dbf711e7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:46.816100 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a988d1-3e8a-4ede-bc78-f34ca105e762 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:46.816321 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a988d1-3e8a-4ede-bc78-f34ca105e762 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:46.816707 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a988d1-3e8a-4ede-bc78-f34ca105e762 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:46.817090 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a988d1-3e8a-4ede-bc78-f34ca105e762 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:46.819267 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-72a988d1-3e8a-4ede-bc78-f34ca105e762 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:46.870434 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:46.879259 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8bf21c13-6446-4425-8ded-61c8dbf711e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef4af76aa42c4a61a0b863c09f84fc3c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:46.880234 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8bf21c13-6446-4425-8ded-61c8dbf711e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef4af76aa42c4a61a0b863c09f84fc3c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:46.896332 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8bf21c13-6446-4425-8ded-61c8dbf711e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef4af76aa42c4a61a0b863c09f84fc3c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:46.901331 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a988d1-3e8a-4ede-bc78-f34ca105e762 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:46.903318 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a988d1-3e8a-4ede-bc78-f34ca105e762 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:46.904833 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8bf21c13-6446-4425-8ded-61c8dbf711e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef4af76aa42c4a61a0b863c09f84fc3c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:46.905584 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8bf21c13-6446-4425-8ded-61c8dbf711e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef4af76aa42c4a61a0b863c09f84fc3c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:46.914154 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1104/2223] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:28:46.915016 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a988d1-3e8a-4ede-bc78-f34ca105e762 service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:46.919619 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1120/2224] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:46 2022] DELETE /identity/v3/users/ef4af76aa42c4a61a0b863c09f84fc3c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:46.924200 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58999145-5171-4609-aae4-124d3737c376 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:46.924497 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58999145-5171-4609-aae4-124d3737c376 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:46.924837 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58999145-5171-4609-aae4-124d3737c376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:46.929392 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a988d1-3e8a-4ede-bc78-f34ca105e762 service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:46.945539 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-58999145-5171-4609-aae4-124d3737c376 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:46.947160 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-58999145-5171-4609-aae4-124d3737c376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:47.005809 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1f1d8-81d7-4651-8aee-6aa215ab9c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:47.006816 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1f1d8-81d7-4651-8aee-6aa215ab9c48 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:47.007356 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1f1d8-81d7-4651-8aee-6aa215ab9c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:47.008488 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1f1d8-81d7-4651-8aee-6aa215ab9c48 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:47.009506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1f1d8-81d7-4651-8aee-6aa215ab9c48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:47.011983 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1f1d8-81d7-4651-8aee-6aa215ab9c48 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:47.040440 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1105/2225] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:28:46 2022] POST /identity/v3/users => generated 276 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:47.041833 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1121/2226] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:28:47.046309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1f1d8-81d7-4651-8aee-6aa215ab9c48 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:47.048020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-4ac1f1d8-81d7-4651-8aee-6aa215ab9c48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:47.053529 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58999145-5171-4609-aae4-124d3737c376 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:47.055243 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-58999145-5171-4609-aae4-124d3737c376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:47.061877 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1f1d8-81d7-4651-8aee-6aa215ab9c48 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:47.067788 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069477a-8d05-4d75-85b4-5b59ac73e2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:47.068507 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069477a-8d05-4d75-85b4-5b59ac73e2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:47.068818 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069477a-8d05-4d75-85b4-5b59ac73e2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:47.069107 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069477a-8d05-4d75-85b4-5b59ac73e2e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:47.069855 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069477a-8d05-4d75-85b4-5b59ac73e2e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:47.071725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069477a-8d05-4d75-85b4-5b59ac73e2e6 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:47.090692 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1106/2227] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 04:28:47.092155 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069477a-8d05-4d75-85b4-5b59ac73e2e6 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:47.106919 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069477a-8d05-4d75-85b4-5b59ac73e2e6 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:47.114343 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1b052-5396-4d00-bd74-146ba21ee6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:47.115351 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1b052-5396-4d00-bd74-146ba21ee6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:47.115804 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1b052-5396-4d00-bd74-146ba21ee6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:47.116228 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1b052-5396-4d00-bd74-146ba21ee6f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:47.116978 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb1b052-5396-4d00-bd74-146ba21ee6f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:47.118649 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb1b052-5396-4d00-bd74-146ba21ee6f5 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:47.131575 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1107/2228] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:47.138690 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58999145-5171-4609-aae4-124d3737c376 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:47.138795 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1b052-5396-4d00-bd74-146ba21ee6f5 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:47.143231 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fca571-4684-4b53-ba12-5e7113b10619 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:47.144079 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fca571-4684-4b53-ba12-5e7113b10619 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:47.144079 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fca571-4684-4b53-ba12-5e7113b10619 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:47.144403 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fca571-4684-4b53-ba12-5e7113b10619 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:47.147607 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1b052-5396-4d00-bd74-146ba21ee6f5 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:47.155244 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7e662-8d43-4cbc-be3e-4ee17ba59e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:47.155244 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7e662-8d43-4cbc-be3e-4ee17ba59e8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:47.155244 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7e662-8d43-4cbc-be3e-4ee17ba59e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:47.157178 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7e662-8d43-4cbc-be3e-4ee17ba59e8d admin admin] PATH_INFO: `/v3/projects/abd4a4d599ba4223b42e4abb00facba9/users/47fcade9ad354d58960924fa2c56b3b7/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:47.162241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fca571-4684-4b53-ba12-5e7113b10619 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:47.163778 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fca571-4684-4b53-ba12-5e7113b10619 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:47.176011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7e662-8d43-4cbc-be3e-4ee17ba59e8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=abd4a4d599ba4223b42e4abb00facba9, user_id=47fcade9ad354d58960924fa2c56b3b7, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:47.177019 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1122/2229] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:47.178910 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7e662-8d43-4cbc-be3e-4ee17ba59e8d admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:47.196045 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1108/2230] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:47 2022] PUT /identity/v3/projects/abd4a4d599ba4223b42e4abb00facba9/users/47fcade9ad354d58960924fa2c56b3b7/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:47.207993 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bfd66-e38a-4976-9de8-3b2bfd1b2bbb None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:47.208216 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bfd66-e38a-4976-9de8-3b2bfd1b2bbb None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:47.208434 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bfd66-e38a-4976-9de8-3b2bfd1b2bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:47.241430 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-9f1bfd66-e38a-4976-9de8-3b2bfd1b2bbb None None] MFA Rules not processed for user `47fcade9ad354d58960924fa2c56b3b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:47.243412 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9f1bfd66-e38a-4976-9de8-3b2bfd1b2bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:47.262235 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7e662-8d43-4cbc-be3e-4ee17ba59e8d admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:47.264578 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a3f7e662-8d43-4cbc-be3e-4ee17ba59e8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:47.296916 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:47.317075 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:47.338191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1123/2231] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:47 2022] POST /identity/v3/auth/tokens => generated 3218 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:47.340792 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bfd66-e38a-4976-9de8-3b2bfd1b2bbb None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:47.342914 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7e662-8d43-4cbc-be3e-4ee17ba59e8d admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:47.349058 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ddee76-cd49-41cd-bdb6-28c4da7322f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:47.350052 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddee76-cd49-41cd-bdb6-28c4da7322f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:47.350351 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddee76-cd49-41cd-bdb6-28c4da7322f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:47.350632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddee76-cd49-41cd-bdb6-28c4da7322f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:47.352816 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-96ddee76-cd49-41cd-bdb6-28c4da7322f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:47.437475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bfd66-e38a-4976-9de8-3b2bfd1b2bbb None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:47.442919 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40be51-9318-4317-bcfa-8f4e0bd847e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:47.443597 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40be51-9318-4317-bcfa-8f4e0bd847e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:47.443881 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40be51-9318-4317-bcfa-8f4e0bd847e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:47.444244 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40be51-9318-4317-bcfa-8f4e0bd847e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:47.444559 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ddee76-cd49-41cd-bdb6-28c4da7322f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:47.445008 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba40be51-9318-4317-bcfa-8f4e0bd847e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:47.446558 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ddee76-cd49-41cd-bdb6-28c4da7322f8 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:47.447769 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba40be51-9318-4317-bcfa-8f4e0bd847e9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:47.459161 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1109/2232] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:47.490659 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1124/2233] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:28:47 2022] POST /identity/v3/projects => generated 357 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:47.491670 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ddee76-cd49-41cd-bdb6-28c4da7322f8 service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:47.508226 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ddee76-cd49-41cd-bdb6-28c4da7322f8 service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:47.605028 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40be51-9318-4317-bcfa-8f4e0bd847e9 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:47.607392 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ba40be51-9318-4317-bcfa-8f4e0bd847e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:47.618682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33640f88-d07d-46a2-96e4-d0b4f55f55fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:47.619710 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33640f88-d07d-46a2-96e4-d0b4f55f55fa admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:47.619995 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33640f88-d07d-46a2-96e4-d0b4f55f55fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:47.620277 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33640f88-d07d-46a2-96e4-d0b4f55f55fa admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:47.621160 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33640f88-d07d-46a2-96e4-d0b4f55f55fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:47.623485 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33640f88-d07d-46a2-96e4-d0b4f55f55fa admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:47.665813 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1110/2234] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:28:47 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:47.670191 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33640f88-d07d-46a2-96e4-d0b4f55f55fa admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:47.682655 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33640f88-d07d-46a2-96e4-d0b4f55f55fa admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:47.689212 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b08e45-6647-4e9a-a81d-119dad0b5887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:47.689941 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b08e45-6647-4e9a-a81d-119dad0b5887 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:47.690323 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b08e45-6647-4e9a-a81d-119dad0b5887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:47.690672 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b08e45-6647-4e9a-a81d-119dad0b5887 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:47.691597 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b08e45-6647-4e9a-a81d-119dad0b5887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:47.693510 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b08e45-6647-4e9a-a81d-119dad0b5887 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:47.710152 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1111/2235] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 04:28:47.715162 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40be51-9318-4317-bcfa-8f4e0bd847e9 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:47.715341 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b08e45-6647-4e9a-a81d-119dad0b5887 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:47.727798 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0e8c6-bf86-4424-998b-de2b2f778c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:47.728397 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0e8c6-bf86-4424-998b-de2b2f778c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:47.728760 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0e8c6-bf86-4424-998b-de2b2f778c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:47.729143 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0e8c6-bf86-4424-998b-de2b2f778c72 admin admin] PATH_INFO: `/v3/projects/3096d9446c774c519ef81e7c8ee6ad35` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:47.729618 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b08e45-6647-4e9a-a81d-119dad0b5887 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:47.730790 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f0e8c6-bf86-4424-998b-de2b2f778c72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3096d9446c774c519ef81e7c8ee6ad35)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:47.732998 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f0e8c6-bf86-4424-998b-de2b2f778c72 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:47.735891 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc09cb-f8f5-4bfd-b3eb-062cd0c76e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:47.737559 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc09cb-f8f5-4bfd-b3eb-062cd0c76e21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:47.737923 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc09cb-f8f5-4bfd-b3eb-062cd0c76e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:47.738538 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc09cb-f8f5-4bfd-b3eb-062cd0c76e21 admin admin] PATH_INFO: `/v3/projects/229f885d9d9f47c6998bde391c789d4c/users/cafbf7e0a5584f5bb6766e91091d6e4e/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:47.775974 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc09cb-f8f5-4bfd-b3eb-062cd0c76e21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=229f885d9d9f47c6998bde391c789d4c, user_id=cafbf7e0a5584f5bb6766e91091d6e4e, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:47.780838 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc09cb-f8f5-4bfd-b3eb-062cd0c76e21 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:47.800038 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d1f0e8c6-bf86-4424-998b-de2b2f778c72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3096d9446c774c519ef81e7c8ee6ad35', 'request_id': 'req-d1f0e8c6-bf86-4424-998b-de2b2f778c72'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:47.806128 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1112/2236] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:47 2022] PUT /identity/v3/projects/229f885d9d9f47c6998bde391c789d4c/users/cafbf7e0a5584f5bb6766e91091d6e4e/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:28:47.808016 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc09cb-f8f5-4bfd-b3eb-062cd0c76e21 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:47.810615 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d1f0e8c6-bf86-4424-998b-de2b2f778c72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3096d9446c774c519ef81e7c8ee6ad35', 'request_id': 'req-d1f0e8c6-bf86-4424-998b-de2b2f778c72'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:47.819706 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d1f0e8c6-bf86-4424-998b-de2b2f778c72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3096d9446c774c519ef81e7c8ee6ad35', 'request_id': 'req-d1f0e8c6-bf86-4424-998b-de2b2f778c72'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:47.825493 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:47.850153 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d1f0e8c6-bf86-4424-998b-de2b2f778c72 admin admin] The token cache is being invalidate because project 3096d9446c774c519ef81e7c8ee6ad35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:47.850753 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d1f0e8c6-bf86-4424-998b-de2b2f778c72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:47.853477 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d1f0e8c6-bf86-4424-998b-de2b2f778c72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:47.858679 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1125/2237] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:47 2022] DELETE /identity/v3/projects/3096d9446c774c519ef81e7c8ee6ad35 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:47.860159 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0e8c6-bf86-4424-998b-de2b2f778c72 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:47.862268 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d1f0e8c6-bf86-4424-998b-de2b2f778c72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:47.882575 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:47.902936 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc09cb-f8f5-4bfd-b3eb-062cd0c76e21 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:47.908360 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de294d8-f815-497d-a225-9604d0f1a2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:47.909119 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de294d8-f815-497d-a225-9604d0f1a2e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:47.909404 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de294d8-f815-497d-a225-9604d0f1a2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:47.909687 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de294d8-f815-497d-a225-9604d0f1a2e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:47.910497 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de294d8-f815-497d-a225-9604d0f1a2e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:47.912115 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de294d8-f815-497d-a225-9604d0f1a2e0 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:47.925583 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1113/2238] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:47.930079 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de294d8-f815-497d-a225-9604d0f1a2e0 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:47.932378 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7de294d8-f815-497d-a225-9604d0f1a2e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:47.951503 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de294d8-f815-497d-a225-9604d0f1a2e0 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:47.957149 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240ce3f-083e-4d7f-86dd-20b76cdf01e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:47.957963 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240ce3f-083e-4d7f-86dd-20b76cdf01e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:47.958455 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240ce3f-083e-4d7f-86dd-20b76cdf01e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:47.958843 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240ce3f-083e-4d7f-86dd-20b76cdf01e2 admin admin] PATH_INFO: `/v3/projects/229f885d9d9f47c6998bde391c789d4c/users/cafbf7e0a5584f5bb6766e91091d6e4e/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:47.962651 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0240ce3f-083e-4d7f-86dd-20b76cdf01e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=229f885d9d9f47c6998bde391c789d4c, user_id=cafbf7e0a5584f5bb6766e91091d6e4e, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:47.967376 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0240ce3f-083e-4d7f-86dd-20b76cdf01e2 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:47.972475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0e8c6-bf86-4424-998b-de2b2f778c72 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:47.980170 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c10f6-4016-430a-b915-9bd9dcd31654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:47.981314 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c10f6-4016-430a-b915-9bd9dcd31654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:47.982285 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c10f6-4016-430a-b915-9bd9dcd31654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:47.982285 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c10f6-4016-430a-b915-9bd9dcd31654 admin admin] PATH_INFO: `/v3/users/b200b5d77c3145bebe4065261d776d53` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:47.983839 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c10f6-4016-430a-b915-9bd9dcd31654 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b200b5d77c3145bebe4065261d776d53)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:47.987117 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c10f6-4016-430a-b915-9bd9dcd31654 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:47.997628 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1114/2239] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:47 2022] PUT /identity/v3/projects/229f885d9d9f47c6998bde391c789d4c/users/cafbf7e0a5584f5bb6766e91091d6e4e/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:28:48.019512 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce10ca7-b857-48d3-ad5d-170084689787 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:48.022059 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce10ca7-b857-48d3-ad5d-170084689787 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:48.023971 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce10ca7-b857-48d3-ad5d-170084689787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:48.087837 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-bce10ca7-b857-48d3-ad5d-170084689787 None None] MFA Rules not processed for user `cafbf7e0a5584f5bb6766e91091d6e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:48.089780 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-bce10ca7-b857-48d3-ad5d-170084689787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:48.090529 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c08c10f6-4016-430a-b915-9bd9dcd31654 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b200b5d77c3145bebe4065261d776d53'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:48.091348 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c08c10f6-4016-430a-b915-9bd9dcd31654 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b200b5d77c3145bebe4065261d776d53'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:48.113885 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c08c10f6-4016-430a-b915-9bd9dcd31654 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b200b5d77c3145bebe4065261d776d53'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:48.130793 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c08c10f6-4016-430a-b915-9bd9dcd31654 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b200b5d77c3145bebe4065261d776d53'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:48.133044 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c08c10f6-4016-430a-b915-9bd9dcd31654 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b200b5d77c3145bebe4065261d776d53'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:48.205471 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1126/2240] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:47 2022] DELETE /identity/v3/users/b200b5d77c3145bebe4065261d776d53 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:28:48.252910 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1115/2241] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:48 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:48.316218 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c10f6-4016-430a-b915-9bd9dcd31654 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:48.318670 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c08c10f6-4016-430a-b915-9bd9dcd31654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:48.444413 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c10f6-4016-430a-b915-9bd9dcd31654 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:48.453481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798eef6-1b5b-47c2-b385-7a93b51c8734 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:48.454193 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798eef6-1b5b-47c2-b385-7a93b51c8734 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:48.454482 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798eef6-1b5b-47c2-b385-7a93b51c8734 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:48.456443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798eef6-1b5b-47c2-b385-7a93b51c8734 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:48.499123 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce10ca7-b857-48d3-ad5d-170084689787 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:48.500719 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-bce10ca7-b857-48d3-ad5d-170084689787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:48.546595 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:48.599922 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce10ca7-b857-48d3-ad5d-170084689787 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:48.606511 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531de6c-9b81-4007-aeef-1cb698ca5c19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:48.607384 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531de6c-9b81-4007-aeef-1cb698ca5c19 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:48.607771 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531de6c-9b81-4007-aeef-1cb698ca5c19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:48.608146 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531de6c-9b81-4007-aeef-1cb698ca5c19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:48.610685 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e531de6c-9b81-4007-aeef-1cb698ca5c19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:48.624643 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798eef6-1b5b-47c2-b385-7a93b51c8734 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:48.626436 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798eef6-1b5b-47c2-b385-7a93b51c8734 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:48.656515 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1127/2242] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:48 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:48.746123 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531de6c-9b81-4007-aeef-1cb698ca5c19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:48.746123 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531de6c-9b81-4007-aeef-1cb698ca5c19 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:48.746823 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798eef6-1b5b-47c2-b385-7a93b51c8734 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:48.748320 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4798eef6-1b5b-47c2-b385-7a93b51c8734 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:48.762612 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1116/2243] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:48.772839 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531de6c-9b81-4007-aeef-1cb698ca5c19 service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:48.778102 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:48.796872 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531de6c-9b81-4007-aeef-1cb698ca5c19 service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:48.803944 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd222316-8b5b-436c-b68d-7b1c97cd3225 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:48.806477 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd222316-8b5b-436c-b68d-7b1c97cd3225 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:48.806825 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd222316-8b5b-436c-b68d-7b1c97cd3225 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:48.807616 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd222316-8b5b-436c-b68d-7b1c97cd3225 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:48.814385 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-dd222316-8b5b-436c-b68d-7b1c97cd3225 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:48.915436 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798eef6-1b5b-47c2-b385-7a93b51c8734 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:48.935490 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879162c5-42c0-428e-be47-68cf7213ab21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:48.935878 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd222316-8b5b-436c-b68d-7b1c97cd3225 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:48.936690 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879162c5-42c0-428e-be47-68cf7213ab21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:48.937262 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879162c5-42c0-428e-be47-68cf7213ab21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:48.937518 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd222316-8b5b-436c-b68d-7b1c97cd3225 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:48.937783 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879162c5-42c0-428e-be47-68cf7213ab21 admin admin] PATH_INFO: `/v3/projects/bf1fe42d17da40d8b041581f8a644401` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:48.943626 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879162c5-42c0-428e-be47-68cf7213ab21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf1fe42d17da40d8b041581f8a644401)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:48.946414 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879162c5-42c0-428e-be47-68cf7213ab21 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:48.954002 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1117/2244] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:48 2022] GET /identity/v3/auth/tokens => generated 3218 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:28:49.044624 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-879162c5-42c0-428e-be47-68cf7213ab21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf1fe42d17da40d8b041581f8a644401', 'request_id': 'req-879162c5-42c0-428e-be47-68cf7213ab21'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:49.057177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-879162c5-42c0-428e-be47-68cf7213ab21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf1fe42d17da40d8b041581f8a644401', 'request_id': 'req-879162c5-42c0-428e-be47-68cf7213ab21'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:49.075343 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-879162c5-42c0-428e-be47-68cf7213ab21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf1fe42d17da40d8b041581f8a644401', 'request_id': 'req-879162c5-42c0-428e-be47-68cf7213ab21'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:49.101303 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-879162c5-42c0-428e-be47-68cf7213ab21 admin admin] The token cache is being invalidate because project bf1fe42d17da40d8b041581f8a644401 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:49.101608 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-879162c5-42c0-428e-be47-68cf7213ab21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:49.102453 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-879162c5-42c0-428e-be47-68cf7213ab21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:49.104930 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1128/2245] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:48 2022] DELETE /identity/v3/projects/bf1fe42d17da40d8b041581f8a644401 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:28:49.109913 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f351513-39e7-4365-9071-e0a76d68a856 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:49.110282 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f351513-39e7-4365-9071-e0a76d68a856 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:49.110577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f351513-39e7-4365-9071-e0a76d68a856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:49.151557 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-8f351513-39e7-4365-9071-e0a76d68a856 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:49.154190 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-8f351513-39e7-4365-9071-e0a76d68a856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:49.239378 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1118/2246] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:49.252300 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7173b1-0ced-4b26-a5d7-7551c1218bdd None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:49.252782 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7173b1-0ced-4b26-a5d7-7551c1218bdd None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:49.253271 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7173b1-0ced-4b26-a5d7-7551c1218bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:49.276936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-1b7173b1-0ced-4b26-a5d7-7551c1218bdd None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:49.278566 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1b7173b1-0ced-4b26-a5d7-7551c1218bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:49.289431 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1129/2247] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:28:49.294805 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f351513-39e7-4365-9071-e0a76d68a856 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:49.305869 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f351513-39e7-4365-9071-e0a76d68a856 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:49.311546 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba7c53-054e-4228-a814-42a2c30fbdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:49.312271 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba7c53-054e-4228-a814-42a2c30fbdfe admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:49.312501 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba7c53-054e-4228-a814-42a2c30fbdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:49.312780 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba7c53-054e-4228-a814-42a2c30fbdfe admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:49.313546 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba7c53-054e-4228-a814-42a2c30fbdfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:28:49.313825 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba7c53-054e-4228-a814-42a2c30fbdfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:49.315497 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba7c53-054e-4228-a814-42a2c30fbdfe admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:49.332155 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1119/2248] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:28:49.334094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7173b1-0ced-4b26-a5d7-7551c1218bdd None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:49.344676 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7173b1-0ced-4b26-a5d7-7551c1218bdd None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:49.351541 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706d2b9-461e-4c87-b705-b6a7a40fc907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:49.352331 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706d2b9-461e-4c87-b705-b6a7a40fc907 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:49.352721 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706d2b9-461e-4c87-b705-b6a7a40fc907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:49.353240 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706d2b9-461e-4c87-b705-b6a7a40fc907 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:49.354925 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706d2b9-461e-4c87-b705-b6a7a40fc907 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:49.356942 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706d2b9-461e-4c87-b705-b6a7a40fc907 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:49.389855 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1130/2249] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:28:49 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:28:49.391167 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba7c53-054e-4228-a814-42a2c30fbdfe admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:49.403047 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba7c53-054e-4228-a814-42a2c30fbdfe admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:49.468840 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80160099-7a71-4d95-8301-2070ec59a2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:49.469519 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80160099-7a71-4d95-8301-2070ec59a2ef admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:49.469804 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80160099-7a71-4d95-8301-2070ec59a2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:49.470113 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80160099-7a71-4d95-8301-2070ec59a2ef admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:49.470806 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80160099-7a71-4d95-8301-2070ec59a2ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:49.472790 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80160099-7a71-4d95-8301-2070ec59a2ef admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:49.498279 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1120/2250] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:28:49 2022] POST /identity/v3/users => generated 291 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:49.499553 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706d2b9-461e-4c87-b705-b6a7a40fc907 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:49.512543 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706d2b9-461e-4c87-b705-b6a7a40fc907 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:49.520537 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fbea1-ff2a-4853-9470-5292d82e7ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:49.521326 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fbea1-ff2a-4853-9470-5292d82e7ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:49.521677 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fbea1-ff2a-4853-9470-5292d82e7ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:49.522070 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fbea1-ff2a-4853-9470-5292d82e7ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:49.522885 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1fbea1-ff2a-4853-9470-5292d82e7ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:49.524718 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1fbea1-ff2a-4853-9470-5292d82e7ea9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:49.541524 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1131/2251] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:49.543119 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80160099-7a71-4d95-8301-2070ec59a2ef admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:49.568591 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80160099-7a71-4d95-8301-2070ec59a2ef admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:49.575854 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee3b55-a837-4447-b37b-f7a5bdc0bd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:49.576548 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee3b55-a837-4447-b37b-f7a5bdc0bd22 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:49.576818 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee3b55-a837-4447-b37b-f7a5bdc0bd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:49.577108 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee3b55-a837-4447-b37b-f7a5bdc0bd22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:49.577846 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee3b55-a837-4447-b37b-f7a5bdc0bd22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:49.579516 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee3b55-a837-4447-b37b-f7a5bdc0bd22 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:49.597602 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1121/2252] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:49.599649 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fbea1-ff2a-4853-9470-5292d82e7ea9 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:49.615877 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fbea1-ff2a-4853-9470-5292d82e7ea9 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:49.623648 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ada496f-52cf-4ed5-a2e8-e1462feec257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:49.624554 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada496f-52cf-4ed5-a2e8-e1462feec257 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:49.624840 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada496f-52cf-4ed5-a2e8-e1462feec257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:49.625121 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada496f-52cf-4ed5-a2e8-e1462feec257 admin admin] PATH_INFO: `/v3/projects/53016f9a3394416b986e9afb947267f5/users/caf256e1e44748648c58c79564ecd351/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:49.638796 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:49.642694 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ada496f-52cf-4ed5-a2e8-e1462feec257 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53016f9a3394416b986e9afb947267f5, user_id=caf256e1e44748648c58c79564ecd351, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:49.645881 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ada496f-52cf-4ed5-a2e8-e1462feec257 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:49.664264 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1132/2253] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:49 2022] PUT /identity/v3/projects/53016f9a3394416b986e9afb947267f5/users/caf256e1e44748648c58c79564ecd351/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:49.674946 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c5416-313a-411f-a90d-fdf92437981f None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:49.675238 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c5416-313a-411f-a90d-fdf92437981f None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:49.675523 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c5416-313a-411f-a90d-fdf92437981f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:49.690838 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:49.711942 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-e74c5416-313a-411f-a90d-fdf92437981f None None] MFA Rules not processed for user `caf256e1e44748648c58c79564ecd351`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:49.714308 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e74c5416-313a-411f-a90d-fdf92437981f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:49.802086 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1122/2254] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:49.806647 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ada496f-52cf-4ed5-a2e8-e1462feec257 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:49.901083 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ada496f-52cf-4ed5-a2e8-e1462feec257 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:49.907105 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05cb4ac-b451-45ce-8868-55a85d4cbaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:49.907924 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05cb4ac-b451-45ce-8868-55a85d4cbaab admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:49.908086 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05cb4ac-b451-45ce-8868-55a85d4cbaab admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:49.908362 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05cb4ac-b451-45ce-8868-55a85d4cbaab admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:49.909347 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05cb4ac-b451-45ce-8868-55a85d4cbaab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:49.911581 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05cb4ac-b451-45ce-8868-55a85d4cbaab admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:49.945770 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1133/2255] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:28:49 2022] POST /identity/v3/projects => generated 379 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:28:49.948752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c5416-313a-411f-a90d-fdf92437981f None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:49.965802 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c5416-313a-411f-a90d-fdf92437981f None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:50.044208 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f2886-2abf-4418-8db9-34b93c607ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:50.045243 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f2886-2abf-4418-8db9-34b93c607ed1 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:50.046089 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f2886-2abf-4418-8db9-34b93c607ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:50.046089 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f2886-2abf-4418-8db9-34b93c607ed1 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:50.046675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f2886-2abf-4418-8db9-34b93c607ed1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:50.049005 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f2886-2abf-4418-8db9-34b93c607ed1 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:50.086781 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1123/2256] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:28:49 2022] POST /identity/v3/users => generated 296 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:50.091512 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05cb4ac-b451-45ce-8868-55a85d4cbaab admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:50.104084 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05cb4ac-b451-45ce-8868-55a85d4cbaab admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:50.111073 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3eee8-2430-4909-896d-d3021f031233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:50.111771 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3eee8-2430-4909-896d-d3021f031233 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:50.112317 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3eee8-2430-4909-896d-d3021f031233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:50.112609 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3eee8-2430-4909-896d-d3021f031233 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:50.113755 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3eee8-2430-4909-896d-d3021f031233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:50.115988 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3eee8-2430-4909-896d-d3021f031233 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:50.142240 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1134/2257] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:50.149801 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f2886-2abf-4418-8db9-34b93c607ed1 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:50.167379 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f2886-2abf-4418-8db9-34b93c607ed1 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:50.172824 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6f328-992b-4ff2-ad64-1f628b813082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:50.173603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6f328-992b-4ff2-ad64-1f628b813082 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:50.173886 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6f328-992b-4ff2-ad64-1f628b813082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:50.174209 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6f328-992b-4ff2-ad64-1f628b813082 admin admin] PATH_INFO: `/v3/projects/dd63a5ea21e948d8897e21e5800a5fb8/users/481300efcf3c41ddb063b8ee824b8cb2/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:50.208693 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6f328-992b-4ff2-ad64-1f628b813082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd63a5ea21e948d8897e21e5800a5fb8, user_id=481300efcf3c41ddb063b8ee824b8cb2, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:50.212067 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6f328-992b-4ff2-ad64-1f628b813082 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:50.233255 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1124/2258] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:50 2022] PUT /identity/v3/projects/dd63a5ea21e948d8897e21e5800a5fb8/users/481300efcf3c41ddb063b8ee824b8cb2/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:50.237821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3eee8-2430-4909-896d-d3021f031233 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:50.252073 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3eee8-2430-4909-896d-d3021f031233 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:50.335646 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c854b-c355-4816-868e-2255933eb499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:50.336551 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c854b-c355-4816-868e-2255933eb499 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:50.337093 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c854b-c355-4816-868e-2255933eb499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:50.338026 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c854b-c355-4816-868e-2255933eb499 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:50.339075 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c854b-c355-4816-868e-2255933eb499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:50.341360 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c854b-c355-4816-868e-2255933eb499 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:50.356136 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1135/2259] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:50.360409 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6f328-992b-4ff2-ad64-1f628b813082 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:50.372286 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6f328-992b-4ff2-ad64-1f628b813082 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:50.379886 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627b8ac-9323-402b-ae32-313b0335923a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:50.381991 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627b8ac-9323-402b-ae32-313b0335923a admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:50.382632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627b8ac-9323-402b-ae32-313b0335923a admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:50.383230 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627b8ac-9323-402b-ae32-313b0335923a admin admin] PATH_INFO: `/v3/projects/dd63a5ea21e948d8897e21e5800a5fb8/users/481300efcf3c41ddb063b8ee824b8cb2/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:50.386181 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627b8ac-9323-402b-ae32-313b0335923a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd63a5ea21e948d8897e21e5800a5fb8, user_id=481300efcf3c41ddb063b8ee824b8cb2, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:50.390468 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627b8ac-9323-402b-ae32-313b0335923a admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:50.424891 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1125/2260] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:50 2022] PUT /identity/v3/projects/dd63a5ea21e948d8897e21e5800a5fb8/users/481300efcf3c41ddb063b8ee824b8cb2/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:50.437497 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c3c20-cc44-4726-bc8c-d413bbdde1c7 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:50.437845 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c3c20-cc44-4726-bc8c-d413bbdde1c7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:50.438165 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c3c20-cc44-4726-bc8c-d413bbdde1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:50.486922 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-af0c3c20-cc44-4726-bc8c-d413bbdde1c7 None None] MFA Rules not processed for user `481300efcf3c41ddb063b8ee824b8cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:50.488178 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-af0c3c20-cc44-4726-bc8c-d413bbdde1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:50.548799 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:50.600055 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1136/2261] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:50.612379 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627b8ac-9323-402b-ae32-313b0335923a admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:50.614893 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-5627b8ac-9323-402b-ae32-313b0335923a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:50.685232 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:50.689871 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627b8ac-9323-402b-ae32-313b0335923a admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:50.696705 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369f618-c38a-4f09-99ee-a7ceb7c0d21e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:50.698501 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369f618-c38a-4f09-99ee-a7ceb7c0d21e service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:50.698721 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369f618-c38a-4f09-99ee-a7ceb7c0d21e service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:50.698975 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369f618-c38a-4f09-99ee-a7ceb7c0d21e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:50.712520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b369f618-c38a-4f09-99ee-a7ceb7c0d21e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:50.714527 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b369f618-c38a-4f09-99ee-a7ceb7c0d21e service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:50.731093 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1126/2262] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:50 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:51.042831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c3c20-cc44-4726-bc8c-d413bbdde1c7 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:51.044412 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-af0c3c20-cc44-4726-bc8c-d413bbdde1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:51.166887 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c3c20-cc44-4726-bc8c-d413bbdde1c7 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:51.172835 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b07e0-6c23-4e08-b74c-c4a53ff6c17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:51.173769 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b07e0-6c23-4e08-b74c-c4a53ff6c17e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:51.174199 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b07e0-6c23-4e08-b74c-c4a53ff6c17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:51.174484 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b07e0-6c23-4e08-b74c-c4a53ff6c17e admin admin] PATH_INFO: `/v3/users/84258fe182884bf58c4d364769e0516d` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:51.176577 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b07e0-6c23-4e08-b74c-c4a53ff6c17e admin admin] RBAC: Authorizing `identity:delete_user(user_id=84258fe182884bf58c4d364769e0516d)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:51.179550 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b07e0-6c23-4e08-b74c-c4a53ff6c17e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:51.229834 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369f618-c38a-4f09-99ee-a7ceb7c0d21e service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:51.248266 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369f618-c38a-4f09-99ee-a7ceb7c0d21e service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:51.262993 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e12b07e0-6c23-4e08-b74c-c4a53ff6c17e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84258fe182884bf58c4d364769e0516d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:51.264262 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e12b07e0-6c23-4e08-b74c-c4a53ff6c17e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84258fe182884bf58c4d364769e0516d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:51.265218 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f63830-1211-4110-b864-9d86d9dbe5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:51.266372 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f63830-1211-4110-b864-9d86d9dbe5e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:51.266660 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f63830-1211-4110-b864-9d86d9dbe5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:51.267281 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f63830-1211-4110-b864-9d86d9dbe5e8 admin admin] PATH_INFO: `/v3/users/caf256e1e44748648c58c79564ecd351` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:51.268968 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f63830-1211-4110-b864-9d86d9dbe5e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caf256e1e44748648c58c79564ecd351)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:51.270953 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f63830-1211-4110-b864-9d86d9dbe5e8 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:51.283565 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e12b07e0-6c23-4e08-b74c-c4a53ff6c17e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84258fe182884bf58c4d364769e0516d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:51.301882 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e12b07e0-6c23-4e08-b74c-c4a53ff6c17e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84258fe182884bf58c4d364769e0516d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:51.302556 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e12b07e0-6c23-4e08-b74c-c4a53ff6c17e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84258fe182884bf58c4d364769e0516d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:51.326066 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1137/2263] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:51 2022] DELETE /identity/v3/users/84258fe182884bf58c4d364769e0516d => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:51.329372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ce33c-49a6-4a76-897c-404ae96f19d8 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:51.331235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ce33c-49a6-4a76-897c-404ae96f19d8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:51.331235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ce33c-49a6-4a76-897c-404ae96f19d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:51.370332 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-0f5ce33c-49a6-4a76-897c-404ae96f19d8 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:51.372452 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0f5ce33c-49a6-4a76-897c-404ae96f19d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:51.389015 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-91f63830-1211-4110-b864-9d86d9dbe5e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caf256e1e44748648c58c79564ecd351'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:51.389995 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-91f63830-1211-4110-b864-9d86d9dbe5e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caf256e1e44748648c58c79564ecd351'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:51.417495 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-91f63830-1211-4110-b864-9d86d9dbe5e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caf256e1e44748648c58c79564ecd351'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:51.443058 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-91f63830-1211-4110-b864-9d86d9dbe5e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caf256e1e44748648c58c79564ecd351'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:51.456524 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-91f63830-1211-4110-b864-9d86d9dbe5e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caf256e1e44748648c58c79564ecd351'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:51.476060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1138/2264] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:51.476235 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1127/2265] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:51 2022] DELETE /identity/v3/users/caf256e1e44748648c58c79564ecd351 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:51.480210 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aae395-fbbc-4105-8bcd-ab856a04a89b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:51.480529 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aae395-fbbc-4105-8bcd-ab856a04a89b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:51.481294 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aae395-fbbc-4105-8bcd-ab856a04a89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:51.483010 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f63830-1211-4110-b864-9d86d9dbe5e8 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:51.484654 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-91f63830-1211-4110-b864-9d86d9dbe5e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:51.510201 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:51.532036 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-21aae395-fbbc-4105-8bcd-ab856a04a89b None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:51.537310 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-21aae395-fbbc-4105-8bcd-ab856a04a89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:51.603322 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f63830-1211-4110-b864-9d86d9dbe5e8 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:51.607977 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b604ada-867d-48e3-ad60-e28a099562d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:51.609055 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b604ada-867d-48e3-ad60-e28a099562d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:51.609353 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b604ada-867d-48e3-ad60-e28a099562d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:51.609624 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b604ada-867d-48e3-ad60-e28a099562d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:51.648354 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1139/2266] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:51.723541 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aae395-fbbc-4105-8bcd-ab856a04a89b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:51.725127 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-21aae395-fbbc-4105-8bcd-ab856a04a89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:51.729211 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b604ada-867d-48e3-ad60-e28a099562d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:51.730994 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b604ada-867d-48e3-ad60-e28a099562d8 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:51.741757 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aae395-fbbc-4105-8bcd-ab856a04a89b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:51.747588 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1128/2267] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:28:51.747890 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f023b1-e9e1-4b62-a2b2-7ac5c963175c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:51.748460 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f023b1-e9e1-4b62-a2b2-7ac5c963175c service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:51.748983 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f023b1-e9e1-4b62-a2b2-7ac5c963175c service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:51.749270 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f023b1-e9e1-4b62-a2b2-7ac5c963175c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:51.768311 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f023b1-e9e1-4b62-a2b2-7ac5c963175c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:51.769787 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f023b1-e9e1-4b62-a2b2-7ac5c963175c service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:51.785499 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1140/2268] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:28:52.216340 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b604ada-867d-48e3-ad60-e28a099562d8 service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:52.217602 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f023b1-e9e1-4b62-a2b2-7ac5c963175c service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:52.218172 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-8b604ada-867d-48e3-ad60-e28a099562d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:52.220115 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f7f023b1-e9e1-4b62-a2b2-7ac5c963175c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:52.244533 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f023b1-e9e1-4b62-a2b2-7ac5c963175c service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:52.254624 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b604ada-867d-48e3-ad60-e28a099562d8 service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:52.257115 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258326f-0032-4810-904b-aad78b207e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:52.259444 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258326f-0032-4810-904b-aad78b207e65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:52.259736 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258326f-0032-4810-904b-aad78b207e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:52.260021 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258326f-0032-4810-904b-aad78b207e65 admin admin] PATH_INFO: `/v3/projects/53016f9a3394416b986e9afb947267f5` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:52.272873 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4258326f-0032-4810-904b-aad78b207e65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53016f9a3394416b986e9afb947267f5)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:52.272873 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4258326f-0032-4810-904b-aad78b207e65 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:52.309482 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85891ecb-2746-4147-8b01-9d58c97d086b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:52.322127 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85891ecb-2746-4147-8b01-9d58c97d086b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:52.322729 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85891ecb-2746-4147-8b01-9d58c97d086b admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:52.322976 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85891ecb-2746-4147-8b01-9d58c97d086b admin admin] PATH_INFO: `/v3/projects/ea68f4e3118c4b7597a6c986e29f0202` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:52.324472 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85891ecb-2746-4147-8b01-9d58c97d086b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea68f4e3118c4b7597a6c986e29f0202)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:52.326528 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85891ecb-2746-4147-8b01-9d58c97d086b admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:52.338962 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:52.347928 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4258326f-0032-4810-904b-aad78b207e65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53016f9a3394416b986e9afb947267f5', 'request_id': 'req-4258326f-0032-4810-904b-aad78b207e65'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:52.355463 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4258326f-0032-4810-904b-aad78b207e65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53016f9a3394416b986e9afb947267f5', 'request_id': 'req-4258326f-0032-4810-904b-aad78b207e65'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:52.366419 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4258326f-0032-4810-904b-aad78b207e65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53016f9a3394416b986e9afb947267f5', 'request_id': 'req-4258326f-0032-4810-904b-aad78b207e65'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:52.383353 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4258326f-0032-4810-904b-aad78b207e65 admin admin] The token cache is being invalidate because project 53016f9a3394416b986e9afb947267f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:52.383892 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4258326f-0032-4810-904b-aad78b207e65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:52.384674 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4258326f-0032-4810-904b-aad78b207e65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:52.386584 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1141/2269] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:52 2022] DELETE /identity/v3/projects/53016f9a3394416b986e9afb947267f5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:52.390615 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258326f-0032-4810-904b-aad78b207e65 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:52.391993 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4258326f-0032-4810-904b-aad78b207e65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:52.411060 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-85891ecb-2746-4147-8b01-9d58c97d086b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea68f4e3118c4b7597a6c986e29f0202', 'request_id': 'req-85891ecb-2746-4147-8b01-9d58c97d086b'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:52.424418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-85891ecb-2746-4147-8b01-9d58c97d086b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea68f4e3118c4b7597a6c986e29f0202', 'request_id': 'req-85891ecb-2746-4147-8b01-9d58c97d086b'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:52.431495 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-85891ecb-2746-4147-8b01-9d58c97d086b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea68f4e3118c4b7597a6c986e29f0202', 'request_id': 'req-85891ecb-2746-4147-8b01-9d58c97d086b'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:52.445004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-85891ecb-2746-4147-8b01-9d58c97d086b admin admin] The token cache is being invalidate because project ea68f4e3118c4b7597a6c986e29f0202 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:52.445004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-85891ecb-2746-4147-8b01-9d58c97d086b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:52.445930 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-85891ecb-2746-4147-8b01-9d58c97d086b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:52.448249 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1129/2270] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:52 2022] DELETE /identity/v3/projects/ea68f4e3118c4b7597a6c986e29f0202 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:52.451969 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85891ecb-2746-4147-8b01-9d58c97d086b admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:52.454077 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-85891ecb-2746-4147-8b01-9d58c97d086b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:52.471491 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258326f-0032-4810-904b-aad78b207e65 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:52.493551 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:52.526320 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85891ecb-2746-4147-8b01-9d58c97d086b admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:52.530970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4283acf-10ec-4d22-99b2-857ddea2c4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:52.531845 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4283acf-10ec-4d22-99b2-857ddea2c4a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:52.532129 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4283acf-10ec-4d22-99b2-857ddea2c4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:52.532411 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4283acf-10ec-4d22-99b2-857ddea2c4a9 admin admin] PATH_INFO: `/v3/users/d7abae1b32004fb8885035bcc4862c2b` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:52.533650 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4283acf-10ec-4d22-99b2-857ddea2c4a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7abae1b32004fb8885035bcc4862c2b)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:52.535659 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4283acf-10ec-4d22-99b2-857ddea2c4a9 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:52.540403 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782bb58-197a-4829-9116-fadcb8c600f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:52.541852 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782bb58-197a-4829-9116-fadcb8c600f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:52.542196 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782bb58-197a-4829-9116-fadcb8c600f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:52.542472 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782bb58-197a-4829-9116-fadcb8c600f4 admin admin] PATH_INFO: `/v3/users/481300efcf3c41ddb063b8ee824b8cb2` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:52.543709 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b782bb58-197a-4829-9116-fadcb8c600f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=481300efcf3c41ddb063b8ee824b8cb2)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:52.545694 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b782bb58-197a-4829-9116-fadcb8c600f4 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:52.586350 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f4283acf-10ec-4d22-99b2-857ddea2c4a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7abae1b32004fb8885035bcc4862c2b'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:52.587114 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f4283acf-10ec-4d22-99b2-857ddea2c4a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7abae1b32004fb8885035bcc4862c2b'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:52.595898 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b782bb58-197a-4829-9116-fadcb8c600f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '481300efcf3c41ddb063b8ee824b8cb2'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:52.596613 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b782bb58-197a-4829-9116-fadcb8c600f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '481300efcf3c41ddb063b8ee824b8cb2'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:52.599772 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f4283acf-10ec-4d22-99b2-857ddea2c4a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7abae1b32004fb8885035bcc4862c2b'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:52.607151 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f4283acf-10ec-4d22-99b2-857ddea2c4a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7abae1b32004fb8885035bcc4862c2b'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:52.609420 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b782bb58-197a-4829-9116-fadcb8c600f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '481300efcf3c41ddb063b8ee824b8cb2'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:52.619117 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f4283acf-10ec-4d22-99b2-857ddea2c4a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7abae1b32004fb8885035bcc4862c2b'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:52.620009 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b782bb58-197a-4829-9116-fadcb8c600f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '481300efcf3c41ddb063b8ee824b8cb2'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:52.621120 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b782bb58-197a-4829-9116-fadcb8c600f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '481300efcf3c41ddb063b8ee824b8cb2'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:52.627448 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1130/2271] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:52 2022] DELETE /identity/v3/users/d7abae1b32004fb8885035bcc4862c2b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:28:52.636351 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1142/2272] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:52 2022] DELETE /identity/v3/users/481300efcf3c41ddb063b8ee824b8cb2 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:52.920059 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4283acf-10ec-4d22-99b2-857ddea2c4a9 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:52.922329 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f4283acf-10ec-4d22-99b2-857ddea2c4a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:52.947904 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:52.948308 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782bb58-197a-4829-9116-fadcb8c600f4 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:52.951916 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b782bb58-197a-4829-9116-fadcb8c600f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:53.022877 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4283acf-10ec-4d22-99b2-857ddea2c4a9 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:53.028320 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d714928-6d3f-402e-847a-64ab07fdcef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:53.029261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d714928-6d3f-402e-847a-64ab07fdcef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:53.029616 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d714928-6d3f-402e-847a-64ab07fdcef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:53.029963 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d714928-6d3f-402e-847a-64ab07fdcef7 admin admin] PATH_INFO: `/v3/projects/85095203270c4cbc8eca736ef833259e` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:53.031264 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d714928-6d3f-402e-847a-64ab07fdcef7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85095203270c4cbc8eca736ef833259e)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:53.033268 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d714928-6d3f-402e-847a-64ab07fdcef7 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:53.034226 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782bb58-197a-4829-9116-fadcb8c600f4 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:53.040094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1beb21-d5f5-48b3-9ecc-9fe82e19a7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:53.041158 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1beb21-d5f5-48b3-9ecc-9fe82e19a7bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:53.041438 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1beb21-d5f5-48b3-9ecc-9fe82e19a7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:53.042143 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1beb21-d5f5-48b3-9ecc-9fe82e19a7bf admin admin] PATH_INFO: `/v3/projects/dd63a5ea21e948d8897e21e5800a5fb8` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:53.043085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1beb21-d5f5-48b3-9ecc-9fe82e19a7bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd63a5ea21e948d8897e21e5800a5fb8)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:53.045165 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1beb21-d5f5-48b3-9ecc-9fe82e19a7bf admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:53.085416 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-8d714928-6d3f-402e-847a-64ab07fdcef7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85095203270c4cbc8eca736ef833259e', 'request_id': 'req-8d714928-6d3f-402e-847a-64ab07fdcef7'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:53.093399 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:53.095627 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-8d714928-6d3f-402e-847a-64ab07fdcef7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85095203270c4cbc8eca736ef833259e', 'request_id': 'req-8d714928-6d3f-402e-847a-64ab07fdcef7'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:53.096939 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-db1beb21-d5f5-48b3-9ecc-9fe82e19a7bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd63a5ea21e948d8897e21e5800a5fb8', 'request_id': 'req-db1beb21-d5f5-48b3-9ecc-9fe82e19a7bf'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:53.102114 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-8d714928-6d3f-402e-847a-64ab07fdcef7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85095203270c4cbc8eca736ef833259e', 'request_id': 'req-8d714928-6d3f-402e-847a-64ab07fdcef7'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:53.103760 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-db1beb21-d5f5-48b3-9ecc-9fe82e19a7bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd63a5ea21e948d8897e21e5800a5fb8', 'request_id': 'req-db1beb21-d5f5-48b3-9ecc-9fe82e19a7bf'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:53.111204 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-db1beb21-d5f5-48b3-9ecc-9fe82e19a7bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd63a5ea21e948d8897e21e5800a5fb8', 'request_id': 'req-db1beb21-d5f5-48b3-9ecc-9fe82e19a7bf'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:53.115918 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-8d714928-6d3f-402e-847a-64ab07fdcef7 admin admin] The token cache is being invalidate because project 85095203270c4cbc8eca736ef833259e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:53.116161 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-8d714928-6d3f-402e-847a-64ab07fdcef7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:53.116821 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-8d714928-6d3f-402e-847a-64ab07fdcef7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:53.119545 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1131/2273] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:52 2022] DELETE /identity/v3/projects/85095203270c4cbc8eca736ef833259e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:53.123221 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d714928-6d3f-402e-847a-64ab07fdcef7 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:53.123636 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-db1beb21-d5f5-48b3-9ecc-9fe82e19a7bf admin admin] The token cache is being invalidate because project dd63a5ea21e948d8897e21e5800a5fb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:53.123936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-db1beb21-d5f5-48b3-9ecc-9fe82e19a7bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:53.124628 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-db1beb21-d5f5-48b3-9ecc-9fe82e19a7bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:53.124796 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-8d714928-6d3f-402e-847a-64ab07fdcef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:53.126736 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1143/2274] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:52 2022] DELETE /identity/v3/projects/dd63a5ea21e948d8897e21e5800a5fb8 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:53.133263 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b9288-094c-4a29-aed5-0342ef672518 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:53.133569 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b9288-094c-4a29-aed5-0342ef672518 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:53.133870 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b9288-094c-4a29-aed5-0342ef672518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:53.162554 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-605b9288-094c-4a29-aed5-0342ef672518 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:53.164390 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-605b9288-094c-4a29-aed5-0342ef672518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:53.216230 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d714928-6d3f-402e-847a-64ab07fdcef7 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:53.238019 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1144/2275] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:53.245793 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49451e-0038-4a35-8e1d-cc7659b761cc None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:53.246132 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49451e-0038-4a35-8e1d-cc7659b761cc None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:53.246474 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49451e-0038-4a35-8e1d-cc7659b761cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:53.274675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-cd49451e-0038-4a35-8e1d-cc7659b761cc None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:53.276792 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cd49451e-0038-4a35-8e1d-cc7659b761cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:53.277412 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:53.287435 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1145/2276] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:28:53.291851 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49451e-0038-4a35-8e1d-cc7659b761cc None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:53.293556 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b322b-ff22-4a2d-a686-5395e7ce89f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:53.294614 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b322b-ff22-4a2d-a686-5395e7ce89f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:53.295282 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b322b-ff22-4a2d-a686-5395e7ce89f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:53.296498 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b322b-ff22-4a2d-a686-5395e7ce89f6 admin admin] PATH_INFO: `/v3/users/7bc3ac09302e453fac60dc3eeebe6c2c` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:53.297945 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b322b-ff22-4a2d-a686-5395e7ce89f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bc3ac09302e453fac60dc3eeebe6c2c)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:53.300010 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b322b-ff22-4a2d-a686-5395e7ce89f6 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:53.305338 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49451e-0038-4a35-8e1d-cc7659b761cc None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:53.314398 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510b5bd-56b2-4d97-a1da-e5e79932e5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:53.315446 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510b5bd-56b2-4d97-a1da-e5e79932e5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:53.315988 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510b5bd-56b2-4d97-a1da-e5e79932e5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:53.316600 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510b5bd-56b2-4d97-a1da-e5e79932e5c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:53.317685 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f510b5bd-56b2-4d97-a1da-e5e79932e5c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:28:53.318178 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f510b5bd-56b2-4d97-a1da-e5e79932e5c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:53.320342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f510b5bd-56b2-4d97-a1da-e5e79932e5c5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:53.336119 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1146/2277] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:28:53.341184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510b5bd-56b2-4d97-a1da-e5e79932e5c5 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:53.354017 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510b5bd-56b2-4d97-a1da-e5e79932e5c5 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:53.359481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e26060-dd6f-4a97-97d9-0a929de93266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:53.360301 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e26060-dd6f-4a97-97d9-0a929de93266 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:53.360675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e26060-dd6f-4a97-97d9-0a929de93266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:53.360974 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e26060-dd6f-4a97-97d9-0a929de93266 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:53.361676 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e26060-dd6f-4a97-97d9-0a929de93266 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:53.363933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e26060-dd6f-4a97-97d9-0a929de93266 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:53.375378 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-8d1b322b-ff22-4a2d-a686-5395e7ce89f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bc3ac09302e453fac60dc3eeebe6c2c'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:53.376069 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-8d1b322b-ff22-4a2d-a686-5395e7ce89f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bc3ac09302e453fac60dc3eeebe6c2c'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:53.393432 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-8d1b322b-ff22-4a2d-a686-5395e7ce89f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bc3ac09302e453fac60dc3eeebe6c2c'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:53.402542 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-8d1b322b-ff22-4a2d-a686-5395e7ce89f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bc3ac09302e453fac60dc3eeebe6c2c'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:53.407859 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1147/2278] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:28:53 2022] POST /identity/v3/projects => generated 367 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:28:53.409449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e26060-dd6f-4a97-97d9-0a929de93266 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:53.411416 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-60e26060-dd6f-4a97-97d9-0a929de93266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:53.413286 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-8d1b322b-ff22-4a2d-a686-5395e7ce89f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bc3ac09302e453fac60dc3eeebe6c2c'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:53.422844 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1132/2279] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:53 2022] DELETE /identity/v3/users/7bc3ac09302e453fac60dc3eeebe6c2c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:28:53.528926 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e26060-dd6f-4a97-97d9-0a929de93266 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:53.590806 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:53.593556 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b322b-ff22-4a2d-a686-5395e7ce89f6 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:53.594789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-8d1b322b-ff22-4a2d-a686-5395e7ce89f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:53.646541 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55ca83-9d4c-4c64-9328-3cbcd46aba15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:53.647544 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55ca83-9d4c-4c64-9328-3cbcd46aba15 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:53.647767 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55ca83-9d4c-4c64-9328-3cbcd46aba15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:53.648056 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55ca83-9d4c-4c64-9328-3cbcd46aba15 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:53.649069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55ca83-9d4c-4c64-9328-3cbcd46aba15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:53.656689 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55ca83-9d4c-4c64-9328-3cbcd46aba15 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:53.694257 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1148/2280] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:28:53 2022] POST /identity/v3/users => generated 284 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:53.700481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55ca83-9d4c-4c64-9328-3cbcd46aba15 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:53.721771 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b322b-ff22-4a2d-a686-5395e7ce89f6 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:53.727062 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fd25c-049f-4e6f-a0de-d9e0a04cd71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:53.728224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fd25c-049f-4e6f-a0de-d9e0a04cd71f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:53.728483 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fd25c-049f-4e6f-a0de-d9e0a04cd71f admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:53.728797 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fd25c-049f-4e6f-a0de-d9e0a04cd71f admin admin] PATH_INFO: `/v3/users/ddd7f998e6cd4820b396f51f210dcb4c` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:53.730470 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910fd25c-049f-4e6f-a0de-d9e0a04cd71f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddd7f998e6cd4820b396f51f210dcb4c)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:53.732613 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910fd25c-049f-4e6f-a0de-d9e0a04cd71f admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:53.733789 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55ca83-9d4c-4c64-9328-3cbcd46aba15 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:53.747815 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf153b-b9e8-4588-a727-1c8f5b6d2191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:53.748894 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf153b-b9e8-4588-a727-1c8f5b6d2191 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:53.749415 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf153b-b9e8-4588-a727-1c8f5b6d2191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:53.749901 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf153b-b9e8-4588-a727-1c8f5b6d2191 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:53.750900 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf153b-b9e8-4588-a727-1c8f5b6d2191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:53.760006 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf153b-b9e8-4588-a727-1c8f5b6d2191 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:53.778811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1149/2281] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:53.785073 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf153b-b9e8-4588-a727-1c8f5b6d2191 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:53.804487 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-910fd25c-049f-4e6f-a0de-d9e0a04cd71f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddd7f998e6cd4820b396f51f210dcb4c'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:53.805636 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-910fd25c-049f-4e6f-a0de-d9e0a04cd71f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddd7f998e6cd4820b396f51f210dcb4c'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:53.810563 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf153b-b9e8-4588-a727-1c8f5b6d2191 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:53.819022 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f82f47-9d55-45f5-b62f-fc59331316aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:53.819831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f82f47-9d55-45f5-b62f-fc59331316aa admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:53.820124 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f82f47-9d55-45f5-b62f-fc59331316aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:53.820490 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f82f47-9d55-45f5-b62f-fc59331316aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:53.821236 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f82f47-9d55-45f5-b62f-fc59331316aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:53.827268 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-910fd25c-049f-4e6f-a0de-d9e0a04cd71f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddd7f998e6cd4820b396f51f210dcb4c'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:53.828091 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f82f47-9d55-45f5-b62f-fc59331316aa admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:53.840799 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-910fd25c-049f-4e6f-a0de-d9e0a04cd71f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddd7f998e6cd4820b396f51f210dcb4c'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:53.842857 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:53.846081 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1150/2282] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:53.850602 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f82f47-9d55-45f5-b62f-fc59331316aa admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:53.854337 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-57f82f47-9d55-45f5-b62f-fc59331316aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:53.862019 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-910fd25c-049f-4e6f-a0de-d9e0a04cd71f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddd7f998e6cd4820b396f51f210dcb4c'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:53.870373 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1133/2283] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:53 2022] DELETE /identity/v3/users/ddd7f998e6cd4820b396f51f210dcb4c => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:28:53.875020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5fe37-b4b8-4dac-8fdd-8588dc18941d None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:53.875467 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5fe37-b4b8-4dac-8fdd-8588dc18941d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:53.875594 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5fe37-b4b8-4dac-8fdd-8588dc18941d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:53.880040 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f82f47-9d55-45f5-b62f-fc59331316aa admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:53.899315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-28e5fe37-b4b8-4dac-8fdd-8588dc18941d None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:53.901122 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-28e5fe37-b4b8-4dac-8fdd-8588dc18941d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:53.968967 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064481c-8f33-493e-9ad6-5dd2efa47e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:53.969959 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064481c-8f33-493e-9ad6-5dd2efa47e94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:53.970346 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064481c-8f33-493e-9ad6-5dd2efa47e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:53.970636 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064481c-8f33-493e-9ad6-5dd2efa47e94 admin admin] PATH_INFO: `/v3/projects/bc4681897f6a4a908adb45c1dbe9247e/users/ed4c15f74a0b4109b21fbafb3755c2ba/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:53.979143 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1134/2284] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:53.991186 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4064481c-8f33-493e-9ad6-5dd2efa47e94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc4681897f6a4a908adb45c1dbe9247e, user_id=ed4c15f74a0b4109b21fbafb3755c2ba, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:53.995045 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4064481c-8f33-493e-9ad6-5dd2efa47e94 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:54.009230 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1151/2285] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:53 2022] PUT /identity/v3/projects/bc4681897f6a4a908adb45c1dbe9247e/users/ed4c15f74a0b4109b21fbafb3755c2ba/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:28:54.016502 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5fe37-b4b8-4dac-8fdd-8588dc18941d None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:54.018352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-28e5fe37-b4b8-4dac-8fdd-8588dc18941d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:54.082476 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38af069-2cbd-4a55-8509-2e2344f7f600 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:54.083143 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38af069-2cbd-4a55-8509-2e2344f7f600 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:54.083710 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38af069-2cbd-4a55-8509-2e2344f7f600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:54.102497 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5fe37-b4b8-4dac-8fdd-8588dc18941d None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:54.119186 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b38af069-2cbd-4a55-8509-2e2344f7f600 None None] MFA Rules not processed for user `ed4c15f74a0b4109b21fbafb3755c2ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:54.120982 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b38af069-2cbd-4a55-8509-2e2344f7f600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:54.174028 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58a2da-115f-49ad-bfe2-fa4b2119e10b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:54.175502 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58a2da-115f-49ad-bfe2-fa4b2119e10b service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:54.176062 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58a2da-115f-49ad-bfe2-fa4b2119e10b service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:54.177524 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58a2da-115f-49ad-bfe2-fa4b2119e10b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:54.210105 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1152/2286] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:54 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:28:54.214253 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38af069-2cbd-4a55-8509-2e2344f7f600 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:54.214253 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b38af069-2cbd-4a55-8509-2e2344f7f600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:54.237785 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:54.268445 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58a2da-115f-49ad-bfe2-fa4b2119e10b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:54.269913 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58a2da-115f-49ad-bfe2-fa4b2119e10b service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:54.274104 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:54.288461 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1135/2287] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:54.290352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58a2da-115f-49ad-bfe2-fa4b2119e10b service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:54.291455 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38af069-2cbd-4a55-8509-2e2344f7f600 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:54.293136 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6e58a2da-115f-49ad-bfe2-fa4b2119e10b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:54.297027 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cab3a-0b88-4bca-8665-879912e8c9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:54.298022 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cab3a-0b88-4bca-8665-879912e8c9a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:54.298332 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cab3a-0b88-4bca-8665-879912e8c9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:54.298586 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cab3a-0b88-4bca-8665-879912e8c9a7 admin admin] PATH_INFO: `/v3/projects/bf1565060e8b46a7adf5f788e74e85d5` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:54.299902 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846cab3a-0b88-4bca-8665-879912e8c9a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf1565060e8b46a7adf5f788e74e85d5)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:54.301731 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846cab3a-0b88-4bca-8665-879912e8c9a7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:54.363996 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-846cab3a-0b88-4bca-8665-879912e8c9a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf1565060e8b46a7adf5f788e74e85d5', 'request_id': 'req-846cab3a-0b88-4bca-8665-879912e8c9a7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:54.365590 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58a2da-115f-49ad-bfe2-fa4b2119e10b service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:54.372364 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-846cab3a-0b88-4bca-8665-879912e8c9a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf1565060e8b46a7adf5f788e74e85d5', 'request_id': 'req-846cab3a-0b88-4bca-8665-879912e8c9a7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:54.384352 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-846cab3a-0b88-4bca-8665-879912e8c9a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf1565060e8b46a7adf5f788e74e85d5', 'request_id': 'req-846cab3a-0b88-4bca-8665-879912e8c9a7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:54.397508 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-846cab3a-0b88-4bca-8665-879912e8c9a7 admin admin] The token cache is being invalidate because project bf1565060e8b46a7adf5f788e74e85d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:54.397936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-846cab3a-0b88-4bca-8665-879912e8c9a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:54.398652 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-846cab3a-0b88-4bca-8665-879912e8c9a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:54.400463 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1153/2288] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:54 2022] DELETE /identity/v3/projects/bf1565060e8b46a7adf5f788e74e85d5 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:54.407655 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390d111-9811-4353-abf9-c2d8fb35f83d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:54.408041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390d111-9811-4353-abf9-c2d8fb35f83d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:54.408427 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390d111-9811-4353-abf9-c2d8fb35f83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:54.429835 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c390d111-9811-4353-abf9-c2d8fb35f83d None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:54.431633 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c390d111-9811-4353-abf9-c2d8fb35f83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:54.444523 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ec49c-b7a9-4b1f-b22d-abf38473b625 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac83171b9284163a71cc729cef076f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:54.445703 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ec49c-b7a9-4b1f-b22d-abf38473b625 service glance] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:54.446092 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ec49c-b7a9-4b1f-b22d-abf38473b625 service glance] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:54.446687 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ec49c-b7a9-4b1f-b22d-abf38473b625 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:54.449073 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-2c4ec49c-b7a9-4b1f-b22d-abf38473b625 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:54.514470 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1154/2289] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:54.522689 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a92543-070e-4620-9157-31e20ec6bfce None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:54.523024 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a92543-070e-4620-9157-31e20ec6bfce None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:54.523251 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a92543-070e-4620-9157-31e20ec6bfce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:54.532649 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ec49c-b7a9-4b1f-b22d-abf38473b625 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:54.534770 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ec49c-b7a9-4b1f-b22d-abf38473b625 service glance] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:54.546309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1136/2290] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:54 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:28:54.551209 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-50a92543-070e-4620-9157-31e20ec6bfce None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:54.552846 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-50a92543-070e-4620-9157-31e20ec6bfce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:54.565794 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1155/2291] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:54.567316 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ec49c-b7a9-4b1f-b22d-abf38473b625 service glance] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:54.579769 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ec49c-b7a9-4b1f-b22d-abf38473b625 service glance] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:54.586254 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f1f59-50d2-46b1-8fb6-5665af171e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:54.586924 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f1f59-50d2-46b1-8fb6-5665af171e1f admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:54.587214 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f1f59-50d2-46b1-8fb6-5665af171e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:54.588593 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f1f59-50d2-46b1-8fb6-5665af171e1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:54.588770 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f1f59-50d2-46b1-8fb6-5665af171e1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:28:54.589080 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f1f59-50d2-46b1-8fb6-5665af171e1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:54.590955 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f1f59-50d2-46b1-8fb6-5665af171e1f admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:54.612596 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1137/2292] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:28:54.617132 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a92543-070e-4620-9157-31e20ec6bfce None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:54.626962 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a92543-070e-4620-9157-31e20ec6bfce None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:54.631684 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114fc57-4e6c-4507-b575-3c917540af89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:54.632070 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114fc57-4e6c-4507-b575-3c917540af89 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:54.632364 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114fc57-4e6c-4507-b575-3c917540af89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:54.632624 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114fc57-4e6c-4507-b575-3c917540af89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:54.633322 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f114fc57-4e6c-4507-b575-3c917540af89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:54.635693 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f114fc57-4e6c-4507-b575-3c917540af89 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:54.670953 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1156/2293] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:28:54 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:54.675228 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f1f59-50d2-46b1-8fb6-5665af171e1f admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:54.681816 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114fc57-4e6c-4507-b575-3c917540af89 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:54.683826 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f114fc57-4e6c-4507-b575-3c917540af89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:54.689694 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f1f59-50d2-46b1-8fb6-5665af171e1f admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:54.737866 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:54.755100 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:54.764301 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6a6f1-deb1-469a-9af7-70332f9588b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:54.764985 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6a6f1-deb1-469a-9af7-70332f9588b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:54.765277 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6a6f1-deb1-469a-9af7-70332f9588b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:54.765560 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6a6f1-deb1-469a-9af7-70332f9588b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:54.767952 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a6a6f1-deb1-469a-9af7-70332f9588b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:54.770076 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a6a6f1-deb1-469a-9af7-70332f9588b1 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:54.792341 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114fc57-4e6c-4507-b575-3c917540af89 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:54.792776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1138/2294] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:28:54 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:54.796865 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6a6f1-deb1-469a-9af7-70332f9588b1 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:54.801703 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c185d46-9d4e-4fb3-ad4c-03e1a49c016c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:54.803429 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c185d46-9d4e-4fb3-ad4c-03e1a49c016c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:54.804015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c185d46-9d4e-4fb3-ad4c-03e1a49c016c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:54.804620 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c185d46-9d4e-4fb3-ad4c-03e1a49c016c admin admin] PATH_INFO: `/v3/projects/99249a9f25d047bfa09b23a0cdf576d3` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:54.806966 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c185d46-9d4e-4fb3-ad4c-03e1a49c016c admin admin] RBAC: Authorizing `identity:delete_project(project_id=99249a9f25d047bfa09b23a0cdf576d3)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:54.807814 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6a6f1-deb1-469a-9af7-70332f9588b1 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:54.810771 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c185d46-9d4e-4fb3-ad4c-03e1a49c016c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:54.813020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eecc63e-a73a-4f5a-b366-95bbffa088c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:54.814097 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eecc63e-a73a-4f5a-b366-95bbffa088c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:54.814505 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eecc63e-a73a-4f5a-b366-95bbffa088c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:54.814789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eecc63e-a73a-4f5a-b366-95bbffa088c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:54.815837 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eecc63e-a73a-4f5a-b366-95bbffa088c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:54.817430 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eecc63e-a73a-4f5a-b366-95bbffa088c7 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:54.829139 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1139/2295] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 04:28:54.838644 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eecc63e-a73a-4f5a-b366-95bbffa088c7 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:54.851717 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eecc63e-a73a-4f5a-b366-95bbffa088c7 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:54.859521 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee9875-c424-43fc-812c-9f21e9836b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:54.860240 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee9875-c424-43fc-812c-9f21e9836b91 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:54.860525 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee9875-c424-43fc-812c-9f21e9836b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:54.860833 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee9875-c424-43fc-812c-9f21e9836b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:54.861617 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee9875-c424-43fc-812c-9f21e9836b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:54.863359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee9875-c424-43fc-812c-9f21e9836b91 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:54.876563 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1140/2296] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 04:28:54.880591 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee9875-c424-43fc-812c-9f21e9836b91 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:54.891906 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee9875-c424-43fc-812c-9f21e9836b91 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:54.895534 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1c185d46-9d4e-4fb3-ad4c-03e1a49c016c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99249a9f25d047bfa09b23a0cdf576d3', 'request_id': 'req-1c185d46-9d4e-4fb3-ad4c-03e1a49c016c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:54.904887 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1c185d46-9d4e-4fb3-ad4c-03e1a49c016c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99249a9f25d047bfa09b23a0cdf576d3', 'request_id': 'req-1c185d46-9d4e-4fb3-ad4c-03e1a49c016c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:54.917471 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1c185d46-9d4e-4fb3-ad4c-03e1a49c016c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99249a9f25d047bfa09b23a0cdf576d3', 'request_id': 'req-1c185d46-9d4e-4fb3-ad4c-03e1a49c016c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:54.945957 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1c185d46-9d4e-4fb3-ad4c-03e1a49c016c admin admin] The token cache is being invalidate because project 99249a9f25d047bfa09b23a0cdf576d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:54.947245 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1c185d46-9d4e-4fb3-ad4c-03e1a49c016c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:54.948340 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1c185d46-9d4e-4fb3-ad4c-03e1a49c016c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:54.950991 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1157/2297] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:54 2022] DELETE /identity/v3/projects/99249a9f25d047bfa09b23a0cdf576d3 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:28:54.955157 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c185d46-9d4e-4fb3-ad4c-03e1a49c016c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:54.957261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1c185d46-9d4e-4fb3-ad4c-03e1a49c016c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:55.009882 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076bf60-0fbb-4a83-a8d1-210cf5b7330a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:55.011853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076bf60-0fbb-4a83-a8d1-210cf5b7330a admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:55.012741 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076bf60-0fbb-4a83-a8d1-210cf5b7330a admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:55.013437 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076bf60-0fbb-4a83-a8d1-210cf5b7330a admin admin] PATH_INFO: `/v3/projects/d307b6a5f3034a2d809e03c31ea2a723/users/b07eb0402cc04ae08773853f87a58663/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:55.047522 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076bf60-0fbb-4a83-a8d1-210cf5b7330a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d307b6a5f3034a2d809e03c31ea2a723, user_id=b07eb0402cc04ae08773853f87a58663, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:55.054060 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076bf60-0fbb-4a83-a8d1-210cf5b7330a admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:55.079984 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1141/2298] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:54 2022] PUT /identity/v3/projects/d307b6a5f3034a2d809e03c31ea2a723/users/b07eb0402cc04ae08773853f87a58663/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:28:55.092536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37500787-690c-484e-8990-4edf10a2a18f None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:55.092536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37500787-690c-484e-8990-4edf10a2a18f None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:55.092536 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37500787-690c-484e-8990-4edf10a2a18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:55.110078 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c185d46-9d4e-4fb3-ad4c-03e1a49c016c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:55.166922 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-37500787-690c-484e-8990-4edf10a2a18f None None] MFA Rules not processed for user `b07eb0402cc04ae08773853f87a58663`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:55.174599 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-37500787-690c-484e-8990-4edf10a2a18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:55.224375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7fc9f-be1e-4aaa-bd96-9817f04df7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:55.225835 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7fc9f-be1e-4aaa-bd96-9817f04df7f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:55.226253 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7fc9f-be1e-4aaa-bd96-9817f04df7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:55.226541 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7fc9f-be1e-4aaa-bd96-9817f04df7f3 admin admin] PATH_INFO: `/v3/users/7478b0b9725a469ebe2e8a88c97d6919` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:55.227906 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7fc9f-be1e-4aaa-bd96-9817f04df7f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7478b0b9725a469ebe2e8a88c97d6919)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:55.229851 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7fc9f-be1e-4aaa-bd96-9817f04df7f3 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:55.232097 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:55.283749 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1142/2299] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:55.285505 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-20c7fc9f-be1e-4aaa-bd96-9817f04df7f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7478b0b9725a469ebe2e8a88c97d6919'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:55.286901 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-20c7fc9f-be1e-4aaa-bd96-9817f04df7f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7478b0b9725a469ebe2e8a88c97d6919'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:55.294887 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37500787-690c-484e-8990-4edf10a2a18f None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:55.296286 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-37500787-690c-484e-8990-4edf10a2a18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:55.300206 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-20c7fc9f-be1e-4aaa-bd96-9817f04df7f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7478b0b9725a469ebe2e8a88c97d6919'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:55.310282 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-20c7fc9f-be1e-4aaa-bd96-9817f04df7f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7478b0b9725a469ebe2e8a88c97d6919'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:55.311054 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-20c7fc9f-be1e-4aaa-bd96-9817f04df7f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7478b0b9725a469ebe2e8a88c97d6919'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:55.326216 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1158/2300] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:54 2022] DELETE /identity/v3/users/7478b0b9725a469ebe2e8a88c97d6919 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:55.341231 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:55.360132 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37500787-690c-484e-8990-4edf10a2a18f None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:55.429411 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa66b84-3d98-4dc5-8249-57cdf4132eb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:55.430039 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa66b84-3d98-4dc5-8249-57cdf4132eb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:55.430370 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa66b84-3d98-4dc5-8249-57cdf4132eb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:55.430609 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa66b84-3d98-4dc5-8249-57cdf4132eb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:55.433122 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-daa66b84-3d98-4dc5-8249-57cdf4132eb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:55.512744 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa66b84-3d98-4dc5-8249-57cdf4132eb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:55.514286 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa66b84-3d98-4dc5-8249-57cdf4132eb8 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:55.525124 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1143/2301] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:28:55.655800 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7fc9f-be1e-4aaa-bd96-9817f04df7f3 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:55.658662 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-20c7fc9f-be1e-4aaa-bd96-9817f04df7f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:55.765238 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7fc9f-be1e-4aaa-bd96-9817f04df7f3 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:55.770404 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee713b-60bc-4b9c-a25f-abc8953968d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:55.771444 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee713b-60bc-4b9c-a25f-abc8953968d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:55.771790 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee713b-60bc-4b9c-a25f-abc8953968d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:55.772016 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee713b-60bc-4b9c-a25f-abc8953968d7 admin admin] PATH_INFO: `/v3/projects/d77cc6a8f357424ab93f36b36d880313` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:55.773238 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee713b-60bc-4b9c-a25f-abc8953968d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d77cc6a8f357424ab93f36b36d880313)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:55.775303 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee713b-60bc-4b9c-a25f-abc8953968d7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:55.848748 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-14ee713b-60bc-4b9c-a25f-abc8953968d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd77cc6a8f357424ab93f36b36d880313', 'request_id': 'req-14ee713b-60bc-4b9c-a25f-abc8953968d7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:55.856511 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-14ee713b-60bc-4b9c-a25f-abc8953968d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd77cc6a8f357424ab93f36b36d880313', 'request_id': 'req-14ee713b-60bc-4b9c-a25f-abc8953968d7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:55.866404 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-14ee713b-60bc-4b9c-a25f-abc8953968d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd77cc6a8f357424ab93f36b36d880313', 'request_id': 'req-14ee713b-60bc-4b9c-a25f-abc8953968d7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:55.882609 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-14ee713b-60bc-4b9c-a25f-abc8953968d7 admin admin] The token cache is being invalidate because project d77cc6a8f357424ab93f36b36d880313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:55.882915 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-14ee713b-60bc-4b9c-a25f-abc8953968d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:55.883591 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-14ee713b-60bc-4b9c-a25f-abc8953968d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:55.885300 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1159/2302] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:55 2022] DELETE /identity/v3/projects/d77cc6a8f357424ab93f36b36d880313 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:55.890165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa66b84-3d98-4dc5-8249-57cdf4132eb8 service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:55.901816 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa66b84-3d98-4dc5-8249-57cdf4132eb8 service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:55.962498 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81c4b0-5288-4f2a-aeda-6e528761be2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:55.963379 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81c4b0-5288-4f2a-aeda-6e528761be2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:55.963664 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81c4b0-5288-4f2a-aeda-6e528761be2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:55.963944 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81c4b0-5288-4f2a-aeda-6e528761be2f admin admin] PATH_INFO: `/v3/users/ecf4239ef72e4f4294e91f9ca44dfce3` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:55.965145 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81c4b0-5288-4f2a-aeda-6e528761be2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecf4239ef72e4f4294e91f9ca44dfce3)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:55.967147 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81c4b0-5288-4f2a-aeda-6e528761be2f admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:56.016689 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-5a81c4b0-5288-4f2a-aeda-6e528761be2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecf4239ef72e4f4294e91f9ca44dfce3'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:56.017636 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-5a81c4b0-5288-4f2a-aeda-6e528761be2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecf4239ef72e4f4294e91f9ca44dfce3'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:56.019070 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:56.034946 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-5a81c4b0-5288-4f2a-aeda-6e528761be2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecf4239ef72e4f4294e91f9ca44dfce3'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:56.046946 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-5a81c4b0-5288-4f2a-aeda-6e528761be2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecf4239ef72e4f4294e91f9ca44dfce3'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:56.054938 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-5a81c4b0-5288-4f2a-aeda-6e528761be2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecf4239ef72e4f4294e91f9ca44dfce3'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:56.062110 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1144/2303] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:28:55 2022] DELETE /identity/v3/users/ecf4239ef72e4f4294e91f9ca44dfce3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:56.391502 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee713b-60bc-4b9c-a25f-abc8953968d7 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:56.393032 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-14ee713b-60bc-4b9c-a25f-abc8953968d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:56.410991 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee713b-60bc-4b9c-a25f-abc8953968d7 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:56.419621 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:56.492637 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e12bf-3fbb-4c83-8e15-7807c8835cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:56.493540 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e12bf-3fbb-4c83-8e15-7807c8835cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:56.494464 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e12bf-3fbb-4c83-8e15-7807c8835cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:56.494746 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e12bf-3fbb-4c83-8e15-7807c8835cc2 admin admin] PATH_INFO: `/v3/projects/2c3e265b3c934f859a834082c0b9e8b3` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:56.495966 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e12bf-3fbb-4c83-8e15-7807c8835cc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c3e265b3c934f859a834082c0b9e8b3)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:56.497905 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e12bf-3fbb-4c83-8e15-7807c8835cc2 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:56.553405 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-825e12bf-3fbb-4c83-8e15-7807c8835cc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c3e265b3c934f859a834082c0b9e8b3', 'request_id': 'req-825e12bf-3fbb-4c83-8e15-7807c8835cc2'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:56.562018 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-825e12bf-3fbb-4c83-8e15-7807c8835cc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c3e265b3c934f859a834082c0b9e8b3', 'request_id': 'req-825e12bf-3fbb-4c83-8e15-7807c8835cc2'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:56.570026 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-825e12bf-3fbb-4c83-8e15-7807c8835cc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c3e265b3c934f859a834082c0b9e8b3', 'request_id': 'req-825e12bf-3fbb-4c83-8e15-7807c8835cc2'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:56.591874 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-825e12bf-3fbb-4c83-8e15-7807c8835cc2 admin admin] The token cache is being invalidate because project 2c3e265b3c934f859a834082c0b9e8b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:28:56.592151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-825e12bf-3fbb-4c83-8e15-7807c8835cc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:56.592841 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-825e12bf-3fbb-4c83-8e15-7807c8835cc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:28:56.597785 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1160/2304] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:28:56 2022] DELETE /identity/v3/projects/2c3e265b3c934f859a834082c0b9e8b3 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:28:56.599674 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb700a-18e6-441f-b6fb-b5fa58f35f0e None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:56.600018 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb700a-18e6-441f-b6fb-b5fa58f35f0e None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:56.600331 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb700a-18e6-441f-b6fb-b5fa58f35f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:56.619216 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-0fcb700a-18e6-441f-b6fb-b5fa58f35f0e None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:56.620446 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-0fcb700a-18e6-441f-b6fb-b5fa58f35f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:56.694950 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1145/2305] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:56.696694 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b947f-989a-40a4-935d-489d11336f6e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:56.696983 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b947f-989a-40a4-935d-489d11336f6e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:56.697272 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b947f-989a-40a4-935d-489d11336f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:56.722771 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-913b947f-989a-40a4-935d-489d11336f6e None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:56.724327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-913b947f-989a-40a4-935d-489d11336f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:56.736173 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1161/2306] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:28:56.740772 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb700a-18e6-441f-b6fb-b5fa58f35f0e None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:56.751301 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb700a-18e6-441f-b6fb-b5fa58f35f0e None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:56.755888 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ed361-11f9-41c3-a015-8a950b64ec48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:56.756569 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ed361-11f9-41c3-a015-8a950b64ec48 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:56.756862 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ed361-11f9-41c3-a015-8a950b64ec48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:56.757168 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ed361-11f9-41c3-a015-8a950b64ec48 admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:56.757858 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ed361-11f9-41c3-a015-8a950b64ec48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:28:56.758258 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ed361-11f9-41c3-a015-8a950b64ec48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:56.759885 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ed361-11f9-41c3-a015-8a950b64ec48 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:56.771834 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1146/2307] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:28:56.776328 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b947f-989a-40a4-935d-489d11336f6e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:56.785672 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b947f-989a-40a4-935d-489d11336f6e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:56.790846 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52623681-11c2-43e6-99f4-a9317dea25e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:56.791560 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52623681-11c2-43e6-99f4-a9317dea25e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:56.791838 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52623681-11c2-43e6-99f4-a9317dea25e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:56.792112 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52623681-11c2-43e6-99f4-a9317dea25e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:56.792794 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52623681-11c2-43e6-99f4-a9317dea25e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:56.794839 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52623681-11c2-43e6-99f4-a9317dea25e9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:56.821929 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1162/2308] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:28:56 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:56.826449 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ed361-11f9-41c3-a015-8a950b64ec48 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:56.836769 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ed361-11f9-41c3-a015-8a950b64ec48 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:56.905065 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9ccac-3933-443d-9123-1fc68d1504a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:56.906788 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9ccac-3933-443d-9123-1fc68d1504a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:56.907137 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9ccac-3933-443d-9123-1fc68d1504a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:56.907423 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9ccac-3933-443d-9123-1fc68d1504a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:56.908132 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9ccac-3933-443d-9123-1fc68d1504a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:56.910150 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9ccac-3933-443d-9123-1fc68d1504a8 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:56.932307 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1147/2309] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:28:56 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:28:56.936572 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52623681-11c2-43e6-99f4-a9317dea25e9 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:56.944597 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d73fd3-0772-4635-adf5-183388a9a7d5 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:56.944887 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d73fd3-0772-4635-adf5-183388a9a7d5 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:56.945182 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d73fd3-0772-4635-adf5-183388a9a7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:56.948429 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52623681-11c2-43e6-99f4-a9317dea25e9 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:56.953540 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b233e9b-191e-473f-aad7-e169c22eee70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:56.954269 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b233e9b-191e-473f-aad7-e169c22eee70 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:56.954555 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b233e9b-191e-473f-aad7-e169c22eee70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:56.954838 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b233e9b-191e-473f-aad7-e169c22eee70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:56.955576 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b233e9b-191e-473f-aad7-e169c22eee70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:56.957715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b233e9b-191e-473f-aad7-e169c22eee70 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:56.966454 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-48d73fd3-0772-4635-adf5-183388a9a7d5 None None] MFA Rules not processed for user `b07eb0402cc04ae08773853f87a58663`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:56.968138 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-48d73fd3-0772-4635-adf5-183388a9a7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:56.970727 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1163/2310] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:28:56.974581 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b233e9b-191e-473f-aad7-e169c22eee70 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:56.986844 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b233e9b-191e-473f-aad7-e169c22eee70 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:56.993674 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8631450-655f-490b-afed-352ad175d97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:56.994380 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8631450-655f-490b-afed-352ad175d97d admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:56.994670 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8631450-655f-490b-afed-352ad175d97d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:56.994950 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8631450-655f-490b-afed-352ad175d97d admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:56.995678 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8631450-655f-490b-afed-352ad175d97d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:56.997289 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8631450-655f-490b-afed-352ad175d97d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:57.010782 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1164/2311] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 04:28:57.014551 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:57.015351 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8631450-655f-490b-afed-352ad175d97d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:57.027632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8631450-655f-490b-afed-352ad175d97d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:57.032361 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c939f-b40b-4a65-b82b-35c509bd5b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:57.033240 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c939f-b40b-4a65-b82b-35c509bd5b1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:57.033517 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c939f-b40b-4a65-b82b-35c509bd5b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:57.033811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c939f-b40b-4a65-b82b-35c509bd5b1e admin admin] PATH_INFO: `/v3/projects/663b34f447084eafb3ca791399f07cea/users/06ee2c50e9034cfcb7d4b543a122b3c9/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:57.033945 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1148/2312] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:28:57.050935 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c939f-b40b-4a65-b82b-35c509bd5b1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=663b34f447084eafb3ca791399f07cea, user_id=06ee2c50e9034cfcb7d4b543a122b3c9, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:57.053588 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c939f-b40b-4a65-b82b-35c509bd5b1e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:57.068949 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1165/2313] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:28:57 2022] PUT /identity/v3/projects/663b34f447084eafb3ca791399f07cea/users/06ee2c50e9034cfcb7d4b543a122b3c9/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:28:57.074569 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6b4c3-caae-4d5d-8158-9d30f74374bc None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:57.074894 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6b4c3-caae-4d5d-8158-9d30f74374bc None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:57.075184 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6b4c3-caae-4d5d-8158-9d30f74374bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:57.098077 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-49a6b4c3-caae-4d5d-8158-9d30f74374bc None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:28:57.099289 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-49a6b4c3-caae-4d5d-8158-9d30f74374bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:57.170274 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1149/2314] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:28:57.180524 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c939f-b40b-4a65-b82b-35c509bd5b1e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:28:57.182402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-be6c939f-b40b-4a65-b82b-35c509bd5b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:28:57.214783 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:28:57.250398 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c939f-b40b-4a65-b82b-35c509bd5b1e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:28:57.255257 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0d4ed-b759-4d84-86b7-f0c0355d18f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:28:57.255913 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0d4ed-b759-4d84-86b7-f0c0355d18f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:28:57.256201 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0d4ed-b759-4d84-86b7-f0c0355d18f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:28:57.256485 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0d4ed-b759-4d84-86b7-f0c0355d18f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:28:57.268352 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0d4ed-b759-4d84-86b7-f0c0355d18f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:28:57.270332 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0d4ed-b759-4d84-86b7-f0c0355d18f3 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:28:57.294213 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1166/2315] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:28:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:29:03.728034 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965019d-938e-4455-ba84-970db08e8c91 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:03.728712 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965019d-938e-4455-ba84-970db08e8c91 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:03.728712 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965019d-938e-4455-ba84-970db08e8c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:03.765364 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-d965019d-938e-4455-ba84-970db08e8c91 None None] MFA Rules not processed for user `06ee2c50e9034cfcb7d4b543a122b3c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:29:03.766642 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d965019d-938e-4455-ba84-970db08e8c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:03.889023 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1150/2316] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:29:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:29:03.893690 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0d4ed-b759-4d84-86b7-f0c0355d18f3 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:03.904023 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0d4ed-b759-4d84-86b7-f0c0355d18f3 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:03.909860 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b0c0f-a2de-42c6-9b98-110c52445698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:03.910567 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b0c0f-a2de-42c6-9b98-110c52445698 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:03.910856 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b0c0f-a2de-42c6-9b98-110c52445698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:03.911137 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b0c0f-a2de-42c6-9b98-110c52445698 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:03.911837 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b0c0f-a2de-42c6-9b98-110c52445698 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:03.913759 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b0c0f-a2de-42c6-9b98-110c52445698 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:03.950181 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1167/2317] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:29:03 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:29:03.954135 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965019d-938e-4455-ba84-970db08e8c91 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:03.966258 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965019d-938e-4455-ba84-970db08e8c91 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:04.052969 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ef72d-9b88-44c8-8d8d-cd5b84cce423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:04.052969 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ef72d-9b88-44c8-8d8d-cd5b84cce423 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:04.052969 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ef72d-9b88-44c8-8d8d-cd5b84cce423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:04.052969 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ef72d-9b88-44c8-8d8d-cd5b84cce423 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:04.053428 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ef72d-9b88-44c8-8d8d-cd5b84cce423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:04.054598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ef72d-9b88-44c8-8d8d-cd5b84cce423 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:04.087121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1151/2318] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:29:03 2022] POST /identity/v3/users => generated 298 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:29:04.090868 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b0c0f-a2de-42c6-9b98-110c52445698 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:04.111200 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b0c0f-a2de-42c6-9b98-110c52445698 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:04.120078 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df039ad-bf60-4c92-be30-c44a8aca1d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:04.121240 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df039ad-bf60-4c92-be30-c44a8aca1d8f admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:04.121398 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df039ad-bf60-4c92-be30-c44a8aca1d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:04.121673 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df039ad-bf60-4c92-be30-c44a8aca1d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:04.122373 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df039ad-bf60-4c92-be30-c44a8aca1d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:04.124106 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df039ad-bf60-4c92-be30-c44a8aca1d8f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:04.150354 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1168/2319] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:29:04.165915 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ef72d-9b88-44c8-8d8d-cd5b84cce423 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:04.180231 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ef72d-9b88-44c8-8d8d-cd5b84cce423 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:04.186295 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa7026-f7a8-4bfa-9e48-26b5f161b95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:04.193191 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa7026-f7a8-4bfa-9e48-26b5f161b95e admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:04.193191 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa7026-f7a8-4bfa-9e48-26b5f161b95e admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:04.193191 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa7026-f7a8-4bfa-9e48-26b5f161b95e admin admin] PATH_INFO: `/v3/projects/6da0c0871bfc4f73802ab853d13dae58/users/99c2c7023bc84ef99e2e8675e4c2372a/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:04.194904 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:04.220732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fa7026-f7a8-4bfa-9e48-26b5f161b95e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6da0c0871bfc4f73802ab853d13dae58, user_id=99c2c7023bc84ef99e2e8675e4c2372a, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:04.224215 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fa7026-f7a8-4bfa-9e48-26b5f161b95e admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:04.261770 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1152/2320] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:29:04 2022] PUT /identity/v3/projects/6da0c0871bfc4f73802ab853d13dae58/users/99c2c7023bc84ef99e2e8675e4c2372a/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:29:04.268079 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df039ad-bf60-4c92-be30-c44a8aca1d8f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:04.283424 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df039ad-bf60-4c92-be30-c44a8aca1d8f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:04.401058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f45b72-f96f-42c1-8cb3-bdf2fa700c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:04.401800 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f45b72-f96f-42c1-8cb3-bdf2fa700c10 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:04.402173 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f45b72-f96f-42c1-8cb3-bdf2fa700c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:04.402558 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f45b72-f96f-42c1-8cb3-bdf2fa700c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:04.403577 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f45b72-f96f-42c1-8cb3-bdf2fa700c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:04.405454 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f45b72-f96f-42c1-8cb3-bdf2fa700c10 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:04.434397 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1169/2321] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:29:04.437202 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa7026-f7a8-4bfa-9e48-26b5f161b95e admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:04.448642 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa7026-f7a8-4bfa-9e48-26b5f161b95e admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:04.456038 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176f7d8-b439-437e-8cad-14c4092a4b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:04.456992 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176f7d8-b439-437e-8cad-14c4092a4b53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:04.457280 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176f7d8-b439-437e-8cad-14c4092a4b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:04.457559 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176f7d8-b439-437e-8cad-14c4092a4b53 admin admin] PATH_INFO: `/v3/projects/6da0c0871bfc4f73802ab853d13dae58/users/99c2c7023bc84ef99e2e8675e4c2372a/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:04.459885 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1176f7d8-b439-437e-8cad-14c4092a4b53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6da0c0871bfc4f73802ab853d13dae58, user_id=99c2c7023bc84ef99e2e8675e4c2372a, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:04.463647 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1176f7d8-b439-437e-8cad-14c4092a4b53 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:04.482046 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1153/2322] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:29:04 2022] PUT /identity/v3/projects/6da0c0871bfc4f73802ab853d13dae58/users/99c2c7023bc84ef99e2e8675e4c2372a/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:29:06.201316 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f45b72-f96f-42c1-8cb3-bdf2fa700c10 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:06.205122 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-75f45b72-f96f-42c1-8cb3-bdf2fa700c10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:06.247765 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f45b72-f96f-42c1-8cb3-bdf2fa700c10 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:06.391239 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef6866-52df-4b7f-af1c-e601b7bc8bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:06.392194 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef6866-52df-4b7f-af1c-e601b7bc8bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:06.392369 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef6866-52df-4b7f-af1c-e601b7bc8bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:06.392607 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef6866-52df-4b7f-af1c-e601b7bc8bc9 admin admin] PATH_INFO: `/v3/users/47fcade9ad354d58960924fa2c56b3b7` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:06.398762 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef6866-52df-4b7f-af1c-e601b7bc8bc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47fcade9ad354d58960924fa2c56b3b7)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:06.401335 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef6866-52df-4b7f-af1c-e601b7bc8bc9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:06.482162 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:06.518237 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bcef6866-52df-4b7f-af1c-e601b7bc8bc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47fcade9ad354d58960924fa2c56b3b7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:06.518948 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bcef6866-52df-4b7f-af1c-e601b7bc8bc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47fcade9ad354d58960924fa2c56b3b7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:06.565439 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bcef6866-52df-4b7f-af1c-e601b7bc8bc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47fcade9ad354d58960924fa2c56b3b7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:06.585009 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bcef6866-52df-4b7f-af1c-e601b7bc8bc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47fcade9ad354d58960924fa2c56b3b7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:06.586330 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bcef6866-52df-4b7f-af1c-e601b7bc8bc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47fcade9ad354d58960924fa2c56b3b7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:06.620837 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1170/2323] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:29:06 2022] DELETE /identity/v3/users/47fcade9ad354d58960924fa2c56b3b7 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:29:06.626315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912eb28-848a-4887-a1b1-f0f4bd09336b None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:06.627177 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912eb28-848a-4887-a1b1-f0f4bd09336b None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:06.627640 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912eb28-848a-4887-a1b1-f0f4bd09336b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:06.656436 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-c912eb28-848a-4887-a1b1-f0f4bd09336b None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:29:06.657800 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c912eb28-848a-4887-a1b1-f0f4bd09336b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:06.783080 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1154/2324] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:29:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:29:06.790924 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef6866-52df-4b7f-af1c-e601b7bc8bc9 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:06.792513 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-bcef6866-52df-4b7f-af1c-e601b7bc8bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:06.926854 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef6866-52df-4b7f-af1c-e601b7bc8bc9 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:06.938982 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942483e7-ffac-4c05-b790-766778a53919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:06.939775 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942483e7-ffac-4c05-b790-766778a53919 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:06.940154 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942483e7-ffac-4c05-b790-766778a53919 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:06.941080 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942483e7-ffac-4c05-b790-766778a53919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:06.973225 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942483e7-ffac-4c05-b790-766778a53919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:06.974890 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942483e7-ffac-4c05-b790-766778a53919 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:07.005574 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1171/2325] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:29:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:29:07.460147 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912eb28-848a-4887-a1b1-f0f4bd09336b None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:07.462823 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c912eb28-848a-4887-a1b1-f0f4bd09336b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:07.491825 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912eb28-848a-4887-a1b1-f0f4bd09336b None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:07.499138 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88bd5d-61ff-4f1c-bfaa-d79077eadaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:07.499538 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88bd5d-61ff-4f1c-bfaa-d79077eadaa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:07.499928 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88bd5d-61ff-4f1c-bfaa-d79077eadaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:07.500307 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88bd5d-61ff-4f1c-bfaa-d79077eadaa5 admin admin] PATH_INFO: `/v3/projects/abd4a4d599ba4223b42e4abb00facba9` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:07.501800 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d88bd5d-61ff-4f1c-bfaa-d79077eadaa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abd4a4d599ba4223b42e4abb00facba9)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:07.505344 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d88bd5d-61ff-4f1c-bfaa-d79077eadaa5 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:07.591587 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3d88bd5d-61ff-4f1c-bfaa-d79077eadaa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abd4a4d599ba4223b42e4abb00facba9', 'request_id': 'req-3d88bd5d-61ff-4f1c-bfaa-d79077eadaa5'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:07.604814 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3d88bd5d-61ff-4f1c-bfaa-d79077eadaa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abd4a4d599ba4223b42e4abb00facba9', 'request_id': 'req-3d88bd5d-61ff-4f1c-bfaa-d79077eadaa5'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:07.615713 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3d88bd5d-61ff-4f1c-bfaa-d79077eadaa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abd4a4d599ba4223b42e4abb00facba9', 'request_id': 'req-3d88bd5d-61ff-4f1c-bfaa-d79077eadaa5'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:07.629668 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3d88bd5d-61ff-4f1c-bfaa-d79077eadaa5 admin admin] The token cache is being invalidate because project abd4a4d599ba4223b42e4abb00facba9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:29:07.630378 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3d88bd5d-61ff-4f1c-bfaa-d79077eadaa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:07.630970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3d88bd5d-61ff-4f1c-bfaa-d79077eadaa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:07.632856 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1155/2326] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:29:07 2022] DELETE /identity/v3/projects/abd4a4d599ba4223b42e4abb00facba9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:29:07.638130 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942483e7-ffac-4c05-b790-766778a53919 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:07.650524 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942483e7-ffac-4c05-b790-766778a53919 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:07.723225 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07463a8-32fe-4595-8b8f-5ffb9311ed00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:07.724152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07463a8-32fe-4595-8b8f-5ffb9311ed00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:07.724500 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07463a8-32fe-4595-8b8f-5ffb9311ed00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:07.724794 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07463a8-32fe-4595-8b8f-5ffb9311ed00 admin admin] PATH_INFO: `/v3/users/cafbf7e0a5584f5bb6766e91091d6e4e` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:07.726208 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07463a8-32fe-4595-8b8f-5ffb9311ed00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cafbf7e0a5584f5bb6766e91091d6e4e)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:07.728794 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07463a8-32fe-4595-8b8f-5ffb9311ed00 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:07.801449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b07463a8-32fe-4595-8b8f-5ffb9311ed00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cafbf7e0a5584f5bb6766e91091d6e4e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:07.802391 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b07463a8-32fe-4595-8b8f-5ffb9311ed00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cafbf7e0a5584f5bb6766e91091d6e4e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:07.810688 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:07.821602 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b07463a8-32fe-4595-8b8f-5ffb9311ed00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cafbf7e0a5584f5bb6766e91091d6e4e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:07.832972 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b07463a8-32fe-4595-8b8f-5ffb9311ed00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cafbf7e0a5584f5bb6766e91091d6e4e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:07.833925 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b07463a8-32fe-4595-8b8f-5ffb9311ed00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cafbf7e0a5584f5bb6766e91091d6e4e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:07.861625 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1172/2327] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:29:07 2022] DELETE /identity/v3/users/cafbf7e0a5584f5bb6766e91091d6e4e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:29:09.041401 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88bd5d-61ff-4f1c-bfaa-d79077eadaa5 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:09.048660 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3d88bd5d-61ff-4f1c-bfaa-d79077eadaa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:09.072005 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88bd5d-61ff-4f1c-bfaa-d79077eadaa5 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:09.226158 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:09.252107 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ee80b-23db-42b5-9c56-536caf44cb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:09.258324 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ee80b-23db-42b5-9c56-536caf44cb99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:09.259333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ee80b-23db-42b5-9c56-536caf44cb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:09.259736 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ee80b-23db-42b5-9c56-536caf44cb99 admin admin] PATH_INFO: `/v3/projects/229f885d9d9f47c6998bde391c789d4c` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:09.262172 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ee80b-23db-42b5-9c56-536caf44cb99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=229f885d9d9f47c6998bde391c789d4c)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:09.270236 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ee80b-23db-42b5-9c56-536caf44cb99 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:09.425883 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-1d9ee80b-23db-42b5-9c56-536caf44cb99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '229f885d9d9f47c6998bde391c789d4c', 'request_id': 'req-1d9ee80b-23db-42b5-9c56-536caf44cb99'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:09.449047 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-1d9ee80b-23db-42b5-9c56-536caf44cb99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '229f885d9d9f47c6998bde391c789d4c', 'request_id': 'req-1d9ee80b-23db-42b5-9c56-536caf44cb99'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:09.463109 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-1d9ee80b-23db-42b5-9c56-536caf44cb99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '229f885d9d9f47c6998bde391c789d4c', 'request_id': 'req-1d9ee80b-23db-42b5-9c56-536caf44cb99'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:09.492838 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-1d9ee80b-23db-42b5-9c56-536caf44cb99 admin admin] The token cache is being invalidate because project 229f885d9d9f47c6998bde391c789d4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:29:09.493587 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-1d9ee80b-23db-42b5-9c56-536caf44cb99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:09.494672 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-1d9ee80b-23db-42b5-9c56-536caf44cb99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:09.501137 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1156/2328] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:29:09 2022] DELETE /identity/v3/projects/229f885d9d9f47c6998bde391c789d4c => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:29:09.503464 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e7da8-3316-445d-8aca-4c9aeb54ccc4 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:09.503981 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e7da8-3316-445d-8aca-4c9aeb54ccc4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:09.504089 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e7da8-3316-445d-8aca-4c9aeb54ccc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:09.538216 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-659e7da8-3316-445d-8aca-4c9aeb54ccc4 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:29:09.540480 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-659e7da8-3316-445d-8aca-4c9aeb54ccc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:09.706150 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df63021-c425-47f2-93a8-37c1876928de None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:09.706905 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df63021-c425-47f2-93a8-37c1876928de None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:09.707572 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df63021-c425-47f2-93a8-37c1876928de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:09.710734 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1173/2329] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:29:09.745197 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-6df63021-c425-47f2-93a8-37c1876928de None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:29:09.746945 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6df63021-c425-47f2-93a8-37c1876928de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:09.759976 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1157/2330] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:29:09.765374 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e7da8-3316-445d-8aca-4c9aeb54ccc4 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:09.777999 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e7da8-3316-445d-8aca-4c9aeb54ccc4 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:09.785826 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209f44b-37c0-4915-b58c-460600e9ab25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:09.787388 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209f44b-37c0-4915-b58c-460600e9ab25 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:09.787913 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209f44b-37c0-4915-b58c-460600e9ab25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:09.788819 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209f44b-37c0-4915-b58c-460600e9ab25 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:09.790438 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209f44b-37c0-4915-b58c-460600e9ab25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:29:09.791066 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209f44b-37c0-4915-b58c-460600e9ab25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:09.794676 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209f44b-37c0-4915-b58c-460600e9ab25 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:09.822249 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1174/2331] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:29:09.826731 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df63021-c425-47f2-93a8-37c1876928de None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:09.838421 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df63021-c425-47f2-93a8-37c1876928de None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:09.845629 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d853a29-d1ec-4cee-a5a5-271d6f83a680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:09.848393 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d853a29-d1ec-4cee-a5a5-271d6f83a680 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:09.848393 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d853a29-d1ec-4cee-a5a5-271d6f83a680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:09.848393 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d853a29-d1ec-4cee-a5a5-271d6f83a680 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:09.849922 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d853a29-d1ec-4cee-a5a5-271d6f83a680 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:09.854707 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d853a29-d1ec-4cee-a5a5-271d6f83a680 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:09.907208 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209f44b-37c0-4915-b58c-460600e9ab25 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:09.908178 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1158/2332] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:29:09 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:29:09.923343 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209f44b-37c0-4915-b58c-460600e9ab25 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:10.002787 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2faeb-728c-483f-9ab9-f4b400881d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:10.003662 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2faeb-728c-483f-9ab9-f4b400881d45 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:10.004097 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2faeb-728c-483f-9ab9-f4b400881d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:10.004599 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2faeb-728c-483f-9ab9-f4b400881d45 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:10.005586 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c2faeb-728c-483f-9ab9-f4b400881d45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:10.009626 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c2faeb-728c-483f-9ab9-f4b400881d45 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:10.046696 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d853a29-d1ec-4cee-a5a5-271d6f83a680 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:10.058804 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1175/2333] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:29:09 2022] POST /identity/v3/users => generated 292 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:29:10.061072 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d853a29-d1ec-4cee-a5a5-271d6f83a680 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:10.067265 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea8076-a3b7-4286-8c23-2ab7fb2f06f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:10.068394 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea8076-a3b7-4286-8c23-2ab7fb2f06f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:10.068763 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea8076-a3b7-4286-8c23-2ab7fb2f06f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:10.069148 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea8076-a3b7-4286-8c23-2ab7fb2f06f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:10.070153 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea8076-a3b7-4286-8c23-2ab7fb2f06f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:10.072131 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea8076-a3b7-4286-8c23-2ab7fb2f06f6 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:10.090645 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2faeb-728c-483f-9ab9-f4b400881d45 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:10.098234 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1159/2334] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:29:10.103620 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2faeb-728c-483f-9ab9-f4b400881d45 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:10.119784 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd2423-6176-4319-8516-2e52d24e7042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:10.120697 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd2423-6176-4319-8516-2e52d24e7042 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:10.122310 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd2423-6176-4319-8516-2e52d24e7042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:10.123151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd2423-6176-4319-8516-2e52d24e7042 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:10.128157 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd2423-6176-4319-8516-2e52d24e7042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:10.136875 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd2423-6176-4319-8516-2e52d24e7042 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:10.177907 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1176/2335] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:29:10.182586 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea8076-a3b7-4286-8c23-2ab7fb2f06f6 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:10.193931 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea8076-a3b7-4286-8c23-2ab7fb2f06f6 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:10.209682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51868657-d1bb-4b12-9eaa-1bdff3aed180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:10.210771 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51868657-d1bb-4b12-9eaa-1bdff3aed180 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:10.213783 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51868657-d1bb-4b12-9eaa-1bdff3aed180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:10.214147 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51868657-d1bb-4b12-9eaa-1bdff3aed180 admin admin] PATH_INFO: `/v3/projects/b275546043ea4b3299c16ad0271a1fed/users/e61590e48dce40878eb9ed34fd9e746c/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:10.261719 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51868657-d1bb-4b12-9eaa-1bdff3aed180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b275546043ea4b3299c16ad0271a1fed, user_id=e61590e48dce40878eb9ed34fd9e746c, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:10.264883 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51868657-d1bb-4b12-9eaa-1bdff3aed180 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:10.299240 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1160/2336] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:29:10 2022] PUT /identity/v3/projects/b275546043ea4b3299c16ad0271a1fed/users/e61590e48dce40878eb9ed34fd9e746c/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:29:10.310032 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb3883-0b98-484f-b0ff-bd4da517db4f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:10.310796 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb3883-0b98-484f-b0ff-bd4da517db4f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:10.311183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb3883-0b98-484f-b0ff-bd4da517db4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:10.382369 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-ebeb3883-0b98-484f-b0ff-bd4da517db4f None None] MFA Rules not processed for user `e61590e48dce40878eb9ed34fd9e746c`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:29:10.383776 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ebeb3883-0b98-484f-b0ff-bd4da517db4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:10.451523 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:10.537922 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1177/2337] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:29:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:29:10.553248 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51868657-d1bb-4b12-9eaa-1bdff3aed180 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:10.557508 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-51868657-d1bb-4b12-9eaa-1bdff3aed180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:10.778694 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51868657-d1bb-4b12-9eaa-1bdff3aed180 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:10.793731 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c71c41-7dab-43c1-a91d-8697583e27be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:10.794443 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c71c41-7dab-43c1-a91d-8697583e27be service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:10.794730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c71c41-7dab-43c1-a91d-8697583e27be service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:10.795011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c71c41-7dab-43c1-a91d-8697583e27be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:10.820445 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c71c41-7dab-43c1-a91d-8697583e27be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:10.823725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c71c41-7dab-43c1-a91d-8697583e27be service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:10.857141 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1161/2338] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:29:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:29:10.883275 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb3883-0b98-484f-b0ff-bd4da517db4f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:11.034229 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb3883-0b98-484f-b0ff-bd4da517db4f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:11.045713 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9e6da-9a5e-47e4-894e-91a3777335f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:11.046970 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9e6da-9a5e-47e4-894e-91a3777335f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:11.047422 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9e6da-9a5e-47e4-894e-91a3777335f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:11.047857 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9e6da-9a5e-47e4-894e-91a3777335f7 admin admin] PATH_INFO: `/v3/users/e61590e48dce40878eb9ed34fd9e746c` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:11.049348 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9e6da-9a5e-47e4-894e-91a3777335f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e61590e48dce40878eb9ed34fd9e746c)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:11.052332 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9e6da-9a5e-47e4-894e-91a3777335f7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:11.152589 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d0a9e6da-9a5e-47e4-894e-91a3777335f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e61590e48dce40878eb9ed34fd9e746c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:11.153600 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d0a9e6da-9a5e-47e4-894e-91a3777335f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e61590e48dce40878eb9ed34fd9e746c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:11.181267 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d0a9e6da-9a5e-47e4-894e-91a3777335f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e61590e48dce40878eb9ed34fd9e746c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:11.203572 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d0a9e6da-9a5e-47e4-894e-91a3777335f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e61590e48dce40878eb9ed34fd9e746c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:11.204160 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d0a9e6da-9a5e-47e4-894e-91a3777335f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e61590e48dce40878eb9ed34fd9e746c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:11.228630 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1178/2339] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:29:10 2022] DELETE /identity/v3/users/e61590e48dce40878eb9ed34fd9e746c => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:29:11.233404 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafe006-ce9a-4d88-974a-acbda8c409f4 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:11.234418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafe006-ce9a-4d88-974a-acbda8c409f4 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:11.234709 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafe006-ce9a-4d88-974a-acbda8c409f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:11.326531 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-1cafe006-ce9a-4d88-974a-acbda8c409f4 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:29:11.330423 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-1cafe006-ce9a-4d88-974a-acbda8c409f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:11.419212 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c092f-66f8-42f7-bc1f-824cc2f159f7 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:11.419506 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c092f-66f8-42f7-bc1f-824cc2f159f7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:11.419794 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c092f-66f8-42f7-bc1f-824cc2f159f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:11.447399 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:11.490042 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-316c092f-66f8-42f7-bc1f-824cc2f159f7 None None] MFA Rules not processed for user `99c2c7023bc84ef99e2e8675e4c2372a`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:29:11.491378 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-316c092f-66f8-42f7-bc1f-824cc2f159f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:11.582551 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1162/2340] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:29:11.593219 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafe006-ce9a-4d88-974a-acbda8c409f4 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:11.597222 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-1cafe006-ce9a-4d88-974a-acbda8c409f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:11.605926 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:11.730568 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1179/2341] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:29:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:29:11.739721 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c092f-66f8-42f7-bc1f-824cc2f159f7 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:11.741831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-316c092f-66f8-42f7-bc1f-824cc2f159f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:11.764711 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafe006-ce9a-4d88-974a-acbda8c409f4 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:11.771723 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ac7e7-db9d-4cac-8a04-3b49f650c8d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:11.773572 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ac7e7-db9d-4cac-8a04-3b49f650c8d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:11.773882 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ac7e7-db9d-4cac-8a04-3b49f650c8d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:11.774308 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ac7e7-db9d-4cac-8a04-3b49f650c8d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:11.819045 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ac7e7-db9d-4cac-8a04-3b49f650c8d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:11.825846 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ac7e7-db9d-4cac-8a04-3b49f650c8d1 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:11.856208 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1163/2342] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:29:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:29:11.882688 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c092f-66f8-42f7-bc1f-824cc2f159f7 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:11.891677 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602879c6-6333-4d69-8fa3-82438c06130a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac83171b9284163a71cc729cef076f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:11.892396 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602879c6-6333-4d69-8fa3-82438c06130a service glance] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:11.893214 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602879c6-6333-4d69-8fa3-82438c06130a service glance] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:11.893561 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602879c6-6333-4d69-8fa3-82438c06130a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:11.903585 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-602879c6-6333-4d69-8fa3-82438c06130a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:12.069391 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602879c6-6333-4d69-8fa3-82438c06130a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:12.071367 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602879c6-6333-4d69-8fa3-82438c06130a service glance] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:12.096255 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1180/2343] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:29:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:29:12.339999 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b5e83-6180-488c-be7a-653488b0b1a9 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:12.340502 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b5e83-6180-488c-be7a-653488b0b1a9 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:12.340582 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b5e83-6180-488c-be7a-653488b0b1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:12.359498 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-8f1b5e83-6180-488c-be7a-653488b0b1a9 None None] MFA Rules not processed for user `3fa2ad34164a4631adf76fbd042679ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:29:12.360778 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-8f1b5e83-6180-488c-be7a-653488b0b1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:12.430328 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1164/2344] 10.222.0.32 () {58 vars in 1009 bytes} [Wed Jun 1 04:29:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:29:12.449362 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602879c6-6333-4d69-8fa3-82438c06130a service glance] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:12.451349 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-602879c6-6333-4d69-8fa3-82438c06130a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:12.471591 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602879c6-6333-4d69-8fa3-82438c06130a service glance] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:12.477764 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13161182-c80e-40ce-9c2c-e586e09dff12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:12.479150 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13161182-c80e-40ce-9c2c-e586e09dff12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:12.479495 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13161182-c80e-40ce-9c2c-e586e09dff12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:12.479714 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13161182-c80e-40ce-9c2c-e586e09dff12 admin admin] PATH_INFO: `/v3/projects/b275546043ea4b3299c16ad0271a1fed` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:12.481294 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b5e83-6180-488c-be7a-653488b0b1a9 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:12.482971 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13161182-c80e-40ce-9c2c-e586e09dff12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b275546043ea4b3299c16ad0271a1fed)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:12.483088 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-8f1b5e83-6180-488c-be7a-653488b0b1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:12.485031 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13161182-c80e-40ce-9c2c-e586e09dff12 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:12.538316 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-13161182-c80e-40ce-9c2c-e586e09dff12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b275546043ea4b3299c16ad0271a1fed', 'request_id': 'req-13161182-c80e-40ce-9c2c-e586e09dff12'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:12.544283 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-13161182-c80e-40ce-9c2c-e586e09dff12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b275546043ea4b3299c16ad0271a1fed', 'request_id': 'req-13161182-c80e-40ce-9c2c-e586e09dff12'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:12.553803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-13161182-c80e-40ce-9c2c-e586e09dff12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b275546043ea4b3299c16ad0271a1fed', 'request_id': 'req-13161182-c80e-40ce-9c2c-e586e09dff12'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:12.568508 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-13161182-c80e-40ce-9c2c-e586e09dff12 admin admin] The token cache is being invalidate because project b275546043ea4b3299c16ad0271a1fed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:29:12.568801 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-13161182-c80e-40ce-9c2c-e586e09dff12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:12.568933 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b5e83-6180-488c-be7a-653488b0b1a9 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:12.569471 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-13161182-c80e-40ce-9c2c-e586e09dff12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:12.571099 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1181/2345] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:29:12 2022] DELETE /identity/v3/projects/b275546043ea4b3299c16ad0271a1fed => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:29:12.576488 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c378dc2-9da0-4329-9a98-dbacb9361245 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:12.576863 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c378dc2-9da0-4329-9a98-dbacb9361245 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:12.577144 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c378dc2-9da0-4329-9a98-dbacb9361245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:12.583323 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:12.595648 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-4c378dc2-9da0-4329-9a98-dbacb9361245 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:29:12.596883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4c378dc2-9da0-4329-9a98-dbacb9361245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:12.603045 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:12.646604 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be0f98-4133-4cc1-bf10-884c1a7a4465 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413c6613b4ec4e53aeeaf6828c807273', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:12.647399 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be0f98-4133-4cc1-bf10-884c1a7a4465 service swift] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:12.647878 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be0f98-4133-4cc1-bf10-884c1a7a4465 service swift] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:12.648239 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be0f98-4133-4cc1-bf10-884c1a7a4465 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:12.650323 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c6be0f98-4133-4cc1-bf10-884c1a7a4465 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:12.678060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1182/2346] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:29:12.685813 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1069a7-ca9b-48f0-95d9-f0a0c9801846 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:12.686202 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1069a7-ca9b-48f0-95d9-f0a0c9801846 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:12.686484 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1069a7-ca9b-48f0-95d9-f0a0c9801846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:12.711919 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-3a1069a7-ca9b-48f0-95d9-f0a0c9801846 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:29:12.713142 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3a1069a7-ca9b-48f0-95d9-f0a0c9801846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:12.720581 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be0f98-4133-4cc1-bf10-884c1a7a4465 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:12.721673 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1183/2347] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:29:12.722226 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be0f98-4133-4cc1-bf10-884c1a7a4465 service swift] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:12.725958 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1069a7-ca9b-48f0-95d9-f0a0c9801846 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:12.732349 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1165/2348] 10.222.0.32 () {60 vars in 1384 bytes} [Wed Jun 1 04:29:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 01 04:29:12.738299 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1069a7-ca9b-48f0-95d9-f0a0c9801846 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:12.744423 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb375f-0a78-48a1-9d3a-f9d6dc133ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:12.745183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb375f-0a78-48a1-9d3a-f9d6dc133ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:12.745472 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb375f-0a78-48a1-9d3a-f9d6dc133ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:12.745745 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb375f-0a78-48a1-9d3a-f9d6dc133ac5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:12.746507 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb375f-0a78-48a1-9d3a-f9d6dc133ac5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:29:12.746949 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb375f-0a78-48a1-9d3a-f9d6dc133ac5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:12.748564 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb375f-0a78-48a1-9d3a-f9d6dc133ac5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:12.779150 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1184/2349] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:29:12.783567 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be0f98-4133-4cc1-bf10-884c1a7a4465 service swift] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:12.799478 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be0f98-4133-4cc1-bf10-884c1a7a4465 service swift] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:12.814965 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411114ad-1193-4ffd-9a75-1b7f0418ff87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:12.816535 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411114ad-1193-4ffd-9a75-1b7f0418ff87 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:12.816918 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411114ad-1193-4ffd-9a75-1b7f0418ff87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:12.817272 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411114ad-1193-4ffd-9a75-1b7f0418ff87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:12.818116 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411114ad-1193-4ffd-9a75-1b7f0418ff87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:12.820415 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411114ad-1193-4ffd-9a75-1b7f0418ff87 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:12.890505 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1166/2350] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:29:12 2022] POST /identity/v3/projects => generated 365 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:29:12.894299 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb375f-0a78-48a1-9d3a-f9d6dc133ac5 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:12.912962 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb375f-0a78-48a1-9d3a-f9d6dc133ac5 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:13.089299 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4775495-5cd9-4496-990c-270398405adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:13.090182 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4775495-5cd9-4496-990c-270398405adb admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:13.090472 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4775495-5cd9-4496-990c-270398405adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:13.090864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4775495-5cd9-4496-990c-270398405adb admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:13.095156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4775495-5cd9-4496-990c-270398405adb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:13.097093 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4775495-5cd9-4496-990c-270398405adb admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:13.215323 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1185/2351] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:29:12 2022] POST /identity/v3/users => generated 283 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:29:13.219551 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411114ad-1193-4ffd-9a75-1b7f0418ff87 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:13.234517 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411114ad-1193-4ffd-9a75-1b7f0418ff87 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:13.241148 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5a253-9dee-45bc-bd25-f3cfe0e323b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:13.242014 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5a253-9dee-45bc-bd25-f3cfe0e323b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:13.242404 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5a253-9dee-45bc-bd25-f3cfe0e323b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:13.242789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5a253-9dee-45bc-bd25-f3cfe0e323b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:13.244198 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5a253-9dee-45bc-bd25-f3cfe0e323b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:13.246015 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5a253-9dee-45bc-bd25-f3cfe0e323b5 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:13.258151 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1167/2352] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:29:13.262579 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4775495-5cd9-4496-990c-270398405adb admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:13.335641 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4775495-5cd9-4496-990c-270398405adb admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:13.344533 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6634f40-1f22-4998-a83d-cec03e5d184c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:13.350738 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6634f40-1f22-4998-a83d-cec03e5d184c admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:13.351126 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6634f40-1f22-4998-a83d-cec03e5d184c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:13.351545 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6634f40-1f22-4998-a83d-cec03e5d184c admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:13.352456 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6634f40-1f22-4998-a83d-cec03e5d184c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:13.354325 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6634f40-1f22-4998-a83d-cec03e5d184c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:13.391812 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1186/2353] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:29:13.394963 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5a253-9dee-45bc-bd25-f3cfe0e323b5 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:13.473506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5a253-9dee-45bc-bd25-f3cfe0e323b5 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:13.488952 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae9a45-5af5-4e34-bf4c-c248308075d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:13.491821 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae9a45-5af5-4e34-bf4c-c248308075d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:13.492119 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae9a45-5af5-4e34-bf4c-c248308075d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:13.492409 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae9a45-5af5-4e34-bf4c-c248308075d2 admin admin] PATH_INFO: `/v3/projects/2d34c88b4d9b438d94e7cd1f36430518/users/48b7342a53284202b07153e1e2e2fb3a/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:13.539076 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae9a45-5af5-4e34-bf4c-c248308075d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d34c88b4d9b438d94e7cd1f36430518, user_id=48b7342a53284202b07153e1e2e2fb3a, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:13.547413 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae9a45-5af5-4e34-bf4c-c248308075d2 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:13.592986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1168/2354] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:29:13 2022] PUT /identity/v3/projects/2d34c88b4d9b438d94e7cd1f36430518/users/48b7342a53284202b07153e1e2e2fb3a/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:29:13.605896 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a38b0-536b-45b8-b0ac-239c0afc7a5c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:13.606227 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a38b0-536b-45b8-b0ac-239c0afc7a5c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:13.606516 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a38b0-536b-45b8-b0ac-239c0afc7a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:13.660610 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e12a38b0-536b-45b8-b0ac-239c0afc7a5c None None] MFA Rules not processed for user `48b7342a53284202b07153e1e2e2fb3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:29:13.662033 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e12a38b0-536b-45b8-b0ac-239c0afc7a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:13.679248 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:13.769936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1187/2355] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:29:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:29:13.781220 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae9a45-5af5-4e34-bf4c-c248308075d2 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:13.784461 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-51ae9a45-5af5-4e34-bf4c-c248308075d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:13.874556 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:13.959230 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae9a45-5af5-4e34-bf4c-c248308075d2 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:13.980839 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c085a8-8465-4924-9aaf-152cd20e2199 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:13.981524 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c085a8-8465-4924-9aaf-152cd20e2199 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:13.981814 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c085a8-8465-4924-9aaf-152cd20e2199 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:13.982259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c085a8-8465-4924-9aaf-152cd20e2199 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:13.997882 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c085a8-8465-4924-9aaf-152cd20e2199 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:13.999576 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c085a8-8465-4924-9aaf-152cd20e2199 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:14.023169 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1169/2356] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:29:13 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:29:21.267762 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0549dd0-d181-4d39-a0c9-eed7816b41ad None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:21.269226 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0549dd0-d181-4d39-a0c9-eed7816b41ad None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:21.270109 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0549dd0-d181-4d39-a0c9-eed7816b41ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:21.299463 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a0549dd0-d181-4d39-a0c9-eed7816b41ad None None] MFA Rules not processed for user `3fa2ad34164a4631adf76fbd042679ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:29:21.301684 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a0549dd0-d181-4d39-a0c9-eed7816b41ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:21.400917 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1188/2357] 10.222.0.32 () {58 vars in 1009 bytes} [Wed Jun 1 04:29:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:29:21.454740 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c085a8-8465-4924-9aaf-152cd20e2199 service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:21.457627 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-69c085a8-8465-4924-9aaf-152cd20e2199 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:21.564492 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c085a8-8465-4924-9aaf-152cd20e2199 service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:21.573451 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a569d-4ed5-4d74-b5f3-00c415221dff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413c6613b4ec4e53aeeaf6828c807273', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:21.574177 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a569d-4ed5-4d74-b5f3-00c415221dff service swift] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:21.574457 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a569d-4ed5-4d74-b5f3-00c415221dff service swift] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:21.574781 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a569d-4ed5-4d74-b5f3-00c415221dff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:21.589248 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a569d-4ed5-4d74-b5f3-00c415221dff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:21.591012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a569d-4ed5-4d74-b5f3-00c415221dff service swift] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:21.604273 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1170/2358] 10.222.0.32 () {60 vars in 1384 bytes} [Wed Jun 1 04:29:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 01 04:29:23.033936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b595f-c6ac-4084-9a09-f675c772c406 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:23.034539 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b595f-c6ac-4084-9a09-f675c772c406 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:23.035157 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b595f-c6ac-4084-9a09-f675c772c406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:23.056885 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5ede8-db4f-4c1e-9433-0fc4a7a64292 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:23.058201 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5ede8-db4f-4c1e-9433-0fc4a7a64292 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:23.058664 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5ede8-db4f-4c1e-9433-0fc4a7a64292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:23.066294 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7f7b595f-c6ac-4084-9a09-f675c772c406 None None] MFA Rules not processed for user `4156a6ff075847769c0d35cfeb1b3af0`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:29:23.067544 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7f7b595f-c6ac-4084-9a09-f675c772c406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:23.085560 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-93b5ede8-db4f-4c1e-9433-0fc4a7a64292 None None] MFA Rules not processed for user `3fa2ad34164a4631adf76fbd042679ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:29:23.089108 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-93b5ede8-db4f-4c1e-9433-0fc4a7a64292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:23.104878 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1171/2359] 10.222.0.32 () {58 vars in 967 bytes} [Wed Jun 1 04:29:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:29:23.177659 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5ede8-db4f-4c1e-9433-0fc4a7a64292 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:23.182485 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1189/2360] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:29:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:29:23.203494 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5ede8-db4f-4c1e-9433-0fc4a7a64292 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:23.217907 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a11bfc-158b-4e46-90dc-5949064a3968 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413c6613b4ec4e53aeeaf6828c807273', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:23.218790 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a11bfc-158b-4e46-90dc-5949064a3968 service swift] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:23.219130 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a11bfc-158b-4e46-90dc-5949064a3968 service swift] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:23.219405 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a11bfc-158b-4e46-90dc-5949064a3968 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:23.237795 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a11bfc-158b-4e46-90dc-5949064a3968 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:23.242203 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a11bfc-158b-4e46-90dc-5949064a3968 service swift] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:23.262704 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1172/2361] 10.222.0.32 () {60 vars in 1384 bytes} [Wed Jun 1 04:29:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 01 04:29:23.512305 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b595f-c6ac-4084-9a09-f675c772c406 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:23.533506 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7f7b595f-c6ac-4084-9a09-f675c772c406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:23.975524 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:24.033906 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89dc43a-0ca6-46e2-99ac-5ae3735be47d None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:24.034838 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89dc43a-0ca6-46e2-99ac-5ae3735be47d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:24.035600 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89dc43a-0ca6-46e2-99ac-5ae3735be47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:24.061337 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b595f-c6ac-4084-9a09-f675c772c406 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:24.096384 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ee531-2d89-4bef-9ac0-a2ce8a5b9042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:24.097714 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ee531-2d89-4bef-9ac0-a2ce8a5b9042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:24.099476 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ee531-2d89-4bef-9ac0-a2ce8a5b9042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:24.100608 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ee531-2d89-4bef-9ac0-a2ce8a5b9042 admin admin] PATH_INFO: `/v3/users/ed4c15f74a0b4109b21fbafb3755c2ba` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:24.104679 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ee531-2d89-4bef-9ac0-a2ce8a5b9042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed4c15f74a0b4109b21fbafb3755c2ba)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:24.108047 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ee531-2d89-4bef-9ac0-a2ce8a5b9042 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:24.119851 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-c89dc43a-0ca6-46e2-99ac-5ae3735be47d None None] MFA Rules not processed for user `3fa2ad34164a4631adf76fbd042679ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:29:24.123618 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c89dc43a-0ca6-46e2-99ac-5ae3735be47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:24.167820 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1173/2362] 10.222.0.32 () {58 vars in 1009 bytes} [Wed Jun 1 04:29:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:29:24.185757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89dc43a-0ca6-46e2-99ac-5ae3735be47d None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:24.208848 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89dc43a-0ca6-46e2-99ac-5ae3735be47d None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:24.219790 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89928bdd-9501-479a-aa3a-3a4bbced4ec1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413c6613b4ec4e53aeeaf6828c807273', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:24.221473 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89928bdd-9501-479a-aa3a-3a4bbced4ec1 service swift] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:24.222756 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89928bdd-9501-479a-aa3a-3a4bbced4ec1 service swift] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:24.224934 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89928bdd-9501-479a-aa3a-3a4bbced4ec1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:24.277300 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89928bdd-9501-479a-aa3a-3a4bbced4ec1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:24.287823 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89928bdd-9501-479a-aa3a-3a4bbced4ec1 service swift] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:24.319898 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-253ee531-2d89-4bef-9ac0-a2ce8a5b9042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed4c15f74a0b4109b21fbafb3755c2ba'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:24.321554 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-253ee531-2d89-4bef-9ac0-a2ce8a5b9042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed4c15f74a0b4109b21fbafb3755c2ba'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:24.345582 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1174/2363] 10.222.0.32 () {60 vars in 1384 bytes} [Wed Jun 1 04:29:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 01 04:29:24.378557 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-253ee531-2d89-4bef-9ac0-a2ce8a5b9042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed4c15f74a0b4109b21fbafb3755c2ba'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:24.402087 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-253ee531-2d89-4bef-9ac0-a2ce8a5b9042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed4c15f74a0b4109b21fbafb3755c2ba'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:24.403223 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-253ee531-2d89-4bef-9ac0-a2ce8a5b9042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed4c15f74a0b4109b21fbafb3755c2ba'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:24.439033 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1190/2364] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:29:23 2022] DELETE /identity/v3/users/ed4c15f74a0b4109b21fbafb3755c2ba => generated 0 bytes in 928 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:29:24.445307 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6a1cb-c719-42e0-b1d6-a588bc127312 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:24.445471 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6a1cb-c719-42e0-b1d6-a588bc127312 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:24.446647 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6a1cb-c719-42e0-b1d6-a588bc127312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:24.559349 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-e0d6a1cb-c719-42e0-b1d6-a588bc127312 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:29:24.561712 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e0d6a1cb-c719-42e0-b1d6-a588bc127312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:24.814286 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1175/2365] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:29:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:29:24.884755 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ee531-2d89-4bef-9ac0-a2ce8a5b9042 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:24.888105 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-253ee531-2d89-4bef-9ac0-a2ce8a5b9042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:25.273860 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ee531-2d89-4bef-9ac0-a2ce8a5b9042 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:25.282459 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d33890-b5fc-40f7-aba2-aace305cb582 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:25.284732 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d33890-b5fc-40f7-aba2-aace305cb582 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:25.285868 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d33890-b5fc-40f7-aba2-aace305cb582 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:25.286711 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d33890-b5fc-40f7-aba2-aace305cb582 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:25.327941 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d33890-b5fc-40f7-aba2-aace305cb582 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:25.340877 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d33890-b5fc-40f7-aba2-aace305cb582 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:25.410522 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1191/2366] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:29:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:29:25.537711 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257b290-5555-4ccd-adb0-cb0a664adb66 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:25.538613 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257b290-5555-4ccd-adb0-cb0a664adb66 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:25.539009 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257b290-5555-4ccd-adb0-cb0a664adb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:25.552161 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:25.580802 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-6257b290-5555-4ccd-adb0-cb0a664adb66 None None] MFA Rules not processed for user `3fa2ad34164a4631adf76fbd042679ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:29:25.583576 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6257b290-5555-4ccd-adb0-cb0a664adb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:25.806698 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1176/2367] 10.222.0.32 () {58 vars in 967 bytes} [Wed Jun 1 04:29:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:29:25.829673 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d33890-b5fc-40f7-aba2-aace305cb582 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:25.835578 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-40d33890-b5fc-40f7-aba2-aace305cb582 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:26.237805 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:26.312679 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d33890-b5fc-40f7-aba2-aace305cb582 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:26.347588 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15d7da-4a84-43ca-b9b0-f187482eae4f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413c6613b4ec4e53aeeaf6828c807273', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:26.351412 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15d7da-4a84-43ca-b9b0-f187482eae4f service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:26.352220 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15d7da-4a84-43ca-b9b0-f187482eae4f service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:26.354545 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15d7da-4a84-43ca-b9b0-f187482eae4f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:26.418683 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15d7da-4a84-43ca-b9b0-f187482eae4f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:26.427041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15d7da-4a84-43ca-b9b0-f187482eae4f service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:26.465407 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1192/2368] 10.222.0.32 () {60 vars in 1384 bytes} [Wed Jun 1 04:29:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 01 04:29:26.649415 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257b290-5555-4ccd-adb0-cb0a664adb66 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:26.652629 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6257b290-5555-4ccd-adb0-cb0a664adb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:26.687475 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257b290-5555-4ccd-adb0-cb0a664adb66 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:26.722339 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541f740-b9ce-4fbc-867c-9897ccdb8cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:26.725958 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541f740-b9ce-4fbc-867c-9897ccdb8cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:26.726431 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541f740-b9ce-4fbc-867c-9897ccdb8cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:26.727425 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541f740-b9ce-4fbc-867c-9897ccdb8cec admin admin] PATH_INFO: `/v3/projects/bc4681897f6a4a908adb45c1dbe9247e` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:26.736607 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e541f740-b9ce-4fbc-867c-9897ccdb8cec admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc4681897f6a4a908adb45c1dbe9247e)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:26.744370 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e541f740-b9ce-4fbc-867c-9897ccdb8cec admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:26.892695 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-e541f740-b9ce-4fbc-867c-9897ccdb8cec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc4681897f6a4a908adb45c1dbe9247e', 'request_id': 'req-e541f740-b9ce-4fbc-867c-9897ccdb8cec'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:26.930166 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-e541f740-b9ce-4fbc-867c-9897ccdb8cec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc4681897f6a4a908adb45c1dbe9247e', 'request_id': 'req-e541f740-b9ce-4fbc-867c-9897ccdb8cec'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:26.941230 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-e541f740-b9ce-4fbc-867c-9897ccdb8cec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc4681897f6a4a908adb45c1dbe9247e', 'request_id': 'req-e541f740-b9ce-4fbc-867c-9897ccdb8cec'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:27.029391 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-e541f740-b9ce-4fbc-867c-9897ccdb8cec admin admin] The token cache is being invalidate because project bc4681897f6a4a908adb45c1dbe9247e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:29:27.030789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-e541f740-b9ce-4fbc-867c-9897ccdb8cec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:27.041531 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-e541f740-b9ce-4fbc-867c-9897ccdb8cec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:27.048534 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1177/2369] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:29:26 2022] DELETE /identity/v3/projects/bc4681897f6a4a908adb45c1dbe9247e => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:29:27.057159 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1ea87-9f83-48e3-994d-9f2bcb74174d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:27.058261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1ea87-9f83-48e3-994d-9f2bcb74174d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:27.059780 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1ea87-9f83-48e3-994d-9f2bcb74174d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:27.239933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-f0a1ea87-9f83-48e3-994d-9f2bcb74174d None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:29:27.241468 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f0a1ea87-9f83-48e3-994d-9f2bcb74174d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:27.332575 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1193/2370] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:29:27.348007 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e05c6-241a-4c11-99b6-57f98acb9b76 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:27.349458 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e05c6-241a-4c11-99b6-57f98acb9b76 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:27.350513 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e05c6-241a-4c11-99b6-57f98acb9b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:27.413470 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-3c9e05c6-241a-4c11-99b6-57f98acb9b76 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:29:27.425211 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3c9e05c6-241a-4c11-99b6-57f98acb9b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:27.452268 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1178/2371] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:29:27.458952 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1ea87-9f83-48e3-994d-9f2bcb74174d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:27.489828 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1ea87-9f83-48e3-994d-9f2bcb74174d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:27.518091 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41cff15-b543-452a-ada9-7bbdd5303328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:27.519814 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cff15-b543-452a-ada9-7bbdd5303328 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:27.520597 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cff15-b543-452a-ada9-7bbdd5303328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:27.521339 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cff15-b543-452a-ada9-7bbdd5303328 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:27.524786 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41cff15-b543-452a-ada9-7bbdd5303328 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:29:27.527020 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41cff15-b543-452a-ada9-7bbdd5303328 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:27.535432 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41cff15-b543-452a-ada9-7bbdd5303328 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:27.603545 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1194/2372] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:29:27.605309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e05c6-241a-4c11-99b6-57f98acb9b76 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:27.621863 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e05c6-241a-4c11-99b6-57f98acb9b76 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:27.631460 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c342ec1-537f-4be1-b82b-99e1c7b153c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:27.634312 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c342ec1-537f-4be1-b82b-99e1c7b153c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:27.635722 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c342ec1-537f-4be1-b82b-99e1c7b153c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:27.637436 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c342ec1-537f-4be1-b82b-99e1c7b153c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:27.638982 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c342ec1-537f-4be1-b82b-99e1c7b153c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:27.643540 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c342ec1-537f-4be1-b82b-99e1c7b153c8 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:27.762178 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1179/2373] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:29:27 2022] POST /identity/v3/projects => generated 371 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:29:27.767618 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41cff15-b543-452a-ada9-7bbdd5303328 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:27.781587 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41cff15-b543-452a-ada9-7bbdd5303328 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:27.870788 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569522ba-af3c-463a-bfa6-c2b31928f0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:27.871521 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569522ba-af3c-463a-bfa6-c2b31928f0b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:27.872261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569522ba-af3c-463a-bfa6-c2b31928f0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:27.872658 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569522ba-af3c-463a-bfa6-c2b31928f0b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:27.873261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569522ba-af3c-463a-bfa6-c2b31928f0b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:27.875285 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569522ba-af3c-463a-bfa6-c2b31928f0b9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:27.937803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1195/2374] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:29:27 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:29:27.943862 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c342ec1-537f-4be1-b82b-99e1c7b153c8 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:27.965352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c342ec1-537f-4be1-b82b-99e1c7b153c8 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:27.980293 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad4efc-d7ac-4f8c-bce7-cfb6a281f09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:27.983743 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad4efc-d7ac-4f8c-bce7-cfb6a281f09b admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:27.984623 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad4efc-d7ac-4f8c-bce7-cfb6a281f09b admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:27.986279 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad4efc-d7ac-4f8c-bce7-cfb6a281f09b admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:27.988225 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad4efc-d7ac-4f8c-bce7-cfb6a281f09b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:27.992105 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad4efc-d7ac-4f8c-bce7-cfb6a281f09b admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:28.053330 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569522ba-af3c-463a-bfa6-c2b31928f0b9 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:28.053769 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1180/2375] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 04:29:28.068483 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569522ba-af3c-463a-bfa6-c2b31928f0b9 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:28.076082 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f0c7e-9921-443c-80af-d0fa4f311e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:28.077200 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f0c7e-9921-443c-80af-d0fa4f311e99 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:28.077964 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f0c7e-9921-443c-80af-d0fa4f311e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:28.078496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f0c7e-9921-443c-80af-d0fa4f311e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:28.079660 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f0c7e-9921-443c-80af-d0fa4f311e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:28.082505 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f0c7e-9921-443c-80af-d0fa4f311e99 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:28.119293 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1196/2376] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 04:29:28.128326 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad4efc-d7ac-4f8c-bce7-cfb6a281f09b admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:28.155481 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad4efc-d7ac-4f8c-bce7-cfb6a281f09b admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:28.167084 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39ce99-788f-45cf-beb5-dc0e1961d83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:28.168959 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39ce99-788f-45cf-beb5-dc0e1961d83a admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:28.169754 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39ce99-788f-45cf-beb5-dc0e1961d83a admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:28.170302 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39ce99-788f-45cf-beb5-dc0e1961d83a admin admin] PATH_INFO: `/v3/projects/30e2fc5d225a453c8485fa20c3dcf3a3/users/a982a01f603547a6ad8b4dd7a01a2bc0/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:28.209065 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39ce99-788f-45cf-beb5-dc0e1961d83a admin admin] RBAC: Authorizing `identity:create_grant(project_id=30e2fc5d225a453c8485fa20c3dcf3a3, user_id=a982a01f603547a6ad8b4dd7a01a2bc0, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:28.233962 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39ce99-788f-45cf-beb5-dc0e1961d83a admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:28.288891 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1181/2377] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:29:28 2022] PUT /identity/v3/projects/30e2fc5d225a453c8485fa20c3dcf3a3/users/a982a01f603547a6ad8b4dd7a01a2bc0/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:29:28.312900 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984b703-4429-4cc0-82b6-5541bfe1ebec None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:28.313240 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984b703-4429-4cc0-82b6-5541bfe1ebec None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:28.313471 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984b703-4429-4cc0-82b6-5541bfe1ebec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:28.379787 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-8984b703-4429-4cc0-82b6-5541bfe1ebec None None] MFA Rules not processed for user `a982a01f603547a6ad8b4dd7a01a2bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:29:28.383978 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8984b703-4429-4cc0-82b6-5541bfe1ebec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:28.451809 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:28.575445 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1197/2378] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:29:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:29:28.583912 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39ce99-788f-45cf-beb5-dc0e1961d83a admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:28.585720 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-df39ce99-788f-45cf-beb5-dc0e1961d83a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:28.687736 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:28.768165 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39ce99-788f-45cf-beb5-dc0e1961d83a admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:28.778129 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23adcc-bbb5-470a-b5f1-d5c4240daac5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:28.780268 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23adcc-bbb5-470a-b5f1-d5c4240daac5 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:28.781233 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23adcc-bbb5-470a-b5f1-d5c4240daac5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:28.781934 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23adcc-bbb5-470a-b5f1-d5c4240daac5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:28.806226 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23adcc-bbb5-470a-b5f1-d5c4240daac5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:28.811684 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23adcc-bbb5-470a-b5f1-d5c4240daac5 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:28.835286 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1182/2379] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:29:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:29:28.879535 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984b703-4429-4cc0-82b6-5541bfe1ebec None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:29.135170 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984b703-4429-4cc0-82b6-5541bfe1ebec None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:29.154369 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c902b-10b0-472d-8223-72e4d7a31231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:29.156347 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c902b-10b0-472d-8223-72e4d7a31231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:29.157189 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c902b-10b0-472d-8223-72e4d7a31231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:29.158162 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c902b-10b0-472d-8223-72e4d7a31231 admin admin] PATH_INFO: `/v3/users/a982a01f603547a6ad8b4dd7a01a2bc0` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:29.162829 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c902b-10b0-472d-8223-72e4d7a31231 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a982a01f603547a6ad8b4dd7a01a2bc0)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:29.172817 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c902b-10b0-472d-8223-72e4d7a31231 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:29.343075 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c29c902b-10b0-472d-8223-72e4d7a31231 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a982a01f603547a6ad8b4dd7a01a2bc0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:29.350318 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c29c902b-10b0-472d-8223-72e4d7a31231 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a982a01f603547a6ad8b4dd7a01a2bc0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:29.427842 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c29c902b-10b0-472d-8223-72e4d7a31231 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a982a01f603547a6ad8b4dd7a01a2bc0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:29.467006 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c29c902b-10b0-472d-8223-72e4d7a31231 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a982a01f603547a6ad8b4dd7a01a2bc0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:29.468826 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c29c902b-10b0-472d-8223-72e4d7a31231 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a982a01f603547a6ad8b4dd7a01a2bc0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:29.510444 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1198/2380] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:29:28 2022] DELETE /identity/v3/users/a982a01f603547a6ad8b4dd7a01a2bc0 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:29:29.515695 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6f990-7396-4093-83ea-c0445c00f49d None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:29.516526 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6f990-7396-4093-83ea-c0445c00f49d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:29.517295 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6f990-7396-4093-83ea-c0445c00f49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:29.593997 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-67f6f990-7396-4093-83ea-c0445c00f49d None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:29:29.596926 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-67f6f990-7396-4093-83ea-c0445c00f49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:29.807500 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1183/2381] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:29:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:29:29.821805 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c902b-10b0-472d-8223-72e4d7a31231 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:29.824493 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c29c902b-10b0-472d-8223-72e4d7a31231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:29.917490 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:29.985883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c902b-10b0-472d-8223-72e4d7a31231 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:29.994727 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f72156-7547-49d5-99d3-c6bc66ec545b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:29.995637 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f72156-7547-49d5-99d3-c6bc66ec545b service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:29.996073 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f72156-7547-49d5-99d3-c6bc66ec545b service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:29.996451 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f72156-7547-49d5-99d3-c6bc66ec545b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:30.009912 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f72156-7547-49d5-99d3-c6bc66ec545b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:30.011662 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f72156-7547-49d5-99d3-c6bc66ec545b service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:30.032120 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1199/2382] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:29:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:29:30.696412 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6f990-7396-4093-83ea-c0445c00f49d None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:30.698373 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-67f6f990-7396-4093-83ea-c0445c00f49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:30.725304 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6f990-7396-4093-83ea-c0445c00f49d None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:30.738367 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ac2d8-1c08-4cfe-8dd8-d87985a2b6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:30.739567 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ac2d8-1c08-4cfe-8dd8-d87985a2b6e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:30.739855 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ac2d8-1c08-4cfe-8dd8-d87985a2b6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:30.740137 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ac2d8-1c08-4cfe-8dd8-d87985a2b6e8 admin admin] PATH_INFO: `/v3/users/b07eb0402cc04ae08773853f87a58663` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:30.741704 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ac2d8-1c08-4cfe-8dd8-d87985a2b6e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b07eb0402cc04ae08773853f87a58663)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:30.743827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ac2d8-1c08-4cfe-8dd8-d87985a2b6e8 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:30.783470 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f72156-7547-49d5-99d3-c6bc66ec545b service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:30.785019 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f6f72156-7547-49d5-99d3-c6bc66ec545b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:30.826919 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f72156-7547-49d5-99d3-c6bc66ec545b service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:30.840581 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584015c7-ae0a-4e30-b68f-d1726c0a6b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:30.842305 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584015c7-ae0a-4e30-b68f-d1726c0a6b87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:30.842896 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584015c7-ae0a-4e30-b68f-d1726c0a6b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:30.843811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584015c7-ae0a-4e30-b68f-d1726c0a6b87 admin admin] PATH_INFO: `/v3/projects/30e2fc5d225a453c8485fa20c3dcf3a3` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:30.845743 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584015c7-ae0a-4e30-b68f-d1726c0a6b87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30e2fc5d225a453c8485fa20c3dcf3a3)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:30.851035 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584015c7-ae0a-4e30-b68f-d1726c0a6b87 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:30.853846 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4f8ac2d8-1c08-4cfe-8dd8-d87985a2b6e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b07eb0402cc04ae08773853f87a58663'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:30.856923 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4f8ac2d8-1c08-4cfe-8dd8-d87985a2b6e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b07eb0402cc04ae08773853f87a58663'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:30.894751 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4f8ac2d8-1c08-4cfe-8dd8-d87985a2b6e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b07eb0402cc04ae08773853f87a58663'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:30.921712 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4f8ac2d8-1c08-4cfe-8dd8-d87985a2b6e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b07eb0402cc04ae08773853f87a58663'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:30.950108 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4f8ac2d8-1c08-4cfe-8dd8-d87985a2b6e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b07eb0402cc04ae08773853f87a58663'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:30.983606 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1184/2383] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:29:30 2022] DELETE /identity/v3/users/b07eb0402cc04ae08773853f87a58663 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:29:30.991633 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab6866-409a-46ad-b7bf-889eb59fe995 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:30.991995 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab6866-409a-46ad-b7bf-889eb59fe995 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:30.992913 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab6866-409a-46ad-b7bf-889eb59fe995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:31.020114 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-b7ab6866-409a-46ad-b7bf-889eb59fe995 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:29:31.021563 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-b7ab6866-409a-46ad-b7bf-889eb59fe995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:31.035562 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-584015c7-ae0a-4e30-b68f-d1726c0a6b87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30e2fc5d225a453c8485fa20c3dcf3a3', 'request_id': 'req-584015c7-ae0a-4e30-b68f-d1726c0a6b87'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:31.052815 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-584015c7-ae0a-4e30-b68f-d1726c0a6b87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30e2fc5d225a453c8485fa20c3dcf3a3', 'request_id': 'req-584015c7-ae0a-4e30-b68f-d1726c0a6b87'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:31.073600 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-584015c7-ae0a-4e30-b68f-d1726c0a6b87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30e2fc5d225a453c8485fa20c3dcf3a3', 'request_id': 'req-584015c7-ae0a-4e30-b68f-d1726c0a6b87'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:31.099638 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-584015c7-ae0a-4e30-b68f-d1726c0a6b87 admin admin] The token cache is being invalidate because project 30e2fc5d225a453c8485fa20c3dcf3a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:29:31.099946 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-584015c7-ae0a-4e30-b68f-d1726c0a6b87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:31.103477 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-584015c7-ae0a-4e30-b68f-d1726c0a6b87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:31.130563 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1200/2384] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:29:30 2022] DELETE /identity/v3/projects/30e2fc5d225a453c8485fa20c3dcf3a3 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:29:31.210628 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:31.347489 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1185/2385] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:29:31.361051 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584015c7-ae0a-4e30-b68f-d1726c0a6b87 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:31.362893 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-584015c7-ae0a-4e30-b68f-d1726c0a6b87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:31.509648 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584015c7-ae0a-4e30-b68f-d1726c0a6b87 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:31.697214 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ac9ea-f93f-47b6-90d0-60462ebfcc4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:31.700769 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ac9ea-f93f-47b6-90d0-60462ebfcc4b service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:31.702870 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ac9ea-f93f-47b6-90d0-60462ebfcc4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:31.703733 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ac9ea-f93f-47b6-90d0-60462ebfcc4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:31.731746 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790ac9ea-f93f-47b6-90d0-60462ebfcc4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:31.734878 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790ac9ea-f93f-47b6-90d0-60462ebfcc4b service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:31.760444 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1201/2386] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:29:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:29:31.831909 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7380d5-4a14-4441-9f2a-168c12372ee0 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:31.832311 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7380d5-4a14-4441-9f2a-168c12372ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:31.832766 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7380d5-4a14-4441-9f2a-168c12372ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:31.878750 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-5a7380d5-4a14-4441-9f2a-168c12372ee0 None None] MFA Rules not processed for user `06ee2c50e9034cfcb7d4b543a122b3c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:29:31.881839 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-5a7380d5-4a14-4441-9f2a-168c12372ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:32.088430 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1186/2387] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:29:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:29:32.203801 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ac9ea-f93f-47b6-90d0-60462ebfcc4b service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:32.206435 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-790ac9ea-f93f-47b6-90d0-60462ebfcc4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:32.244609 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ac9ea-f93f-47b6-90d0-60462ebfcc4b service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:32.257352 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a7aea-0623-4dc8-8296-6caf4385fb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:32.260002 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a7aea-0623-4dc8-8296-6caf4385fb7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:32.260722 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a7aea-0623-4dc8-8296-6caf4385fb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:32.261225 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a7aea-0623-4dc8-8296-6caf4385fb7c admin admin] PATH_INFO: `/v3/projects/d307b6a5f3034a2d809e03c31ea2a723` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:32.263215 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a7aea-0623-4dc8-8296-6caf4385fb7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d307b6a5f3034a2d809e03c31ea2a723)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:32.265752 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a7aea-0623-4dc8-8296-6caf4385fb7c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:32.291645 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:32.392689 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1d7a7aea-0623-4dc8-8296-6caf4385fb7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd307b6a5f3034a2d809e03c31ea2a723', 'request_id': 'req-1d7a7aea-0623-4dc8-8296-6caf4385fb7c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:32.416112 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1d7a7aea-0623-4dc8-8296-6caf4385fb7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd307b6a5f3034a2d809e03c31ea2a723', 'request_id': 'req-1d7a7aea-0623-4dc8-8296-6caf4385fb7c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:32.431007 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1d7a7aea-0623-4dc8-8296-6caf4385fb7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd307b6a5f3034a2d809e03c31ea2a723', 'request_id': 'req-1d7a7aea-0623-4dc8-8296-6caf4385fb7c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:32.452157 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1d7a7aea-0623-4dc8-8296-6caf4385fb7c admin admin] The token cache is being invalidate because project d307b6a5f3034a2d809e03c31ea2a723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:29:32.452473 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1d7a7aea-0623-4dc8-8296-6caf4385fb7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:32.454460 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1d7a7aea-0623-4dc8-8296-6caf4385fb7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:32.458732 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1202/2388] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:29:32 2022] DELETE /identity/v3/projects/d307b6a5f3034a2d809e03c31ea2a723 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:29:32.468422 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa13c64-e487-44ef-9e5c-667e8f656828 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:32.469003 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa13c64-e487-44ef-9e5c-667e8f656828 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:32.469510 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa13c64-e487-44ef-9e5c-667e8f656828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:32.530770 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-faa13c64-e487-44ef-9e5c-667e8f656828 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:29:32.533530 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-faa13c64-e487-44ef-9e5c-667e8f656828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:32.662796 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1187/2389] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:29:32.675912 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92053aa-add7-4425-9e25-a8ed72f60286 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:32.676226 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92053aa-add7-4425-9e25-a8ed72f60286 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:32.676740 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92053aa-add7-4425-9e25-a8ed72f60286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:32.707852 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d92053aa-add7-4425-9e25-a8ed72f60286 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:29:32.709126 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d92053aa-add7-4425-9e25-a8ed72f60286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:32.722024 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1203/2390] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:29:32.800093 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa13c64-e487-44ef-9e5c-667e8f656828 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:32.817834 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa13c64-e487-44ef-9e5c-667e8f656828 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:32.831883 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d28836-fd3c-47e7-a1dc-a2a37621bb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:32.833692 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d28836-fd3c-47e7-a1dc-a2a37621bb92 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:32.834226 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d28836-fd3c-47e7-a1dc-a2a37621bb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:32.834682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d28836-fd3c-47e7-a1dc-a2a37621bb92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:32.835672 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d28836-fd3c-47e7-a1dc-a2a37621bb92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:29:32.836720 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d28836-fd3c-47e7-a1dc-a2a37621bb92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:32.838550 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d28836-fd3c-47e7-a1dc-a2a37621bb92 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:32.870516 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1188/2391] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:29:32.877208 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92053aa-add7-4425-9e25-a8ed72f60286 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:32.895146 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92053aa-add7-4425-9e25-a8ed72f60286 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:32.900807 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605662ea-5383-43bc-a27e-86fa83557bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:32.901517 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605662ea-5383-43bc-a27e-86fa83557bbf admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:32.901802 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605662ea-5383-43bc-a27e-86fa83557bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:32.902112 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605662ea-5383-43bc-a27e-86fa83557bbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:32.902900 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605662ea-5383-43bc-a27e-86fa83557bbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:32.904907 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605662ea-5383-43bc-a27e-86fa83557bbf admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:32.937272 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1204/2392] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:29:32 2022] POST /identity/v3/projects => generated 391 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:29:32.944157 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d28836-fd3c-47e7-a1dc-a2a37621bb92 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:32.958286 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d28836-fd3c-47e7-a1dc-a2a37621bb92 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:33.050846 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc74d8e-4740-43e1-ae7c-78e6357139ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:33.052034 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc74d8e-4740-43e1-ae7c-78e6357139ec admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:33.052535 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc74d8e-4740-43e1-ae7c-78e6357139ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:33.053033 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc74d8e-4740-43e1-ae7c-78e6357139ec admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:33.054360 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc74d8e-4740-43e1-ae7c-78e6357139ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:33.058926 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc74d8e-4740-43e1-ae7c-78e6357139ec admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:33.082300 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:33.098876 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1189/2393] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:29:32 2022] POST /identity/v3/users => generated 296 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:29:33.100087 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605662ea-5383-43bc-a27e-86fa83557bbf admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:33.114058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605662ea-5383-43bc-a27e-86fa83557bbf admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:33.121757 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bac759-576e-45f6-8fc0-f76e10678eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:33.122689 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bac759-576e-45f6-8fc0-f76e10678eaa admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:33.123110 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bac759-576e-45f6-8fc0-f76e10678eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:33.123479 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bac759-576e-45f6-8fc0-f76e10678eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:33.124563 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bac759-576e-45f6-8fc0-f76e10678eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:33.126760 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bac759-576e-45f6-8fc0-f76e10678eaa admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:33.149376 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1205/2394] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:29:33.158642 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc74d8e-4740-43e1-ae7c-78e6357139ec admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:33.175166 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc74d8e-4740-43e1-ae7c-78e6357139ec admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:33.182038 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542527e-c542-4f2f-98e4-56cc71666326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:33.182927 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542527e-c542-4f2f-98e4-56cc71666326 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:33.183253 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542527e-c542-4f2f-98e4-56cc71666326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:33.183754 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542527e-c542-4f2f-98e4-56cc71666326 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:33.184725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b542527e-c542-4f2f-98e4-56cc71666326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:33.186568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b542527e-c542-4f2f-98e4-56cc71666326 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:33.200396 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1190/2395] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:29:33.205511 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bac759-576e-45f6-8fc0-f76e10678eaa admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:33.223191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bac759-576e-45f6-8fc0-f76e10678eaa admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:33.232217 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f8544-a1d3-4a04-8ab8-76e82a0e3d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:33.233634 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f8544-a1d3-4a04-8ab8-76e82a0e3d98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:33.234099 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f8544-a1d3-4a04-8ab8-76e82a0e3d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:33.234563 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f8544-a1d3-4a04-8ab8-76e82a0e3d98 admin admin] PATH_INFO: `/v3/projects/8f26678ee7064e75a508b3b593b9849a/users/084689cab4e041beb55f7cbc3901f2c0/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:33.258515 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f8544-a1d3-4a04-8ab8-76e82a0e3d98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f26678ee7064e75a508b3b593b9849a, user_id=084689cab4e041beb55f7cbc3901f2c0, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:33.262791 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f8544-a1d3-4a04-8ab8-76e82a0e3d98 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:33.292894 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1206/2396] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:29:33 2022] PUT /identity/v3/projects/8f26678ee7064e75a508b3b593b9849a/users/084689cab4e041beb55f7cbc3901f2c0/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:29:33.311761 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3de78-8fe7-47aa-aecb-489b38c1242a None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:33.312246 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3de78-8fe7-47aa-aecb-489b38c1242a None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:33.312836 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3de78-8fe7-47aa-aecb-489b38c1242a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:33.358516 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-d5e3de78-8fe7-47aa-aecb-489b38c1242a None None] MFA Rules not processed for user `084689cab4e041beb55f7cbc3901f2c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:29:33.360927 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d5e3de78-8fe7-47aa-aecb-489b38c1242a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:33.493732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1191/2397] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:29:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:29:33.509446 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f8544-a1d3-4a04-8ab8-76e82a0e3d98 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:33.512088 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ab0f8544-a1d3-4a04-8ab8-76e82a0e3d98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:33.600106 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f8544-a1d3-4a04-8ab8-76e82a0e3d98 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:33.605138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6f42c-fcef-4195-9d1e-3a42785dc705 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:33.605815 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6f42c-fcef-4195-9d1e-3a42785dc705 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:33.606137 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6f42c-fcef-4195-9d1e-3a42785dc705 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:33.606415 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6f42c-fcef-4195-9d1e-3a42785dc705 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:33.619769 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6f42c-fcef-4195-9d1e-3a42785dc705 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:33.621490 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6f42c-fcef-4195-9d1e-3a42785dc705 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:33.637598 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1207/2398] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:29:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:29:35.277384 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419e796-769e-4d29-b5a3-9307f2998f99 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:35.278115 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419e796-769e-4d29-b5a3-9307f2998f99 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:35.278338 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419e796-769e-4d29-b5a3-9307f2998f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:35.361601 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-3419e796-769e-4d29-b5a3-9307f2998f99 None None] MFA Rules not processed for user `3fa2ad34164a4631adf76fbd042679ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:29:35.363481 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3419e796-769e-4d29-b5a3-9307f2998f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:35.534540 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1192/2399] 10.222.0.32 () {58 vars in 1009 bytes} [Wed Jun 1 04:29:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:29:35.554735 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6f42c-fcef-4195-9d1e-3a42785dc705 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:35.564074 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2bd6f42c-fcef-4195-9d1e-3a42785dc705 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:35.779459 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:35.860286 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6f42c-fcef-4195-9d1e-3a42785dc705 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:35.874883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895cf3d-e399-4dc5-8c02-7b9c1f676720 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413c6613b4ec4e53aeeaf6828c807273', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:35.875569 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895cf3d-e399-4dc5-8c02-7b9c1f676720 service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:35.875942 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895cf3d-e399-4dc5-8c02-7b9c1f676720 service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:35.876226 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895cf3d-e399-4dc5-8c02-7b9c1f676720 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:35.895000 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9895cf3d-e399-4dc5-8c02-7b9c1f676720 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:35.896656 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9895cf3d-e399-4dc5-8c02-7b9c1f676720 service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:35.920852 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1208/2400] 10.222.0.32 () {60 vars in 1384 bytes} [Wed Jun 1 04:29:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 01 04:29:45.507574 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=67 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:45.911783 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=12 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:46.448784 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419e796-769e-4d29-b5a3-9307f2998f99 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:46.521523 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419e796-769e-4d29-b5a3-9307f2998f99 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:46.527461 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9dabb-adcf-4701-a602-ced7ba19618b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:46.528433 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9dabb-adcf-4701-a602-ced7ba19618b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:46.528799 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9dabb-adcf-4701-a602-ced7ba19618b admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:46.529171 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9dabb-adcf-4701-a602-ced7ba19618b admin admin] PATH_INFO: `/v3/users/084689cab4e041beb55f7cbc3901f2c0` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:46.531029 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9dabb-adcf-4701-a602-ced7ba19618b admin admin] RBAC: Authorizing `identity:delete_user(user_id=084689cab4e041beb55f7cbc3901f2c0)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:46.533278 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9dabb-adcf-4701-a602-ced7ba19618b admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:46.600731 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-73b9dabb-adcf-4701-a602-ced7ba19618b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '084689cab4e041beb55f7cbc3901f2c0'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:46.602464 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-73b9dabb-adcf-4701-a602-ced7ba19618b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '084689cab4e041beb55f7cbc3901f2c0'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:46.622774 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-73b9dabb-adcf-4701-a602-ced7ba19618b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '084689cab4e041beb55f7cbc3901f2c0'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:46.630940 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-73b9dabb-adcf-4701-a602-ced7ba19618b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '084689cab4e041beb55f7cbc3901f2c0'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:46.639330 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-73b9dabb-adcf-4701-a602-ced7ba19618b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '084689cab4e041beb55f7cbc3901f2c0'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:46.648726 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1193/2401] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:29:46 2022] DELETE /identity/v3/users/084689cab4e041beb55f7cbc3901f2c0 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:29:46.654122 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92ce31-ab70-4d8b-96b4-33bb725de573 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:46.654528 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92ce31-ab70-4d8b-96b4-33bb725de573 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:46.655007 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92ce31-ab70-4d8b-96b4-33bb725de573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:46.690973 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-6d92ce31-ab70-4d8b-96b4-33bb725de573 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:29:46.692609 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6d92ce31-ab70-4d8b-96b4-33bb725de573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:46.773912 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1209/2402] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:29:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:29:46.785571 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9dabb-adcf-4701-a602-ced7ba19618b admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:46.787388 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-73b9dabb-adcf-4701-a602-ced7ba19618b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:46.885948 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9dabb-adcf-4701-a602-ced7ba19618b admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:46.890569 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5ca75-c759-4962-ad5d-1e64da143e21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:46.891787 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5ca75-c759-4962-ad5d-1e64da143e21 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:46.892179 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5ca75-c759-4962-ad5d-1e64da143e21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:46.892711 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5ca75-c759-4962-ad5d-1e64da143e21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:46.908108 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5ca75-c759-4962-ad5d-1e64da143e21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:46.910216 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5ca75-c759-4962-ad5d-1e64da143e21 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:46.928541 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1194/2403] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:29:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:29:47.920688 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92ce31-ab70-4d8b-96b4-33bb725de573 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:47.923020 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6d92ce31-ab70-4d8b-96b4-33bb725de573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:47.938889 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92ce31-ab70-4d8b-96b4-33bb725de573 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:47.945648 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816677a-44c6-48c9-a993-09a579d0622a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:47.947123 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816677a-44c6-48c9-a993-09a579d0622a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:47.947962 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816677a-44c6-48c9-a993-09a579d0622a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:47.948807 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816677a-44c6-48c9-a993-09a579d0622a admin admin] PATH_INFO: `/v3/projects/8f26678ee7064e75a508b3b593b9849a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:47.950842 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816677a-44c6-48c9-a993-09a579d0622a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f26678ee7064e75a508b3b593b9849a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:47.953313 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816677a-44c6-48c9-a993-09a579d0622a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:48.033922 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2816677a-44c6-48c9-a993-09a579d0622a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f26678ee7064e75a508b3b593b9849a', 'request_id': 'req-2816677a-44c6-48c9-a993-09a579d0622a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:48.042931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2816677a-44c6-48c9-a993-09a579d0622a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f26678ee7064e75a508b3b593b9849a', 'request_id': 'req-2816677a-44c6-48c9-a993-09a579d0622a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:48.054862 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2816677a-44c6-48c9-a993-09a579d0622a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f26678ee7064e75a508b3b593b9849a', 'request_id': 'req-2816677a-44c6-48c9-a993-09a579d0622a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:48.072162 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2816677a-44c6-48c9-a993-09a579d0622a admin admin] The token cache is being invalidate because project 8f26678ee7064e75a508b3b593b9849a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:29:48.073143 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2816677a-44c6-48c9-a993-09a579d0622a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:48.075064 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2816677a-44c6-48c9-a993-09a579d0622a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:48.078361 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1210/2404] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:29:47 2022] DELETE /identity/v3/projects/8f26678ee7064e75a508b3b593b9849a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:29:55.172313 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5ca75-c759-4962-ad5d-1e64da143e21 service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:55.174218 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-97d5ca75-c759-4962-ad5d-1e64da143e21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:55.191581 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5ca75-c759-4962-ad5d-1e64da143e21 service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:55.223029 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:55.291663 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd1b1c-558c-4363-a11b-ad4ec816ed8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:55.292837 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd1b1c-558c-4363-a11b-ad4ec816ed8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:55.293231 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd1b1c-558c-4363-a11b-ad4ec816ed8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:55.293605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd1b1c-558c-4363-a11b-ad4ec816ed8e admin admin] PATH_INFO: `/v3/users/48b7342a53284202b07153e1e2e2fb3a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:55.295160 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd1b1c-558c-4363-a11b-ad4ec816ed8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=48b7342a53284202b07153e1e2e2fb3a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:55.297334 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd1b1c-558c-4363-a11b-ad4ec816ed8e admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:55.379780 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-19dd1b1c-558c-4363-a11b-ad4ec816ed8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48b7342a53284202b07153e1e2e2fb3a'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:55.380557 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-19dd1b1c-558c-4363-a11b-ad4ec816ed8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48b7342a53284202b07153e1e2e2fb3a'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:55.405306 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-19dd1b1c-558c-4363-a11b-ad4ec816ed8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48b7342a53284202b07153e1e2e2fb3a'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:55.420847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-19dd1b1c-558c-4363-a11b-ad4ec816ed8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48b7342a53284202b07153e1e2e2fb3a'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:55.435366 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-19dd1b1c-558c-4363-a11b-ad4ec816ed8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48b7342a53284202b07153e1e2e2fb3a'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:55.448155 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1195/2405] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:29:55 2022] DELETE /identity/v3/users/48b7342a53284202b07153e1e2e2fb3a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:29:55.453335 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41db272-93e1-4143-a3b3-c483a3747475 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:55.453844 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41db272-93e1-4143-a3b3-c483a3747475 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:55.454118 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41db272-93e1-4143-a3b3-c483a3747475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:55.475223 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a41db272-93e1-4143-a3b3-c483a3747475 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:29:55.476661 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a41db272-93e1-4143-a3b3-c483a3747475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:55.567908 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1211/2406] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:29:55.582846 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd1b1c-558c-4363-a11b-ad4ec816ed8e admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:55.584885 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-19dd1b1c-558c-4363-a11b-ad4ec816ed8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:55.687549 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd1b1c-558c-4363-a11b-ad4ec816ed8e admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:55.693187 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584f2bb-1755-4722-9db9-08aa3b9b24f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:55.694576 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584f2bb-1755-4722-9db9-08aa3b9b24f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:55.695310 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584f2bb-1755-4722-9db9-08aa3b9b24f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:55.695848 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584f2bb-1755-4722-9db9-08aa3b9b24f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:55.714457 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584f2bb-1755-4722-9db9-08aa3b9b24f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:55.717883 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584f2bb-1755-4722-9db9-08aa3b9b24f7 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:55.738867 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1196/2407] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:29:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:29:56.320358 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41db272-93e1-4143-a3b3-c483a3747475 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:56.322023 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a41db272-93e1-4143-a3b3-c483a3747475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:56.337958 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41db272-93e1-4143-a3b3-c483a3747475 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:56.346919 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbfa491-b707-4e12-b0ab-aa6a27fcdf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:56.348502 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfa491-b707-4e12-b0ab-aa6a27fcdf99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:56.349013 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfa491-b707-4e12-b0ab-aa6a27fcdf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:56.349530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfa491-b707-4e12-b0ab-aa6a27fcdf99 admin admin] PATH_INFO: `/v3/projects/2d34c88b4d9b438d94e7cd1f36430518` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:56.352118 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbfa491-b707-4e12-b0ab-aa6a27fcdf99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d34c88b4d9b438d94e7cd1f36430518)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:56.354999 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbfa491-b707-4e12-b0ab-aa6a27fcdf99 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:56.385535 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:56.421205 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5dbfa491-b707-4e12-b0ab-aa6a27fcdf99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d34c88b4d9b438d94e7cd1f36430518', 'request_id': 'req-5dbfa491-b707-4e12-b0ab-aa6a27fcdf99'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:56.427936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5dbfa491-b707-4e12-b0ab-aa6a27fcdf99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d34c88b4d9b438d94e7cd1f36430518', 'request_id': 'req-5dbfa491-b707-4e12-b0ab-aa6a27fcdf99'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:56.438195 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5dbfa491-b707-4e12-b0ab-aa6a27fcdf99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d34c88b4d9b438d94e7cd1f36430518', 'request_id': 'req-5dbfa491-b707-4e12-b0ab-aa6a27fcdf99'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:56.454714 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5dbfa491-b707-4e12-b0ab-aa6a27fcdf99 admin admin] The token cache is being invalidate because project 2d34c88b4d9b438d94e7cd1f36430518 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:29:56.455549 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5dbfa491-b707-4e12-b0ab-aa6a27fcdf99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:56.456281 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5dbfa491-b707-4e12-b0ab-aa6a27fcdf99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:29:56.459115 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1212/2408] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:29:56 2022] DELETE /identity/v3/projects/2d34c88b4d9b438d94e7cd1f36430518 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:29:56.467538 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0b3ad-4459-42a9-a00f-dccbabf821bf None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:56.468130 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0b3ad-4459-42a9-a00f-dccbabf821bf None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:56.468460 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0b3ad-4459-42a9-a00f-dccbabf821bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:56.497821 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-afd0b3ad-4459-42a9-a00f-dccbabf821bf None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:29:56.499932 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-afd0b3ad-4459-42a9-a00f-dccbabf821bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:56.581077 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:56.618787 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1197/2409] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:29:56.630679 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61bc3a-8267-458e-8a21-9e842e0861e2 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:56.631193 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61bc3a-8267-458e-8a21-9e842e0861e2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:56.631697 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61bc3a-8267-458e-8a21-9e842e0861e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:56.671622 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-af61bc3a-8267-458e-8a21-9e842e0861e2 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:29:56.674080 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-af61bc3a-8267-458e-8a21-9e842e0861e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:56.687471 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1213/2410] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:29:56.694313 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0b3ad-4459-42a9-a00f-dccbabf821bf None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:56.712743 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0b3ad-4459-42a9-a00f-dccbabf821bf None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:56.721118 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf2027-5818-458e-8ef9-d481255da25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:56.722299 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf2027-5818-458e-8ef9-d481255da25e admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:56.722809 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf2027-5818-458e-8ef9-d481255da25e admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:56.723312 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf2027-5818-458e-8ef9-d481255da25e admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:56.724800 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf2027-5818-458e-8ef9-d481255da25e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:29:56.725285 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf2027-5818-458e-8ef9-d481255da25e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:56.729065 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf2027-5818-458e-8ef9-d481255da25e admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:56.753632 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1198/2411] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:29:56.762173 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61bc3a-8267-458e-8a21-9e842e0861e2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:56.781788 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61bc3a-8267-458e-8a21-9e842e0861e2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:56.790825 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edeeac-374c-43e1-bf18-a6fa7a00dbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:56.791759 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edeeac-374c-43e1-bf18-a6fa7a00dbc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:56.792211 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edeeac-374c-43e1-bf18-a6fa7a00dbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:56.792617 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edeeac-374c-43e1-bf18-a6fa7a00dbc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:56.793833 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2edeeac-374c-43e1-bf18-a6fa7a00dbc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:56.797243 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2edeeac-374c-43e1-bf18-a6fa7a00dbc2 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:56.840832 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1214/2412] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:29:56 2022] POST /identity/v3/projects => generated 381 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:29:56.845120 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf2027-5818-458e-8ef9-d481255da25e admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:56.856570 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf2027-5818-458e-8ef9-d481255da25e admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:56.925308 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931247d-a224-4ea3-ba23-57f0c4649618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:56.926089 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931247d-a224-4ea3-ba23-57f0c4649618 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:56.926418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931247d-a224-4ea3-ba23-57f0c4649618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:56.926770 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931247d-a224-4ea3-ba23-57f0c4649618 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:56.927550 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931247d-a224-4ea3-ba23-57f0c4649618 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:56.929588 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931247d-a224-4ea3-ba23-57f0c4649618 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:56.953471 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1199/2413] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:29:56 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:29:56.958191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edeeac-374c-43e1-bf18-a6fa7a00dbc2 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:56.970755 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edeeac-374c-43e1-bf18-a6fa7a00dbc2 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:56.977124 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe84df-9de1-425e-a2a7-cd17b1cda4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:56.977873 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe84df-9de1-425e-a2a7-cd17b1cda4cb admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:56.978249 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe84df-9de1-425e-a2a7-cd17b1cda4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:56.978589 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe84df-9de1-425e-a2a7-cd17b1cda4cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:56.979490 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe84df-9de1-425e-a2a7-cd17b1cda4cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:56.981443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe84df-9de1-425e-a2a7-cd17b1cda4cb admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:56.995086 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1215/2414] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:29:56.999533 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931247d-a224-4ea3-ba23-57f0c4649618 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:57.010406 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931247d-a224-4ea3-ba23-57f0c4649618 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:57.015629 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b62d6-325d-4e00-a927-f1e7f4e79479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:57.016346 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b62d6-325d-4e00-a927-f1e7f4e79479 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:57.016631 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b62d6-325d-4e00-a927-f1e7f4e79479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:57.016909 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b62d6-325d-4e00-a927-f1e7f4e79479 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:57.017839 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b62d6-325d-4e00-a927-f1e7f4e79479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:57.019892 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b62d6-325d-4e00-a927-f1e7f4e79479 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:57.033141 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1200/2415] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:29:57.038069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe84df-9de1-425e-a2a7-cd17b1cda4cb admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:57.049508 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe84df-9de1-425e-a2a7-cd17b1cda4cb admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:57.054435 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218250e-b555-42d9-bc7d-8cf9f916e374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:57.055353 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218250e-b555-42d9-bc7d-8cf9f916e374 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:57.055639 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218250e-b555-42d9-bc7d-8cf9f916e374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:57.055914 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218250e-b555-42d9-bc7d-8cf9f916e374 admin admin] PATH_INFO: `/v3/projects/8e21c256386246e5a2213d17018f1cca/users/ba02c8f4cbd544268cf39c6254127e88/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:57.075562 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8218250e-b555-42d9-bc7d-8cf9f916e374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e21c256386246e5a2213d17018f1cca, user_id=ba02c8f4cbd544268cf39c6254127e88, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:57.078613 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8218250e-b555-42d9-bc7d-8cf9f916e374 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:57.094975 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1216/2416] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:29:57 2022] PUT /identity/v3/projects/8e21c256386246e5a2213d17018f1cca/users/ba02c8f4cbd544268cf39c6254127e88/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:29:57.101257 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc88a15-2113-4610-b0d5-c65baa6ae7f6 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:57.101538 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc88a15-2113-4610-b0d5-c65baa6ae7f6 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:57.101814 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc88a15-2113-4610-b0d5-c65baa6ae7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:57.121319 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-1fc88a15-2113-4610-b0d5-c65baa6ae7f6 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:29:57.122621 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-1fc88a15-2113-4610-b0d5-c65baa6ae7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:57.200388 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1201/2417] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:29:57.211869 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218250e-b555-42d9-bc7d-8cf9f916e374 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:57.214044 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8218250e-b555-42d9-bc7d-8cf9f916e374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:57.287043 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218250e-b555-42d9-bc7d-8cf9f916e374 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:57.291200 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18a4dc-3114-49c7-b0bd-3780ca5a6e87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:57.291889 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18a4dc-3114-49c7-b0bd-3780ca5a6e87 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:57.292176 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18a4dc-3114-49c7-b0bd-3780ca5a6e87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:57.292491 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18a4dc-3114-49c7-b0bd-3780ca5a6e87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:57.304246 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18a4dc-3114-49c7-b0bd-3780ca5a6e87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:57.305804 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18a4dc-3114-49c7-b0bd-3780ca5a6e87 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:57.317107 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1217/2418] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:29:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:29:58.316675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a99c3-320d-4735-a5cc-3b2624be9262 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:58.317282 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a99c3-320d-4735-a5cc-3b2624be9262 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:58.317672 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a99c3-320d-4735-a5cc-3b2624be9262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:58.357065 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-a86a99c3-320d-4735-a5cc-3b2624be9262 None None] MFA Rules not processed for user `ba02c8f4cbd544268cf39c6254127e88`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:29:58.359018 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a86a99c3-320d-4735-a5cc-3b2624be9262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:58.426109 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:58.470122 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1202/2419] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:29:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:29:58.485699 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18a4dc-3114-49c7-b0bd-3780ca5a6e87 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:29:58.489268 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ea18a4dc-3114-49c7-b0bd-3780ca5a6e87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:29:58.565683 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:29:58.603639 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18a4dc-3114-49c7-b0bd-3780ca5a6e87 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:29:58.607897 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b02898-3af8-464a-b349-fea0ec39c914 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:29:58.608577 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b02898-3af8-464a-b349-fea0ec39c914 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:29:58.608869 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b02898-3af8-464a-b349-fea0ec39c914 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:29:58.609143 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b02898-3af8-464a-b349-fea0ec39c914 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:29:58.620105 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b02898-3af8-464a-b349-fea0ec39c914 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:29:58.621603 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b02898-3af8-464a-b349-fea0ec39c914 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:29:58.634819 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1218/2420] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:29:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:30:00.130576 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9434361-c310-49fd-86a9-5c9042e1ea0f None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:30:00.131436 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9434361-c310-49fd-86a9-5c9042e1ea0f None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:30:00.131436 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9434361-c310-49fd-86a9-5c9042e1ea0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:30:00.153159 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-b9434361-c310-49fd-86a9-5c9042e1ea0f None None] MFA Rules not processed for user `ba02c8f4cbd544268cf39c6254127e88`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:30:00.155245 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-b9434361-c310-49fd-86a9-5c9042e1ea0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:30:00.165224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1203/2421] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:30:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:30:05.075958 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b02898-3af8-464a-b349-fea0ec39c914 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:30:05.109394 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b02898-3af8-464a-b349-fea0ec39c914 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:30:05.114847 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70760751-7497-4edc-8d4c-b806702d5db5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:30:05.115525 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70760751-7497-4edc-8d4c-b806702d5db5 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:30:05.115804 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70760751-7497-4edc-8d4c-b806702d5db5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:30:05.116251 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70760751-7497-4edc-8d4c-b806702d5db5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:30:05.118657 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-70760751-7497-4edc-8d4c-b806702d5db5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:30:05.232853 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70760751-7497-4edc-8d4c-b806702d5db5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:30:05.235682 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70760751-7497-4edc-8d4c-b806702d5db5 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:30:05.266555 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1219/2422] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:30:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:30:06.779019 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041235a-6f82-438a-84ce-a9a5acaba250 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:30:06.779895 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041235a-6f82-438a-84ce-a9a5acaba250 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:30:06.780080 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041235a-6f82-438a-84ce-a9a5acaba250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:30:06.815690 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-8041235a-6f82-438a-84ce-a9a5acaba250 None None] MFA Rules not processed for user `3fa2ad34164a4631adf76fbd042679ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:30:06.818057 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-8041235a-6f82-438a-84ce-a9a5acaba250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:30:06.921638 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1204/2423] 10.222.0.32 () {58 vars in 1009 bytes} [Wed Jun 1 04:30:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:30:06.937685 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70760751-7497-4edc-8d4c-b806702d5db5 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:30:06.940689 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-70760751-7497-4edc-8d4c-b806702d5db5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:30:07.045796 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70760751-7497-4edc-8d4c-b806702d5db5 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:30:07.051743 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6596f-9090-405c-8d2c-c15879fee7d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413c6613b4ec4e53aeeaf6828c807273', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:30:07.052441 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6596f-9090-405c-8d2c-c15879fee7d5 service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:30:07.052732 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6596f-9090-405c-8d2c-c15879fee7d5 service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:30:07.053018 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6596f-9090-405c-8d2c-c15879fee7d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:30:07.063650 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f6596f-9090-405c-8d2c-c15879fee7d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:30:07.066589 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f6596f-9090-405c-8d2c-c15879fee7d5 service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:30:07.084212 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1220/2424] 10.222.0.32 () {60 vars in 1384 bytes} [Wed Jun 1 04:30:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 01 04:30:16.902395 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=40 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:30:17.075836 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=76 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:30:27.431890 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab339cd6-c47d-443e-a1e1-1683ce45ab9b None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:30:27.432865 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab339cd6-c47d-443e-a1e1-1683ce45ab9b None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:30:27.435148 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab339cd6-c47d-443e-a1e1-1683ce45ab9b None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:30:27.439087 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1205/2425] 10.222.0.32 () {54 vars in 921 bytes} [Wed Jun 1 04:30:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:30:27.448502 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca8413-06df-4497-97d2-f6eb5801caa7 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:30:27.449448 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca8413-06df-4497-97d2-f6eb5801caa7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:30:27.449448 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca8413-06df-4497-97d2-f6eb5801caa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:30:27.554116 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-3fca8413-06df-4497-97d2-f6eb5801caa7 None None] MFA Rules not processed for user `79d614f85f5541d3babbb41468cbf55c`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:30:27.555649 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3fca8413-06df-4497-97d2-f6eb5801caa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:30:27.664318 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1221/2426] 10.222.0.32 () {58 vars in 1018 bytes} [Wed Jun 1 04:30:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:30:27.677133 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab339cd6-c47d-443e-a1e1-1683ce45ab9b None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:30:27.679445 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-ab339cd6-c47d-443e-a1e1-1683ce45ab9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:30:27.772590 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab339cd6-c47d-443e-a1e1-1683ce45ab9b None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:30:27.776807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5260c1-1277-4771-a8b3-ea2569735f99 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac83171b9284163a71cc729cef076f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:30:27.777482 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5260c1-1277-4771-a8b3-ea2569735f99 service glance] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:30:27.777822 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5260c1-1277-4771-a8b3-ea2569735f99 service glance] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:30:27.778094 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5260c1-1277-4771-a8b3-ea2569735f99 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:30:27.789855 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5260c1-1277-4771-a8b3-ea2569735f99 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:30:27.791370 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5260c1-1277-4771-a8b3-ea2569735f99 service glance] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:30:27.804205 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1206/2427] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:30:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:30:27.897555 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2909a-6ec7-46c6-9010-b5175860b6b9 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:30:27.898030 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2909a-6ec7-46c6-9010-b5175860b6b9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:30:27.898422 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2909a-6ec7-46c6-9010-b5175860b6b9 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:30:27.900100 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1222/2428] 10.222.0.32 () {54 vars in 921 bytes} [Wed Jun 1 04:30:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 04:30:27.906023 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da01f7-6f9f-422a-95b5-33020b870a81 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:30:27.906572 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da01f7-6f9f-422a-95b5-33020b870a81 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:30:27.906863 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da01f7-6f9f-422a-95b5-33020b870a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:30:27.937914 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-76da01f7-6f9f-422a-95b5-33020b870a81 None None] MFA Rules not processed for user `dca5f9455ef349738adf4569fe5ed165`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:30:27.939524 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-76da01f7-6f9f-422a-95b5-33020b870a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:30:27.951679 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1207/2429] 10.222.0.32 () {58 vars in 1018 bytes} [Wed Jun 1 04:30:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:30:27.969245 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2909a-6ec7-46c6-9010-b5175860b6b9 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:30:27.984646 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2909a-6ec7-46c6-9010-b5175860b6b9 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:30:27.988977 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99650778-d023-4b69-85da-444992f30db9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:30:27.989798 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99650778-d023-4b69-85da-444992f30db9 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:30:27.990732 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99650778-d023-4b69-85da-444992f30db9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:30:27.991016 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99650778-d023-4b69-85da-444992f30db9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:30:27.999566 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99650778-d023-4b69-85da-444992f30db9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:30:28.001065 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99650778-d023-4b69-85da-444992f30db9 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:30:28.014177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1223/2430] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:30:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:30:28.127826 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de77e17-83ed-4968-9eb5-cbabe5847726 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:30:28.128353 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de77e17-83ed-4968-9eb5-cbabe5847726 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:30:28.128866 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de77e17-83ed-4968-9eb5-cbabe5847726 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:30:28.132645 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1208/2431] 10.222.0.32 () {54 vars in 921 bytes} [Wed Jun 1 04:30:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:30:28.142781 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a258f4-8203-4f0d-a582-57200d9e3c90 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:30:28.143066 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a258f4-8203-4f0d-a582-57200d9e3c90 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:30:28.143332 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a258f4-8203-4f0d-a582-57200d9e3c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:30:28.188400 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-88a258f4-8203-4f0d-a582-57200d9e3c90 None None] MFA Rules not processed for user `79d614f85f5541d3babbb41468cbf55c`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:30:28.189849 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-88a258f4-8203-4f0d-a582-57200d9e3c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:30:28.218922 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1224/2432] 10.222.0.32 () {58 vars in 1018 bytes} [Wed Jun 1 04:30:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:30:28.242662 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de77e17-83ed-4968-9eb5-cbabe5847726 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:30:28.255586 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de77e17-83ed-4968-9eb5-cbabe5847726 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:30:28.260204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2162b0a-2b37-4e64-a608-da22831d41b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:30:28.260993 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2162b0a-2b37-4e64-a608-da22831d41b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:30:28.261281 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2162b0a-2b37-4e64-a608-da22831d41b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:30:28.261582 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2162b0a-2b37-4e64-a608-da22831d41b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:30:28.274326 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2162b0a-2b37-4e64-a608-da22831d41b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:30:28.275831 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2162b0a-2b37-4e64-a608-da22831d41b8 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:30:28.290361 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1209/2433] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:30:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:30:32.721900 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88950e-dae0-4972-8340-11530b272c5f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:30:32.722802 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88950e-dae0-4972-8340-11530b272c5f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:30:32.723132 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88950e-dae0-4972-8340-11530b272c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:30:32.800774 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-1f88950e-dae0-4972-8340-11530b272c5f None None] MFA Rules not processed for user `3fa2ad34164a4631adf76fbd042679ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:30:32.802061 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1f88950e-dae0-4972-8340-11530b272c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:30:32.823129 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1225/2434] 10.222.0.32 () {58 vars in 1009 bytes} [Wed Jun 1 04:30:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:30:32.837084 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2162b0a-2b37-4e64-a608-da22831d41b8 service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:30:32.864003 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2162b0a-2b37-4e64-a608-da22831d41b8 service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:30:32.874392 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6ff33-65f8-42fa-9db7-4bafc1fa3250 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413c6613b4ec4e53aeeaf6828c807273', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:30:32.875211 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6ff33-65f8-42fa-9db7-4bafc1fa3250 service swift] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:30:32.875528 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6ff33-65f8-42fa-9db7-4bafc1fa3250 service swift] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:30:32.875805 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6ff33-65f8-42fa-9db7-4bafc1fa3250 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:30:32.885875 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6ff33-65f8-42fa-9db7-4bafc1fa3250 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:30:32.887570 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6ff33-65f8-42fa-9db7-4bafc1fa3250 service swift] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:30:32.898453 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1210/2435] 10.222.0.32 () {60 vars in 1384 bytes} [Wed Jun 1 04:30:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 01 04:30:34.149352 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9477a3-eb27-4565-ac55-5e51d07c13a8 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:30:34.150466 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9477a3-eb27-4565-ac55-5e51d07c13a8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:30:34.150928 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9477a3-eb27-4565-ac55-5e51d07c13a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:30:34.174193 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2e9477a3-eb27-4565-ac55-5e51d07c13a8 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:30:34.175483 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2e9477a3-eb27-4565-ac55-5e51d07c13a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:30:34.184429 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1226/2436] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Jun 1 04:30:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:30:34.213126 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6ff33-65f8-42fa-9db7-4bafc1fa3250 service swift] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:30:34.215345 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-08e6ff33-65f8-42fa-9db7-4bafc1fa3250 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:30:34.242550 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6ff33-65f8-42fa-9db7-4bafc1fa3250 service swift] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:30:34.250653 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3e293-aeb1-4017-9b92-de57b2d79c70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:30:34.251319 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3e293-aeb1-4017-9b92-de57b2d79c70 service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:30:34.251603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3e293-aeb1-4017-9b92-de57b2d79c70 service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:30:34.251916 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3e293-aeb1-4017-9b92-de57b2d79c70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:30:34.262303 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c3e293-aeb1-4017-9b92-de57b2d79c70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:30:34.263917 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c3e293-aeb1-4017-9b92-de57b2d79c70 service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:30:34.275151 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1211/2437] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:30:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:30:44.167934 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=76 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:30:44.270025 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=60 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:30:49.090967 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc4995-1736-47db-8065-db2e89830da4 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:30:49.092334 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc4995-1736-47db-8065-db2e89830da4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:30:49.092865 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc4995-1736-47db-8065-db2e89830da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:30:49.120694 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-f1dc4995-1736-47db-8065-db2e89830da4 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:30:49.121959 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f1dc4995-1736-47db-8065-db2e89830da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:30:49.131607 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1227/2438] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Jun 1 04:30:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:30:49.156885 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3e293-aeb1-4017-9b92-de57b2d79c70 service nova] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:30:49.159595 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-30c3e293-aeb1-4017-9b92-de57b2d79c70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:30:49.182225 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3e293-aeb1-4017-9b92-de57b2d79c70 service nova] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:30:49.190802 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595d5c0-a711-47ac-83b9-4afdc82fa863 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:30:49.191576 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595d5c0-a711-47ac-83b9-4afdc82fa863 service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:30:49.192060 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595d5c0-a711-47ac-83b9-4afdc82fa863 service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:30:49.192577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595d5c0-a711-47ac-83b9-4afdc82fa863 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:30:49.215121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595d5c0-a711-47ac-83b9-4afdc82fa863 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:30:49.217029 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595d5c0-a711-47ac-83b9-4afdc82fa863 service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:30:49.233171 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1212/2439] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:30:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:30:52.351509 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11733e-4824-4cce-ae15-35727da71363 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:30:52.352398 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11733e-4824-4cce-ae15-35727da71363 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:30:52.352398 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11733e-4824-4cce-ae15-35727da71363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:30:52.374994 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-1e11733e-4824-4cce-ae15-35727da71363 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:30:52.376400 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1e11733e-4824-4cce-ae15-35727da71363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:30:52.384899 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1228/2440] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Jun 1 04:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:30:52.413239 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595d5c0-a711-47ac-83b9-4afdc82fa863 service nova] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:30:52.430745 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595d5c0-a711-47ac-83b9-4afdc82fa863 service nova] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:30:52.440672 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d074cb6-d3f5-4aeb-a920-58f90114a8e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:30:52.441811 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d074cb6-d3f5-4aeb-a920-58f90114a8e2 service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:30:52.442409 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d074cb6-d3f5-4aeb-a920-58f90114a8e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:30:52.442917 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d074cb6-d3f5-4aeb-a920-58f90114a8e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:30:52.460179 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d074cb6-d3f5-4aeb-a920-58f90114a8e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:30:52.463273 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d074cb6-d3f5-4aeb-a920-58f90114a8e2 service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:30:52.476590 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1213/2441] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:30:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:30:53.881763 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db72792-0646-4762-868d-097cecc10405 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:30:53.883264 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db72792-0646-4762-868d-097cecc10405 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:30:53.883264 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db72792-0646-4762-868d-097cecc10405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:30:53.916394 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-5db72792-0646-4762-868d-097cecc10405 None None] MFA Rules not processed for user `3fa2ad34164a4631adf76fbd042679ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:30:53.918539 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5db72792-0646-4762-868d-097cecc10405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:30:53.931716 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1229/2442] 10.222.0.32 () {58 vars in 967 bytes} [Wed Jun 1 04:30:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:30:53.951083 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d074cb6-d3f5-4aeb-a920-58f90114a8e2 service nova] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:30:53.968515 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d074cb6-d3f5-4aeb-a920-58f90114a8e2 service nova] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:30:53.975356 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597bad6-4ca1-49ea-9ed7-029d26207307 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413c6613b4ec4e53aeeaf6828c807273', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:30:53.976024 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597bad6-4ca1-49ea-9ed7-029d26207307 service swift] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:30:53.976316 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597bad6-4ca1-49ea-9ed7-029d26207307 service swift] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:30:53.976605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597bad6-4ca1-49ea-9ed7-029d26207307 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:30:53.987108 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597bad6-4ca1-49ea-9ed7-029d26207307 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:30:53.988801 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597bad6-4ca1-49ea-9ed7-029d26207307 service swift] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:30:53.999656 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1214/2443] 10.222.0.32 () {60 vars in 1384 bytes} [Wed Jun 1 04:30:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 01 04:30:56.527312 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032afa9-86db-4002-8eb2-681b2c004847 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:30:56.528186 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032afa9-86db-4002-8eb2-681b2c004847 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:30:56.528186 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032afa9-86db-4002-8eb2-681b2c004847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:30:56.559449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c032afa9-86db-4002-8eb2-681b2c004847 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:30:56.561625 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c032afa9-86db-4002-8eb2-681b2c004847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:30:56.573679 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1230/2444] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Jun 1 04:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:30:56.697111 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597bad6-4ca1-49ea-9ed7-029d26207307 service swift] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:30:56.721781 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597bad6-4ca1-49ea-9ed7-029d26207307 service swift] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:30:56.733070 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c70e93-a412-4708-962d-e822876ba59f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:30:56.733837 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c70e93-a412-4708-962d-e822876ba59f service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:30:56.734277 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c70e93-a412-4708-962d-e822876ba59f service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:30:56.734662 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c70e93-a412-4708-962d-e822876ba59f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:30:56.745435 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c70e93-a412-4708-962d-e822876ba59f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:30:56.747314 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c70e93-a412-4708-962d-e822876ba59f service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:30:56.759012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1215/2445] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:30:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:30:59.713252 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c2b05-ef9a-45d1-8dd2-8ba1da960bc9 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:30:59.713828 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c2b05-ef9a-45d1-8dd2-8ba1da960bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:30:59.713828 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c2b05-ef9a-45d1-8dd2-8ba1da960bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:30:59.734603 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-df7c2b05-ef9a-45d1-8dd2-8ba1da960bc9 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:30:59.735831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-df7c2b05-ef9a-45d1-8dd2-8ba1da960bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:30:59.744173 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1231/2446] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Jun 1 04:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:30:59.777557 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c70e93-a412-4708-962d-e822876ba59f service nova] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:30:59.789555 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c70e93-a412-4708-962d-e822876ba59f service nova] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:30:59.796627 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b7839-1d6d-4463-a3b0-7056a3cfcc0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:30:59.797322 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b7839-1d6d-4463-a3b0-7056a3cfcc0e service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:30:59.797610 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b7839-1d6d-4463-a3b0-7056a3cfcc0e service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:30:59.797897 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b7839-1d6d-4463-a3b0-7056a3cfcc0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:30:59.807881 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b7839-1d6d-4463-a3b0-7056a3cfcc0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:30:59.809507 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b7839-1d6d-4463-a3b0-7056a3cfcc0e service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:30:59.821251 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1216/2447] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:30:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:31:03.926609 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe539a-55dd-4446-b707-a3ce8fd28cf1 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:31:03.927219 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe539a-55dd-4446-b707-a3ce8fd28cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:31:03.927219 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe539a-55dd-4446-b707-a3ce8fd28cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:31:03.948338 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-ddbe539a-55dd-4446-b707-a3ce8fd28cf1 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:31:03.949610 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ddbe539a-55dd-4446-b707-a3ce8fd28cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:31:03.958989 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1232/2448] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Jun 1 04:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:31:03.990640 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b7839-1d6d-4463-a3b0-7056a3cfcc0e service nova] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:31:04.007853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b7839-1d6d-4463-a3b0-7056a3cfcc0e service nova] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:31:04.014460 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ff086-516a-448b-aa02-2a75a733682c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:31:04.015146 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ff086-516a-448b-aa02-2a75a733682c service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:31:04.015432 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ff086-516a-448b-aa02-2a75a733682c service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:31:04.015708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ff086-516a-448b-aa02-2a75a733682c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:31:04.025594 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ff086-516a-448b-aa02-2a75a733682c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:31:04.027590 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ff086-516a-448b-aa02-2a75a733682c service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:31:04.042361 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1217/2449] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:31:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:31:13.940956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=18 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:31:14.034364 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=36 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:31:15.482867 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe539a-55dd-4446-b707-a3ce8fd28cf1 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:31:15.484988 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ddbe539a-55dd-4446-b707-a3ce8fd28cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:31:15.608337 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe539a-55dd-4446-b707-a3ce8fd28cf1 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:31:15.614636 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c0099-d848-4c42-b70d-c58802e5db52 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0433f6219478476286ea27c5c82d41a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:31:15.615315 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c0099-d848-4c42-b70d-c58802e5db52 service placement] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:31:15.615744 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c0099-d848-4c42-b70d-c58802e5db52 service placement] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:31:15.616026 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c0099-d848-4c42-b70d-c58802e5db52 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:31:15.618302 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d78c0099-d848-4c42-b70d-c58802e5db52 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:31:15.631519 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c0099-d848-4c42-b70d-c58802e5db52 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:31:15.633082 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c0099-d848-4c42-b70d-c58802e5db52 service placement] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:31:15.644275 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1233/2450] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:31:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:31:17.666798 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a9659-a6d9-44d8-86d6-33243abb787d None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:31:17.667519 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a9659-a6d9-44d8-86d6-33243abb787d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:31:17.668050 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a9659-a6d9-44d8-86d6-33243abb787d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:31:17.699136 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-479a9659-a6d9-44d8-86d6-33243abb787d None None] MFA Rules not processed for user `4156a6ff075847769c0d35cfeb1b3af0`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:31:17.701534 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-479a9659-a6d9-44d8-86d6-33243abb787d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:31:17.784981 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1218/2451] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:31:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:31:21.969284 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fa03b-cae9-47d7-adb7-234e26a2c4f5 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:31:21.970738 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fa03b-cae9-47d7-adb7-234e26a2c4f5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:31:21.972699 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fa03b-cae9-47d7-adb7-234e26a2c4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:31:22.007827 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-741fa03b-cae9-47d7-adb7-234e26a2c4f5 None None] MFA Rules not processed for user `ba02c8f4cbd544268cf39c6254127e88`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:31:22.009361 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-741fa03b-cae9-47d7-adb7-234e26a2c4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:31:22.022977 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1234/2452] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:31:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:31:27.776607 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=25 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:31:30.513551 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170cf4bf-37ca-4ce5-8ec5-3d6159bbd799 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:31:30.514610 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170cf4bf-37ca-4ce5-8ec5-3d6159bbd799 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:31:30.514610 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170cf4bf-37ca-4ce5-8ec5-3d6159bbd799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:31:30.536466 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-170cf4bf-37ca-4ce5-8ec5-3d6159bbd799 None None] MFA Rules not processed for user `df8135d434a6499db18f03e1ec293a05`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:31:30.537750 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-170cf4bf-37ca-4ce5-8ec5-3d6159bbd799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:31:30.617321 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1219/2453] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:31:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:31:31.997864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=44 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:31:40.609000 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=25 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:31:43.829194 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305a876-c6fa-4d40-be87-994e5db61d92 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:31:43.830173 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305a876-c6fa-4d40-be87-994e5db61d92 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:31:43.830173 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305a876-c6fa-4d40-be87-994e5db61d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:31:43.859200 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7305a876-c6fa-4d40-be87-994e5db61d92 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:31:43.861399 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7305a876-c6fa-4d40-be87-994e5db61d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:31:43.876156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1235/2454] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Jun 1 04:31:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:31:43.903837 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170cf4bf-37ca-4ce5-8ec5-3d6159bbd799 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:31:43.922760 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170cf4bf-37ca-4ce5-8ec5-3d6159bbd799 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:31:43.931437 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930fd718-86c6-4b82-909f-15d9db0b66e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:31:43.932606 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fd718-86c6-4b82-909f-15d9db0b66e6 service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:31:43.933122 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fd718-86c6-4b82-909f-15d9db0b66e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:31:43.933579 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fd718-86c6-4b82-909f-15d9db0b66e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:31:43.951207 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930fd718-86c6-4b82-909f-15d9db0b66e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:31:43.953170 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930fd718-86c6-4b82-909f-15d9db0b66e6 service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:31:43.970197 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1220/2455] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:31:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:31:48.286145 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c31e71-a3d5-490d-80fd-ba1ba8e139fd None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:31:48.287169 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c31e71-a3d5-490d-80fd-ba1ba8e139fd None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:31:48.287546 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c31e71-a3d5-490d-80fd-ba1ba8e139fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:31:48.309962 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-29c31e71-a3d5-490d-80fd-ba1ba8e139fd None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:31:48.311551 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-29c31e71-a3d5-490d-80fd-ba1ba8e139fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:31:48.321875 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1236/2456] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Jun 1 04:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:31:48.344794 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930fd718-86c6-4b82-909f-15d9db0b66e6 service nova] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:31:48.359891 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930fd718-86c6-4b82-909f-15d9db0b66e6 service nova] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:31:48.367766 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35735a8-ddb6-498d-bf1c-7682726c73ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:31:48.368714 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35735a8-ddb6-498d-bf1c-7682726c73ad service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:31:48.369080 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35735a8-ddb6-498d-bf1c-7682726c73ad service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:31:48.369483 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35735a8-ddb6-498d-bf1c-7682726c73ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:31:48.382587 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35735a8-ddb6-498d-bf1c-7682726c73ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:31:48.385683 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35735a8-ddb6-498d-bf1c-7682726c73ad service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:31:48.414631 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1221/2457] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:31:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:31:50.383490 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb62c5c-feb2-4fbc-a3b4-9a85bfcbe6eb None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:31:50.384276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb62c5c-feb2-4fbc-a3b4-9a85bfcbe6eb None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:31:50.384276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb62c5c-feb2-4fbc-a3b4-9a85bfcbe6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:31:50.410378 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-bdb62c5c-feb2-4fbc-a3b4-9a85bfcbe6eb None None] MFA Rules not processed for user `d5a8390d1220475582b70d1347a1ef14`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:31:50.411730 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-bdb62c5c-feb2-4fbc-a3b4-9a85bfcbe6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:31:50.481766 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1237/2458] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:31:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:31:51.538409 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75ede8-fc21-4bf4-9151-dee9f6f4a9c7 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:31:51.539037 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75ede8-fc21-4bf4-9151-dee9f6f4a9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:31:51.539037 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75ede8-fc21-4bf4-9151-dee9f6f4a9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:31:51.569180 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-eb75ede8-fc21-4bf4-9151-dee9f6f4a9c7 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:31:51.570465 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-eb75ede8-fc21-4bf4-9151-dee9f6f4a9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:31:51.579988 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1222/2459] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Jun 1 04:31:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:31:51.614536 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb62c5c-feb2-4fbc-a3b4-9a85bfcbe6eb None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:31:51.629964 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb62c5c-feb2-4fbc-a3b4-9a85bfcbe6eb None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:31:51.638090 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44678cc9-fc0f-436f-b0e9-e5ac5376678b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:31:51.638772 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44678cc9-fc0f-436f-b0e9-e5ac5376678b service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:31:51.639354 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44678cc9-fc0f-436f-b0e9-e5ac5376678b service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:31:51.639567 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44678cc9-fc0f-436f-b0e9-e5ac5376678b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:31:51.670175 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44678cc9-fc0f-436f-b0e9-e5ac5376678b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:31:51.673324 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44678cc9-fc0f-436f-b0e9-e5ac5376678b service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:31:51.696804 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1238/2460] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:31:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:31:56.860871 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af839081-74fc-4ccc-8199-453fd125c630 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:31:56.864591 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af839081-74fc-4ccc-8199-453fd125c630 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:31:56.865161 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af839081-74fc-4ccc-8199-453fd125c630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:31:56.899374 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-af839081-74fc-4ccc-8199-453fd125c630 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:31:56.902266 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-af839081-74fc-4ccc-8199-453fd125c630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:31:56.925124 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1223/2461] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Jun 1 04:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:31:56.972196 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44678cc9-fc0f-436f-b0e9-e5ac5376678b service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:31:56.992273 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44678cc9-fc0f-436f-b0e9-e5ac5376678b service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:31:57.003101 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaca614-020a-4206-baac-fd6d937a569c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:31:57.004126 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaca614-020a-4206-baac-fd6d937a569c service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:31:57.010581 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaca614-020a-4206-baac-fd6d937a569c service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:31:57.011158 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaca614-020a-4206-baac-fd6d937a569c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:31:57.028924 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaca614-020a-4206-baac-fd6d937a569c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:31:57.032100 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaca614-020a-4206-baac-fd6d937a569c service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:31:57.053727 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1239/2462] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:31:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:31:59.009758 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ac3a0-f8ad-4393-88c8-f2a7fc977964 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:31:59.010611 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ac3a0-f8ad-4393-88c8-f2a7fc977964 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:31:59.011104 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ac3a0-f8ad-4393-88c8-f2a7fc977964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:31:59.043577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-420ac3a0-f8ad-4393-88c8-f2a7fc977964 None None] MFA Rules not processed for user `3fa2ad34164a4631adf76fbd042679ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:31:59.045672 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-420ac3a0-f8ad-4393-88c8-f2a7fc977964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:31:59.060142 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1224/2463] 10.222.0.32 () {58 vars in 967 bytes} [Wed Jun 1 04:31:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:31:59.122246 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaca614-020a-4206-baac-fd6d937a569c service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:31:59.136141 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaca614-020a-4206-baac-fd6d937a569c service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:31:59.144743 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee16c8-8917-478c-aa18-113450d769ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413c6613b4ec4e53aeeaf6828c807273', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:31:59.149812 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee16c8-8917-478c-aa18-113450d769ac service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:31:59.149812 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee16c8-8917-478c-aa18-113450d769ac service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:31:59.149812 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee16c8-8917-478c-aa18-113450d769ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:31:59.165475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee16c8-8917-478c-aa18-113450d769ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:31:59.170823 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee16c8-8917-478c-aa18-113450d769ac service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:31:59.185374 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1240/2464] 10.222.0.32 () {60 vars in 1384 bytes} [Wed Jun 1 04:31:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 01 04:32:01.170573 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315ab01-1fd2-4b6e-ab5c-e85800c7241b None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:32:01.171053 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315ab01-1fd2-4b6e-ab5c-e85800c7241b None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:32:01.171253 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315ab01-1fd2-4b6e-ab5c-e85800c7241b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:32:01.205630 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-7315ab01-1fd2-4b6e-ab5c-e85800c7241b None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:32:01.207513 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7315ab01-1fd2-4b6e-ab5c-e85800c7241b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:32:01.217627 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1225/2465] 10.222.0.50 () {58 vars in 1016 bytes} [Wed Jun 1 04:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:32:01.256594 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee16c8-8917-478c-aa18-113450d769ac service swift] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:32:01.285705 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee16c8-8917-478c-aa18-113450d769ac service swift] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:32:01.305306 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e2f18-2c68-4bd9-ba5a-c5390cf1f8d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:32:01.306805 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e2f18-2c68-4bd9-ba5a-c5390cf1f8d3 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:32:01.307565 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e2f18-2c68-4bd9-ba5a-c5390cf1f8d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:32:01.308257 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e2f18-2c68-4bd9-ba5a-c5390cf1f8d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:32:01.344173 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e2f18-2c68-4bd9-ba5a-c5390cf1f8d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:32:01.347902 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e2f18-2c68-4bd9-ba5a-c5390cf1f8d3 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:32:01.370451 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1241/2466] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:32:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:32:09.546797 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315ab01-1fd2-4b6e-ab5c-e85800c7241b None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:32:09.548301 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7315ab01-1fd2-4b6e-ab5c-e85800c7241b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:32:09.562716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315ab01-1fd2-4b6e-ab5c-e85800c7241b None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:32:09.569317 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bcc820-1c95-4e3b-bf55-82bdacb5ae24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:32:09.570701 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bcc820-1c95-4e3b-bf55-82bdacb5ae24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:32:09.571196 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bcc820-1c95-4e3b-bf55-82bdacb5ae24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:32:09.571523 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bcc820-1c95-4e3b-bf55-82bdacb5ae24 admin admin] PATH_INFO: `/v3/users/06ee2c50e9034cfcb7d4b543a122b3c9` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:32:09.573059 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bcc820-1c95-4e3b-bf55-82bdacb5ae24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06ee2c50e9034cfcb7d4b543a122b3c9)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:32:09.575076 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bcc820-1c95-4e3b-bf55-82bdacb5ae24 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:32:09.630320 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-63bcc820-1c95-4e3b-bf55-82bdacb5ae24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06ee2c50e9034cfcb7d4b543a122b3c9'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:09.630967 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-63bcc820-1c95-4e3b-bf55-82bdacb5ae24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06ee2c50e9034cfcb7d4b543a122b3c9'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:09.646491 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-63bcc820-1c95-4e3b-bf55-82bdacb5ae24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06ee2c50e9034cfcb7d4b543a122b3c9'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:09.654498 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-63bcc820-1c95-4e3b-bf55-82bdacb5ae24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06ee2c50e9034cfcb7d4b543a122b3c9'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:09.663845 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-63bcc820-1c95-4e3b-bf55-82bdacb5ae24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06ee2c50e9034cfcb7d4b543a122b3c9'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:09.670958 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1226/2467] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:32:09 2022] DELETE /identity/v3/users/06ee2c50e9034cfcb7d4b543a122b3c9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:32:09.869782 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e2f18-2c68-4bd9-ba5a-c5390cf1f8d3 service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:32:09.881549 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e2f18-2c68-4bd9-ba5a-c5390cf1f8d3 service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:32:09.951149 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c095e62-131f-4dc3-98c4-da1eacda318f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:32:09.952036 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c095e62-131f-4dc3-98c4-da1eacda318f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:32:09.952321 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c095e62-131f-4dc3-98c4-da1eacda318f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:32:09.952598 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c095e62-131f-4dc3-98c4-da1eacda318f admin admin] PATH_INFO: `/v3/projects/663b34f447084eafb3ca791399f07cea` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:32:09.953817 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c095e62-131f-4dc3-98c4-da1eacda318f admin admin] RBAC: Authorizing `identity:delete_project(project_id=663b34f447084eafb3ca791399f07cea)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:32:09.955805 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c095e62-131f-4dc3-98c4-da1eacda318f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:32:10.002722 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:32:10.012027 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9c095e62-131f-4dc3-98c4-da1eacda318f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '663b34f447084eafb3ca791399f07cea', 'request_id': 'req-9c095e62-131f-4dc3-98c4-da1eacda318f'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:10.023686 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9c095e62-131f-4dc3-98c4-da1eacda318f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '663b34f447084eafb3ca791399f07cea', 'request_id': 'req-9c095e62-131f-4dc3-98c4-da1eacda318f'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:10.032747 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9c095e62-131f-4dc3-98c4-da1eacda318f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '663b34f447084eafb3ca791399f07cea', 'request_id': 'req-9c095e62-131f-4dc3-98c4-da1eacda318f'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:10.048653 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9c095e62-131f-4dc3-98c4-da1eacda318f admin admin] The token cache is being invalidate because project 663b34f447084eafb3ca791399f07cea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:32:10.049505 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9c095e62-131f-4dc3-98c4-da1eacda318f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:10.050236 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9c095e62-131f-4dc3-98c4-da1eacda318f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:10.051827 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1242/2468] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:32:09 2022] DELETE /identity/v3/projects/663b34f447084eafb3ca791399f07cea => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:32:10.056010 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bcc820-1c95-4e3b-bf55-82bdacb5ae24 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:32:10.057465 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-63bcc820-1c95-4e3b-bf55-82bdacb5ae24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:32:10.071431 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bcc820-1c95-4e3b-bf55-82bdacb5ae24 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:32:10.163789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec36da0-79c1-4a57-91a1-316c75de0e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:32:10.165475 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec36da0-79c1-4a57-91a1-316c75de0e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:32:10.166110 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec36da0-79c1-4a57-91a1-316c75de0e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:32:10.166703 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec36da0-79c1-4a57-91a1-316c75de0e6a admin admin] PATH_INFO: `/v3/users/99c2c7023bc84ef99e2e8675e4c2372a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:32:10.169387 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec36da0-79c1-4a57-91a1-316c75de0e6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=99c2c7023bc84ef99e2e8675e4c2372a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:32:10.173333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec36da0-79c1-4a57-91a1-316c75de0e6a admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:32:10.211985 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:32:10.248568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-6ec36da0-79c1-4a57-91a1-316c75de0e6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99c2c7023bc84ef99e2e8675e4c2372a'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:10.249597 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-6ec36da0-79c1-4a57-91a1-316c75de0e6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99c2c7023bc84ef99e2e8675e4c2372a'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:10.272958 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-6ec36da0-79c1-4a57-91a1-316c75de0e6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99c2c7023bc84ef99e2e8675e4c2372a'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:10.287372 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-6ec36da0-79c1-4a57-91a1-316c75de0e6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99c2c7023bc84ef99e2e8675e4c2372a'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:10.300870 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-6ec36da0-79c1-4a57-91a1-316c75de0e6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99c2c7023bc84ef99e2e8675e4c2372a'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:10.308166 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1227/2469] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:32:10 2022] DELETE /identity/v3/users/99c2c7023bc84ef99e2e8675e4c2372a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:32:10.515671 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c095e62-131f-4dc3-98c4-da1eacda318f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:32:10.517148 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9c095e62-131f-4dc3-98c4-da1eacda318f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:32:10.540268 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c095e62-131f-4dc3-98c4-da1eacda318f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:32:10.607143 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747dd9a-5fed-4e2a-bbf0-c04868c92a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:32:10.608019 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747dd9a-5fed-4e2a-bbf0-c04868c92a92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:32:10.608302 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747dd9a-5fed-4e2a-bbf0-c04868c92a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:32:10.608578 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747dd9a-5fed-4e2a-bbf0-c04868c92a92 admin admin] PATH_INFO: `/v3/projects/6da0c0871bfc4f73802ab853d13dae58` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:32:10.609762 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747dd9a-5fed-4e2a-bbf0-c04868c92a92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6da0c0871bfc4f73802ab853d13dae58)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:32:10.611741 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747dd9a-5fed-4e2a-bbf0-c04868c92a92 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:32:10.661067 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3747dd9a-5fed-4e2a-bbf0-c04868c92a92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6da0c0871bfc4f73802ab853d13dae58', 'request_id': 'req-3747dd9a-5fed-4e2a-bbf0-c04868c92a92'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:10.667190 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3747dd9a-5fed-4e2a-bbf0-c04868c92a92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6da0c0871bfc4f73802ab853d13dae58', 'request_id': 'req-3747dd9a-5fed-4e2a-bbf0-c04868c92a92'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:10.675711 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3747dd9a-5fed-4e2a-bbf0-c04868c92a92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6da0c0871bfc4f73802ab853d13dae58', 'request_id': 'req-3747dd9a-5fed-4e2a-bbf0-c04868c92a92'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:10.687426 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3747dd9a-5fed-4e2a-bbf0-c04868c92a92 admin admin] The token cache is being invalidate because project 6da0c0871bfc4f73802ab853d13dae58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:32:10.687730 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3747dd9a-5fed-4e2a-bbf0-c04868c92a92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:10.688400 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3747dd9a-5fed-4e2a-bbf0-c04868c92a92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:10.690524 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1243/2470] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:32:10 2022] DELETE /identity/v3/projects/6da0c0871bfc4f73802ab853d13dae58 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:32:20.303958 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:32:20.684355 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=60,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:32:27.585902 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec36da0-79c1-4a57-91a1-316c75de0e6a admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:32:27.587588 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6ec36da0-79c1-4a57-91a1-316c75de0e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:32:27.670041 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec36da0-79c1-4a57-91a1-316c75de0e6a admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:32:27.747409 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a9c6b-263d-47b6-a03a-12e4921a83bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:32:27.748308 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a9c6b-263d-47b6-a03a-12e4921a83bd service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:32:27.748732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a9c6b-263d-47b6-a03a-12e4921a83bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:32:27.749046 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a9c6b-263d-47b6-a03a-12e4921a83bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:32:27.751443 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-825a9c6b-263d-47b6-a03a-12e4921a83bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:32:27.861872 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a9c6b-263d-47b6-a03a-12e4921a83bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:32:27.863420 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a9c6b-263d-47b6-a03a-12e4921a83bd service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:32:27.876951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1228/2471] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:32:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:32:29.187738 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747dd9a-5fed-4e2a-bbf0-c04868c92a92 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:32:29.189241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3747dd9a-5fed-4e2a-bbf0-c04868c92a92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:32:29.202132 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747dd9a-5fed-4e2a-bbf0-c04868c92a92 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:32:29.206935 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0fde6-1e6a-4968-9a1d-358bc8e85852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:32:29.207606 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0fde6-1e6a-4968-9a1d-358bc8e85852 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:32:29.207888 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0fde6-1e6a-4968-9a1d-358bc8e85852 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:32:29.208168 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0fde6-1e6a-4968-9a1d-358bc8e85852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:32:29.210061 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e8e0fde6-1e6a-4968-9a1d-358bc8e85852 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:32:29.227910 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0fde6-1e6a-4968-9a1d-358bc8e85852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:32:29.229366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0fde6-1e6a-4968-9a1d-358bc8e85852 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:32:29.242593 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1244/2472] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:32:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:32:35.316836 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a9c6b-263d-47b6-a03a-12e4921a83bd service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:32:35.328666 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a9c6b-263d-47b6-a03a-12e4921a83bd service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:32:35.334822 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd044069-3df4-4629-958d-9f7a344d2090 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:32:35.335845 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd044069-3df4-4629-958d-9f7a344d2090 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:32:35.336228 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd044069-3df4-4629-958d-9f7a344d2090 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:32:35.336520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd044069-3df4-4629-958d-9f7a344d2090 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:32:35.338825 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-fd044069-3df4-4629-958d-9f7a344d2090 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:32:35.433658 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:32:35.451377 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd044069-3df4-4629-958d-9f7a344d2090 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:32:35.454028 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd044069-3df4-4629-958d-9f7a344d2090 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:32:35.471251 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1229/2473] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:32:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:32:36.809275 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0fde6-1e6a-4968-9a1d-358bc8e85852 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:32:36.821023 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e8e0fde6-1e6a-4968-9a1d-358bc8e85852 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:32:36.844274 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0fde6-1e6a-4968-9a1d-358bc8e85852 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:32:36.850259 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9279525-5b41-4de7-a9e9-ce01c067e0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:32:36.851225 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9279525-5b41-4de7-a9e9-ce01c067e0a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:32:36.851499 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9279525-5b41-4de7-a9e9-ce01c067e0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:32:36.851781 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9279525-5b41-4de7-a9e9-ce01c067e0a4 admin admin] PATH_INFO: `/v3/users/ba02c8f4cbd544268cf39c6254127e88` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:32:36.853154 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9279525-5b41-4de7-a9e9-ce01c067e0a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba02c8f4cbd544268cf39c6254127e88)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:32:36.855369 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9279525-5b41-4de7-a9e9-ce01c067e0a4 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:32:36.951538 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f9279525-5b41-4de7-a9e9-ce01c067e0a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba02c8f4cbd544268cf39c6254127e88'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:36.952392 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f9279525-5b41-4de7-a9e9-ce01c067e0a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba02c8f4cbd544268cf39c6254127e88'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:36.998827 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f9279525-5b41-4de7-a9e9-ce01c067e0a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba02c8f4cbd544268cf39c6254127e88'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:37.019941 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f9279525-5b41-4de7-a9e9-ce01c067e0a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba02c8f4cbd544268cf39c6254127e88'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:37.022209 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f9279525-5b41-4de7-a9e9-ce01c067e0a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba02c8f4cbd544268cf39c6254127e88'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:37.056599 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1245/2474] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:32:36 2022] DELETE /identity/v3/users/ba02c8f4cbd544268cf39c6254127e88 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:32:37.411756 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd044069-3df4-4629-958d-9f7a344d2090 service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:32:37.428697 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd044069-3df4-4629-958d-9f7a344d2090 service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:32:37.512369 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74900b0-5fa8-4257-9bbf-ce00a21c3e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:32:37.513284 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74900b0-5fa8-4257-9bbf-ce00a21c3e73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:32:37.513504 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74900b0-5fa8-4257-9bbf-ce00a21c3e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:32:37.513910 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74900b0-5fa8-4257-9bbf-ce00a21c3e73 admin admin] PATH_INFO: `/v3/projects/8e21c256386246e5a2213d17018f1cca` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:32:37.515524 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74900b0-5fa8-4257-9bbf-ce00a21c3e73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e21c256386246e5a2213d17018f1cca)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:32:37.518184 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74900b0-5fa8-4257-9bbf-ce00a21c3e73 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:32:37.590046 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f74900b0-5fa8-4257-9bbf-ce00a21c3e73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e21c256386246e5a2213d17018f1cca', 'request_id': 'req-f74900b0-5fa8-4257-9bbf-ce00a21c3e73'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:37.601007 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f74900b0-5fa8-4257-9bbf-ce00a21c3e73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e21c256386246e5a2213d17018f1cca', 'request_id': 'req-f74900b0-5fa8-4257-9bbf-ce00a21c3e73'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:37.608023 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f74900b0-5fa8-4257-9bbf-ce00a21c3e73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e21c256386246e5a2213d17018f1cca', 'request_id': 'req-f74900b0-5fa8-4257-9bbf-ce00a21c3e73'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:37.621738 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f74900b0-5fa8-4257-9bbf-ce00a21c3e73 admin admin] The token cache is being invalidate because project 8e21c256386246e5a2213d17018f1cca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:32:37.622064 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f74900b0-5fa8-4257-9bbf-ce00a21c3e73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:37.622840 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f74900b0-5fa8-4257-9bbf-ce00a21c3e73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:37.624478 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1230/2475] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:32:37 2022] DELETE /identity/v3/projects/8e21c256386246e5a2213d17018f1cca => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:32:39.958303 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9279525-5b41-4de7-a9e9-ce01c067e0a4 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:32:39.961922 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f9279525-5b41-4de7-a9e9-ce01c067e0a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:32:39.985040 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9279525-5b41-4de7-a9e9-ce01c067e0a4 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:32:40.065878 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14e3cb-a306-4600-9f82-be42422b150b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:32:40.066827 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14e3cb-a306-4600-9f82-be42422b150b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:32:40.067111 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14e3cb-a306-4600-9f82-be42422b150b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:32:40.067388 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14e3cb-a306-4600-9f82-be42422b150b admin admin] PATH_INFO: `/v3/users/4156a6ff075847769c0d35cfeb1b3af0` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:32:40.068684 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e14e3cb-a306-4600-9f82-be42422b150b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4156a6ff075847769c0d35cfeb1b3af0)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:32:40.070700 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e14e3cb-a306-4600-9f82-be42422b150b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:32:40.157928 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5e14e3cb-a306-4600-9f82-be42422b150b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4156a6ff075847769c0d35cfeb1b3af0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:40.158840 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5e14e3cb-a306-4600-9f82-be42422b150b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4156a6ff075847769c0d35cfeb1b3af0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:40.175247 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:32:40.178498 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5e14e3cb-a306-4600-9f82-be42422b150b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4156a6ff075847769c0d35cfeb1b3af0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:40.190043 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5e14e3cb-a306-4600-9f82-be42422b150b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4156a6ff075847769c0d35cfeb1b3af0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:40.190713 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5e14e3cb-a306-4600-9f82-be42422b150b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4156a6ff075847769c0d35cfeb1b3af0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:40.212100 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1246/2476] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:32:39 2022] DELETE /identity/v3/users/4156a6ff075847769c0d35cfeb1b3af0 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:32:40.425236 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74900b0-5fa8-4257-9bbf-ce00a21c3e73 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:32:40.427099 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f74900b0-5fa8-4257-9bbf-ce00a21c3e73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:32:40.442469 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74900b0-5fa8-4257-9bbf-ce00a21c3e73 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:32:40.514100 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543508c9-0673-47ae-9abb-85dddb12bd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:32:40.514992 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543508c9-0673-47ae-9abb-85dddb12bd22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:32:40.515275 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543508c9-0673-47ae-9abb-85dddb12bd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:32:40.515554 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543508c9-0673-47ae-9abb-85dddb12bd22 admin admin] PATH_INFO: `/v3/projects/42cd86feb1264918ad5faa15c3d140b9` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:32:40.517011 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543508c9-0673-47ae-9abb-85dddb12bd22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42cd86feb1264918ad5faa15c3d140b9)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:32:40.519037 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543508c9-0673-47ae-9abb-85dddb12bd22 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:32:40.553937 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:32:40.583236 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-543508c9-0673-47ae-9abb-85dddb12bd22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42cd86feb1264918ad5faa15c3d140b9', 'request_id': 'req-543508c9-0673-47ae-9abb-85dddb12bd22'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:40.591874 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-543508c9-0673-47ae-9abb-85dddb12bd22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42cd86feb1264918ad5faa15c3d140b9', 'request_id': 'req-543508c9-0673-47ae-9abb-85dddb12bd22'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:40.598620 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-543508c9-0673-47ae-9abb-85dddb12bd22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42cd86feb1264918ad5faa15c3d140b9', 'request_id': 'req-543508c9-0673-47ae-9abb-85dddb12bd22'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:40.612676 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-543508c9-0673-47ae-9abb-85dddb12bd22 admin admin] The token cache is being invalidate because project 42cd86feb1264918ad5faa15c3d140b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:32:40.612962 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-543508c9-0673-47ae-9abb-85dddb12bd22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:40.613686 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-543508c9-0673-47ae-9abb-85dddb12bd22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:32:40.615393 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1231/2477] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:32:40 2022] DELETE /identity/v3/projects/42cd86feb1264918ad5faa15c3d140b9 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:32:40.620849 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9436861-da6d-40b4-94d0-e870e7fca89a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:32:40.621138 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9436861-da6d-40b4-94d0-e870e7fca89a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:32:40.621421 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9436861-da6d-40b4-94d0-e870e7fca89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:32:40.641811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d9436861-da6d-40b4-94d0-e870e7fca89a None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:32:40.643171 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d9436861-da6d-40b4-94d0-e870e7fca89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:32:40.715039 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1247/2478] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:32:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:32:40.723925 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539893cc-c471-403b-b81a-c6db8e63f832 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:32:40.724230 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539893cc-c471-403b-b81a-c6db8e63f832 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:32:40.724515 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539893cc-c471-403b-b81a-c6db8e63f832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:32:40.744842 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-539893cc-c471-403b-b81a-c6db8e63f832 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:32:40.746135 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-539893cc-c471-403b-b81a-c6db8e63f832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:32:40.754563 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1232/2479] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:32:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:32:40.759217 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9436861-da6d-40b4-94d0-e870e7fca89a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:32:40.770175 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9436861-da6d-40b4-94d0-e870e7fca89a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:32:40.774871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2020b4b-a4b7-4d2b-9894-d528c1691131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:32:40.775567 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2020b4b-a4b7-4d2b-9894-d528c1691131 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:32:40.775851 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2020b4b-a4b7-4d2b-9894-d528c1691131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:32:40.776128 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2020b4b-a4b7-4d2b-9894-d528c1691131 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:32:40.776884 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2020b4b-a4b7-4d2b-9894-d528c1691131 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:32:40.777194 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2020b4b-a4b7-4d2b-9894-d528c1691131 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:32:40.778920 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2020b4b-a4b7-4d2b-9894-d528c1691131 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:32:40.793429 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1248/2480] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:32:40.798701 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539893cc-c471-403b-b81a-c6db8e63f832 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:32:40.808966 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539893cc-c471-403b-b81a-c6db8e63f832 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:32:40.814993 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7bed2-6f14-45ff-b1bf-23fc1e261037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:32:40.815790 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7bed2-6f14-45ff-b1bf-23fc1e261037 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:32:40.816174 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7bed2-6f14-45ff-b1bf-23fc1e261037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:32:40.816555 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7bed2-6f14-45ff-b1bf-23fc1e261037 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:32:40.817383 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7bed2-6f14-45ff-b1bf-23fc1e261037 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:32:40.819599 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7bed2-6f14-45ff-b1bf-23fc1e261037 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:32:40.850751 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1233/2481] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:32:40 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:32:40.855312 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2020b4b-a4b7-4d2b-9894-d528c1691131 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:32:40.866201 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2020b4b-a4b7-4d2b-9894-d528c1691131 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:32:40.933945 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f206b2-4d39-45fd-9c65-fad68855d85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:32:40.934784 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f206b2-4d39-45fd-9c65-fad68855d85c admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:32:40.934996 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f206b2-4d39-45fd-9c65-fad68855d85c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:32:40.935363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f206b2-4d39-45fd-9c65-fad68855d85c admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:32:40.936127 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f206b2-4d39-45fd-9c65-fad68855d85c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:32:40.938418 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f206b2-4d39-45fd-9c65-fad68855d85c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:32:40.964916 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1249/2482] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:32:40 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:32:40.970655 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7bed2-6f14-45ff-b1bf-23fc1e261037 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:32:40.985906 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7bed2-6f14-45ff-b1bf-23fc1e261037 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:32:40.991180 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5baa0-ea27-4573-b5ef-3d4cbd50293b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:32:40.991878 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5baa0-ea27-4573-b5ef-3d4cbd50293b admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:32:40.992159 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5baa0-ea27-4573-b5ef-3d4cbd50293b admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:32:40.992446 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5baa0-ea27-4573-b5ef-3d4cbd50293b admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:32:40.993176 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5baa0-ea27-4573-b5ef-3d4cbd50293b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:32:40.994844 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5baa0-ea27-4573-b5ef-3d4cbd50293b admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:32:41.006800 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1234/2483] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:32:41.013406 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f206b2-4d39-45fd-9c65-fad68855d85c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:32:41.031510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f206b2-4d39-45fd-9c65-fad68855d85c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:32:41.039058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e63821-fab8-46a0-b796-3fb27d77038c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:32:41.039786 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e63821-fab8-46a0-b796-3fb27d77038c admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:32:41.040104 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e63821-fab8-46a0-b796-3fb27d77038c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:32:41.040388 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e63821-fab8-46a0-b796-3fb27d77038c admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:32:41.041213 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e63821-fab8-46a0-b796-3fb27d77038c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:32:41.042910 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e63821-fab8-46a0-b796-3fb27d77038c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:32:41.062251 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1250/2484] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:32:41.064303 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5baa0-ea27-4573-b5ef-3d4cbd50293b admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:32:41.081546 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5baa0-ea27-4573-b5ef-3d4cbd50293b admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:32:41.090920 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5688a-65c3-4e72-903b-bcab536bbf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:32:41.092562 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5688a-65c3-4e72-903b-bcab536bbf9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:32:41.093056 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5688a-65c3-4e72-903b-bcab536bbf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:32:41.093559 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5688a-65c3-4e72-903b-bcab536bbf9e admin admin] PATH_INFO: `/v3/projects/db352bbd23484a068a7badc327d9f6fa/users/84e5577e32e545c0a060cce6238208eb/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:32:41.116279 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5688a-65c3-4e72-903b-bcab536bbf9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=db352bbd23484a068a7badc327d9f6fa, user_id=84e5577e32e545c0a060cce6238208eb, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:32:41.119122 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5688a-65c3-4e72-903b-bcab536bbf9e admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:32:41.137823 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1235/2485] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:32:41 2022] PUT /identity/v3/projects/db352bbd23484a068a7badc327d9f6fa/users/84e5577e32e545c0a060cce6238208eb/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:32:41.145540 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8463b-129e-48bc-a4cc-2dda3428cdda None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:32:41.145991 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8463b-129e-48bc-a4cc-2dda3428cdda None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:32:41.146373 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8463b-129e-48bc-a4cc-2dda3428cdda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:32:41.176618 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-72e8463b-129e-48bc-a4cc-2dda3428cdda None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:32:41.178211 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-72e8463b-129e-48bc-a4cc-2dda3428cdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:32:41.244500 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:32:41.273698 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1251/2486] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:32:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:32:41.288120 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5688a-65c3-4e72-903b-bcab536bbf9e admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:32:41.290801 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-04d5688a-65c3-4e72-903b-bcab536bbf9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:32:41.390031 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5688a-65c3-4e72-903b-bcab536bbf9e admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:32:41.396752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0969a-d829-408c-a1d2-3193efe748dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:32:41.397862 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0969a-d829-408c-a1d2-3193efe748dc service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:32:41.398577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0969a-d829-408c-a1d2-3193efe748dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:32:41.399067 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0969a-d829-408c-a1d2-3193efe748dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:32:41.420549 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc0969a-d829-408c-a1d2-3193efe748dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:32:41.422117 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc0969a-d829-408c-a1d2-3193efe748dc service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:32:41.435183 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1236/2487] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:32:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:32:44.771958 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8463b-129e-48bc-a4cc-2dda3428cdda None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:32:44.774416 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-72e8463b-129e-48bc-a4cc-2dda3428cdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:32:44.950810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8463b-129e-48bc-a4cc-2dda3428cdda None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:32:44.971902 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2193d5-8143-4f35-859a-5728054b13b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:32:44.974354 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2193d5-8143-4f35-859a-5728054b13b0 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:32:44.975455 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2193d5-8143-4f35-859a-5728054b13b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:32:44.976622 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2193d5-8143-4f35-859a-5728054b13b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:32:44.981200 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ee2193d5-8143-4f35-859a-5728054b13b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:32:45.207815 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2193d5-8143-4f35-859a-5728054b13b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:32:45.214227 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2193d5-8143-4f35-859a-5728054b13b0 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:32:45.245408 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1252/2488] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:32:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:32:48.818677 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe223d9-8d09-4713-ae21-829a294114de None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:32:48.819464 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe223d9-8d09-4713-ae21-829a294114de None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:32:48.819570 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe223d9-8d09-4713-ae21-829a294114de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:32:48.878826 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-cfe223d9-8d09-4713-ae21-829a294114de None None] MFA Rules not processed for user `84e5577e32e545c0a060cce6238208eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:32:48.883690 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-cfe223d9-8d09-4713-ae21-829a294114de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:32:48.962349 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:32:49.007628 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1237/2489] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:32:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:32:49.033830 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2193d5-8143-4f35-859a-5728054b13b0 service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:32:49.067689 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2193d5-8143-4f35-859a-5728054b13b0 service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:32:49.074963 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59db4f-554f-4d37-8407-0355288ffc19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:32:49.075955 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59db4f-554f-4d37-8407-0355288ffc19 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:32:49.076417 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59db4f-554f-4d37-8407-0355288ffc19 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:32:49.076851 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59db4f-554f-4d37-8407-0355288ffc19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:32:49.091617 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59db4f-554f-4d37-8407-0355288ffc19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:32:49.095568 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59db4f-554f-4d37-8407-0355288ffc19 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:32:49.126134 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1253/2490] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:32:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:32:51.461880 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a1671-f8cf-4f94-b5cb-ed74c4ae31ef None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:32:51.462492 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a1671-f8cf-4f94-b5cb-ed74c4ae31ef None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:32:51.462899 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a1671-f8cf-4f94-b5cb-ed74c4ae31ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:32:51.487930 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-d09a1671-f8cf-4f94-b5cb-ed74c4ae31ef None None] MFA Rules not processed for user `84e5577e32e545c0a060cce6238208eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:32:51.489318 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d09a1671-f8cf-4f94-b5cb-ed74c4ae31ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:32:51.497771 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1238/2491] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:32:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:32:51.928019 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59db4f-554f-4d37-8407-0355288ffc19 service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:32:51.941016 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59db4f-554f-4d37-8407-0355288ffc19 service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:32:51.945763 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4397b3-736a-4f0e-90a9-d72a68b16ad2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:32:51.946581 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4397b3-736a-4f0e-90a9-d72a68b16ad2 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:32:51.946848 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4397b3-736a-4f0e-90a9-d72a68b16ad2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:32:51.947159 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4397b3-736a-4f0e-90a9-d72a68b16ad2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:32:51.949384 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-dd4397b3-736a-4f0e-90a9-d72a68b16ad2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:32:51.961323 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4397b3-736a-4f0e-90a9-d72a68b16ad2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:32:51.963829 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4397b3-736a-4f0e-90a9-d72a68b16ad2 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:32:51.977283 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1254/2492] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:32:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:32:52.402388 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a1671-f8cf-4f94-b5cb-ed74c4ae31ef None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:32:52.404360 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d09a1671-f8cf-4f94-b5cb-ed74c4ae31ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:32:52.517055 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a1671-f8cf-4f94-b5cb-ed74c4ae31ef None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:32:52.523096 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2730d84-42f3-4878-a8a3-2b68712f1ac4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0433f6219478476286ea27c5c82d41a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:32:52.523726 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2730d84-42f3-4878-a8a3-2b68712f1ac4 service placement] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:32:52.524102 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2730d84-42f3-4878-a8a3-2b68712f1ac4 service placement] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:32:52.524420 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2730d84-42f3-4878-a8a3-2b68712f1ac4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:32:52.526637 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a2730d84-42f3-4878-a8a3-2b68712f1ac4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:32:52.544391 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2730d84-42f3-4878-a8a3-2b68712f1ac4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:32:52.547421 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2730d84-42f3-4878-a8a3-2b68712f1ac4 service placement] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:32:52.565010 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1239/2493] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:32:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:32:54.324916 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4397b3-736a-4f0e-90a9-d72a68b16ad2 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:32:54.338468 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4397b3-736a-4f0e-90a9-d72a68b16ad2 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:32:54.344639 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bf03a-58c2-4bc5-bfcf-010cb13276ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:32:54.345943 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bf03a-58c2-4bc5-bfcf-010cb13276ed service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:32:54.346765 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bf03a-58c2-4bc5-bfcf-010cb13276ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:32:54.347334 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bf03a-58c2-4bc5-bfcf-010cb13276ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:32:54.350794 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5d7bf03a-58c2-4bc5-bfcf-010cb13276ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:32:54.367373 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bf03a-58c2-4bc5-bfcf-010cb13276ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:32:54.369184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bf03a-58c2-4bc5-bfcf-010cb13276ed service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:32:54.388470 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1255/2494] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:32:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:32:55.020193 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2730d84-42f3-4878-a8a3-2b68712f1ac4 service placement] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:32:55.023095 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a2730d84-42f3-4878-a8a3-2b68712f1ac4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:32:55.044338 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2730d84-42f3-4878-a8a3-2b68712f1ac4 service placement] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:32:55.049846 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee3559-e59b-413c-a148-0cbac5ea694a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:32:55.050987 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee3559-e59b-413c-a148-0cbac5ea694a service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:32:55.051375 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee3559-e59b-413c-a148-0cbac5ea694a service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:32:55.051772 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee3559-e59b-413c-a148-0cbac5ea694a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:32:55.054659 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-20ee3559-e59b-413c-a148-0cbac5ea694a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:32:55.070568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee3559-e59b-413c-a148-0cbac5ea694a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:32:55.073604 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee3559-e59b-413c-a148-0cbac5ea694a service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:32:55.090135 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1240/2495] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:32:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:32:59.891963 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bf03a-58c2-4bc5-bfcf-010cb13276ed service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:32:59.918318 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bf03a-58c2-4bc5-bfcf-010cb13276ed service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:32:59.927813 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37aa46d-12b8-4b8a-a39f-078b6430ef9a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0433f6219478476286ea27c5c82d41a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:32:59.929398 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37aa46d-12b8-4b8a-a39f-078b6430ef9a service placement] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:32:59.930074 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37aa46d-12b8-4b8a-a39f-078b6430ef9a service placement] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:32:59.930643 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37aa46d-12b8-4b8a-a39f-078b6430ef9a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:32:59.933868 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b37aa46d-12b8-4b8a-a39f-078b6430ef9a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:32:59.956424 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37aa46d-12b8-4b8a-a39f-078b6430ef9a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:32:59.959545 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37aa46d-12b8-4b8a-a39f-078b6430ef9a service placement] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:32:59.979072 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1256/2496] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:32:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:32:59.992596 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee3559-e59b-413c-a148-0cbac5ea694a service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:32:59.996232 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-20ee3559-e59b-413c-a148-0cbac5ea694a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:00.017402 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee3559-e59b-413c-a148-0cbac5ea694a service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:00.022967 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e1c09-21e1-438b-a82c-8bd1b5fb2e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:00.023979 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e1c09-21e1-438b-a82c-8bd1b5fb2e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:00.024330 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e1c09-21e1-438b-a82c-8bd1b5fb2e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:00.024677 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e1c09-21e1-438b-a82c-8bd1b5fb2e02 admin admin] PATH_INFO: `/v3/users/df8135d434a6499db18f03e1ec293a05` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:00.026153 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e1c09-21e1-438b-a82c-8bd1b5fb2e02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df8135d434a6499db18f03e1ec293a05)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:00.028335 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e1c09-21e1-438b-a82c-8bd1b5fb2e02 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:00.100894 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-288e1c09-21e1-438b-a82c-8bd1b5fb2e02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df8135d434a6499db18f03e1ec293a05'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:00.102139 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-288e1c09-21e1-438b-a82c-8bd1b5fb2e02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df8135d434a6499db18f03e1ec293a05'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:00.125031 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-288e1c09-21e1-438b-a82c-8bd1b5fb2e02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df8135d434a6499db18f03e1ec293a05'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:00.138767 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-288e1c09-21e1-438b-a82c-8bd1b5fb2e02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df8135d434a6499db18f03e1ec293a05'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:00.150638 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-288e1c09-21e1-438b-a82c-8bd1b5fb2e02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df8135d434a6499db18f03e1ec293a05'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:00.159591 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1241/2497] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:32:59 2022] DELETE /identity/v3/users/df8135d434a6499db18f03e1ec293a05 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:33:00.375901 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37aa46d-12b8-4b8a-a39f-078b6430ef9a service placement] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:00.400242 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37aa46d-12b8-4b8a-a39f-078b6430ef9a service placement] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:00.440329 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:33:00.477694 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83566ba-6dc6-4c48-b111-f23de2408532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:00.478541 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83566ba-6dc6-4c48-b111-f23de2408532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:00.478833 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83566ba-6dc6-4c48-b111-f23de2408532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:00.479120 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83566ba-6dc6-4c48-b111-f23de2408532 admin admin] PATH_INFO: `/v3/projects/36184dd2a0a74fa3bbb38107f7863f3f` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:00.480596 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83566ba-6dc6-4c48-b111-f23de2408532 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36184dd2a0a74fa3bbb38107f7863f3f)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:00.482611 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83566ba-6dc6-4c48-b111-f23de2408532 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:00.538476 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d83566ba-6dc6-4c48-b111-f23de2408532 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36184dd2a0a74fa3bbb38107f7863f3f', 'request_id': 'req-d83566ba-6dc6-4c48-b111-f23de2408532'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:00.545653 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d83566ba-6dc6-4c48-b111-f23de2408532 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36184dd2a0a74fa3bbb38107f7863f3f', 'request_id': 'req-d83566ba-6dc6-4c48-b111-f23de2408532'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:00.555527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d83566ba-6dc6-4c48-b111-f23de2408532 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36184dd2a0a74fa3bbb38107f7863f3f', 'request_id': 'req-d83566ba-6dc6-4c48-b111-f23de2408532'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:00.570527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d83566ba-6dc6-4c48-b111-f23de2408532 admin admin] The token cache is being invalidate because project 36184dd2a0a74fa3bbb38107f7863f3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:33:00.570924 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d83566ba-6dc6-4c48-b111-f23de2408532 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:00.571756 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d83566ba-6dc6-4c48-b111-f23de2408532 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:00.573700 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1257/2498] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:33:00 2022] DELETE /identity/v3/projects/36184dd2a0a74fa3bbb38107f7863f3f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:33:00.580671 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480d0bc-e493-47a7-b44e-6b8cf01fc36e None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:00.580982 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480d0bc-e493-47a7-b44e-6b8cf01fc36e None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:00.581259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480d0bc-e493-47a7-b44e-6b8cf01fc36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:00.601128 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-2480d0bc-e493-47a7-b44e-6b8cf01fc36e None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:33:00.602661 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-2480d0bc-e493-47a7-b44e-6b8cf01fc36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:00.625786 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:33:00.681683 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1242/2499] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:33:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:33:00.692227 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eadbce4-6280-4716-b070-88e8fb0cfe8d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:00.692714 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eadbce4-6280-4716-b070-88e8fb0cfe8d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:00.693191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eadbce4-6280-4716-b070-88e8fb0cfe8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:00.726493 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-1eadbce4-6280-4716-b070-88e8fb0cfe8d None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:33:00.728841 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1eadbce4-6280-4716-b070-88e8fb0cfe8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:00.744050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1258/2500] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:33:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:33:00.748851 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480d0bc-e493-47a7-b44e-6b8cf01fc36e None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:00.762020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480d0bc-e493-47a7-b44e-6b8cf01fc36e None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:00.767522 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e5bb8-e28e-497b-8e80-9def01202f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:00.768212 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e5bb8-e28e-497b-8e80-9def01202f7a admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:00.768499 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e5bb8-e28e-497b-8e80-9def01202f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:00.768779 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e5bb8-e28e-497b-8e80-9def01202f7a admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:00.769520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e5bb8-e28e-497b-8e80-9def01202f7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:33:00.769859 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e5bb8-e28e-497b-8e80-9def01202f7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:00.771789 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e5bb8-e28e-497b-8e80-9def01202f7a admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:00.786232 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1243/2501] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:33:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:33:00.792977 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eadbce4-6280-4716-b070-88e8fb0cfe8d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:00.803745 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eadbce4-6280-4716-b070-88e8fb0cfe8d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:00.808688 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16a0e2-5378-4188-bff0-584a3e05d1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:00.809371 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16a0e2-5378-4188-bff0-584a3e05d1f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:00.809652 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16a0e2-5378-4188-bff0-584a3e05d1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:00.809929 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16a0e2-5378-4188-bff0-584a3e05d1f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:00.810693 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16a0e2-5378-4188-bff0-584a3e05d1f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:00.813237 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16a0e2-5378-4188-bff0-584a3e05d1f4 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:00.845821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1259/2502] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:33:00 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:33:00.849305 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e5bb8-e28e-497b-8e80-9def01202f7a admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:00.861334 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e5bb8-e28e-497b-8e80-9def01202f7a admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:00.938526 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a62fe1-850e-4350-9fac-91bf35f01490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:00.939224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a62fe1-850e-4350-9fac-91bf35f01490 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:00.939508 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a62fe1-850e-4350-9fac-91bf35f01490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:00.939790 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a62fe1-850e-4350-9fac-91bf35f01490 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:00.940517 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a62fe1-850e-4350-9fac-91bf35f01490 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:00.942882 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a62fe1-850e-4350-9fac-91bf35f01490 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:00.970458 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1244/2503] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:33:00 2022] POST /identity/v3/users => generated 291 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:33:00.975770 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16a0e2-5378-4188-bff0-584a3e05d1f4 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:00.999353 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16a0e2-5378-4188-bff0-584a3e05d1f4 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:01.010397 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55930aed-8e06-4bff-8a92-d553cc7c3e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:01.011234 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55930aed-8e06-4bff-8a92-d553cc7c3e3d admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:01.012130 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55930aed-8e06-4bff-8a92-d553cc7c3e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:01.013141 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55930aed-8e06-4bff-8a92-d553cc7c3e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:01.015012 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55930aed-8e06-4bff-8a92-d553cc7c3e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:01.019012 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55930aed-8e06-4bff-8a92-d553cc7c3e3d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:01.043498 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1260/2504] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:33:01.049577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a62fe1-850e-4350-9fac-91bf35f01490 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:01.071936 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a62fe1-850e-4350-9fac-91bf35f01490 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:01.082472 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4677b-ab90-4bdb-84ab-c5af726f50a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:01.084601 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4677b-ab90-4bdb-84ab-c5af726f50a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:01.084601 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4677b-ab90-4bdb-84ab-c5af726f50a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:01.085496 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4677b-ab90-4bdb-84ab-c5af726f50a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:01.086863 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f4677b-ab90-4bdb-84ab-c5af726f50a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:01.090028 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f4677b-ab90-4bdb-84ab-c5af726f50a5 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:01.111127 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1245/2505] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:33:01.116545 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55930aed-8e06-4bff-8a92-d553cc7c3e3d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:01.141273 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55930aed-8e06-4bff-8a92-d553cc7c3e3d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:01.160972 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1dea8c-c605-4297-a97c-132e296162a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:01.169245 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4677b-ab90-4bdb-84ab-c5af726f50a5 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:01.170861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1dea8c-c605-4297-a97c-132e296162a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:01.171132 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1dea8c-c605-4297-a97c-132e296162a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:01.171301 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1dea8c-c605-4297-a97c-132e296162a4 admin admin] PATH_INFO: `/v3/projects/689099b2b4c84c3d8b67cdba4a81926c/users/80e3c44f37de49469ff99291bb8986a0/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:01.173467 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-95f4677b-ab90-4bdb-84ab-c5af726f50a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:01.229097 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1dea8c-c605-4297-a97c-132e296162a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=689099b2b4c84c3d8b67cdba4a81926c, user_id=80e3c44f37de49469ff99291bb8986a0, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:01.237283 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1dea8c-c605-4297-a97c-132e296162a4 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:01.277862 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1261/2506] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:33:01 2022] PUT /identity/v3/projects/689099b2b4c84c3d8b67cdba4a81926c/users/80e3c44f37de49469ff99291bb8986a0/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:33:01.289721 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4677b-ab90-4bdb-84ab-c5af726f50a5 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:01.297884 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e5a5e-f896-48fd-b4f2-df0abca02f08 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:01.298956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e5a5e-f896-48fd-b4f2-df0abca02f08 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:01.299380 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e5a5e-f896-48fd-b4f2-df0abca02f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:01.338731 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:33:01.357713 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-9f6e5a5e-f896-48fd-b4f2-df0abca02f08 None None] MFA Rules not processed for user `80e3c44f37de49469ff99291bb8986a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:33:01.360227 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9f6e5a5e-f896-48fd-b4f2-df0abca02f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:01.424711 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e0355-4594-45d2-b052-821c18a3b35c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:01.425398 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e0355-4594-45d2-b052-821c18a3b35c service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:01.426428 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e0355-4594-45d2-b052-821c18a3b35c service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:01.426743 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e0355-4594-45d2-b052-821c18a3b35c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:01.429004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-806e0355-4594-45d2-b052-821c18a3b35c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:01.442375 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e0355-4594-45d2-b052-821c18a3b35c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:01.444325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e0355-4594-45d2-b052-821c18a3b35c service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:01.459448 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1246/2507] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:33:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:33:01.474314 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:33:01.501205 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1262/2508] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:33:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:33:01.506274 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e0355-4594-45d2-b052-821c18a3b35c service nova] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:01.582378 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e0355-4594-45d2-b052-821c18a3b35c service nova] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:01.588353 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e9a7c-6527-464e-8d4a-e93535be24ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:01.589201 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e9a7c-6527-464e-8d4a-e93535be24ef admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:01.589783 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e9a7c-6527-464e-8d4a-e93535be24ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:01.589783 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e9a7c-6527-464e-8d4a-e93535be24ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:01.590692 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e9a7c-6527-464e-8d4a-e93535be24ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:01.592776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e9a7c-6527-464e-8d4a-e93535be24ef admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:01.626255 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1247/2509] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:33:01 2022] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:33:01.630801 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e5a5e-f896-48fd-b4f2-df0abca02f08 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:01.648343 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e5a5e-f896-48fd-b4f2-df0abca02f08 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:01.736620 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9b05e-f2e5-4bf4-b02c-f15f753920e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:01.737809 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9b05e-f2e5-4bf4-b02c-f15f753920e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:01.738520 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9b05e-f2e5-4bf4-b02c-f15f753920e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:01.739006 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9b05e-f2e5-4bf4-b02c-f15f753920e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:01.740406 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9b05e-f2e5-4bf4-b02c-f15f753920e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:01.744706 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9b05e-f2e5-4bf4-b02c-f15f753920e2 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:01.773952 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1263/2510] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:33:01 2022] POST /identity/v3/users => generated 296 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:33:01.778042 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e9a7c-6527-464e-8d4a-e93535be24ef admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:01.790602 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e9a7c-6527-464e-8d4a-e93535be24ef admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:01.796304 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f16d37-6ee2-468f-a5d3-1e271eaefb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:01.797567 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f16d37-6ee2-468f-a5d3-1e271eaefb8c admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:01.797849 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f16d37-6ee2-468f-a5d3-1e271eaefb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:01.798189 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f16d37-6ee2-468f-a5d3-1e271eaefb8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:01.798921 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f16d37-6ee2-468f-a5d3-1e271eaefb8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:01.800594 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f16d37-6ee2-468f-a5d3-1e271eaefb8c admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:01.814190 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1248/2511] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 04:33:01.819244 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9b05e-f2e5-4bf4-b02c-f15f753920e2 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:01.836572 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9b05e-f2e5-4bf4-b02c-f15f753920e2 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:01.841933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a8fda-45ac-4407-8071-98e470cd5676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:01.843181 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a8fda-45ac-4407-8071-98e470cd5676 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:01.843573 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a8fda-45ac-4407-8071-98e470cd5676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:01.843979 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a8fda-45ac-4407-8071-98e470cd5676 admin admin] PATH_INFO: `/v3/projects/84946fa24b90429b82caf0e0c532c238/users/2e1a01888e8d411ea47d4d025d139438/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:01.863882 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a8fda-45ac-4407-8071-98e470cd5676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84946fa24b90429b82caf0e0c532c238, user_id=2e1a01888e8d411ea47d4d025d139438, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:01.867075 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a8fda-45ac-4407-8071-98e470cd5676 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:01.889096 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1264/2512] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:33:01 2022] PUT /identity/v3/projects/84946fa24b90429b82caf0e0c532c238/users/2e1a01888e8d411ea47d4d025d139438/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:33:01.893957 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f16d37-6ee2-468f-a5d3-1e271eaefb8c admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:01.907156 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f16d37-6ee2-468f-a5d3-1e271eaefb8c admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:01.974936 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998338f-0c07-44c9-b958-b9ebe9ceda63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:01.975706 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998338f-0c07-44c9-b958-b9ebe9ceda63 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:01.976029 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998338f-0c07-44c9-b958-b9ebe9ceda63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:01.976349 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998338f-0c07-44c9-b958-b9ebe9ceda63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:01.977216 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998338f-0c07-44c9-b958-b9ebe9ceda63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:01.978965 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998338f-0c07-44c9-b958-b9ebe9ceda63 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:01.991076 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1249/2513] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:33:01.995700 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a8fda-45ac-4407-8071-98e470cd5676 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:02.008012 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a8fda-45ac-4407-8071-98e470cd5676 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:02.013123 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596503ba-1abb-42a2-a4ab-08c6cd577ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:02.014024 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596503ba-1abb-42a2-a4ab-08c6cd577ab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:02.014357 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596503ba-1abb-42a2-a4ab-08c6cd577ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:02.014681 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596503ba-1abb-42a2-a4ab-08c6cd577ab5 admin admin] PATH_INFO: `/v3/projects/84946fa24b90429b82caf0e0c532c238/users/2e1a01888e8d411ea47d4d025d139438/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:02.017574 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596503ba-1abb-42a2-a4ab-08c6cd577ab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84946fa24b90429b82caf0e0c532c238, user_id=2e1a01888e8d411ea47d4d025d139438, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:02.020487 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596503ba-1abb-42a2-a4ab-08c6cd577ab5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:02.033250 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1265/2514] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:33:01 2022] PUT /identity/v3/projects/84946fa24b90429b82caf0e0c532c238/users/2e1a01888e8d411ea47d4d025d139438/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:33:02.046216 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d3322-992d-4eb2-af46-b74ba02901d2 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:02.046556 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d3322-992d-4eb2-af46-b74ba02901d2 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:02.047422 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d3322-992d-4eb2-af46-b74ba02901d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:02.079139 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-205d3322-992d-4eb2-af46-b74ba02901d2 None None] MFA Rules not processed for user `2e1a01888e8d411ea47d4d025d139438`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:33:02.080837 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-205d3322-992d-4eb2-af46-b74ba02901d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:02.092601 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:33:02.171284 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1250/2515] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:33:02 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:33:02.184006 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596503ba-1abb-42a2-a4ab-08c6cd577ab5 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:02.186189 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-596503ba-1abb-42a2-a4ab-08c6cd577ab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:02.265380 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596503ba-1abb-42a2-a4ab-08c6cd577ab5 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:02.271099 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3aecc5-0cd6-40f2-8b89-958e9828a092 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:02.272035 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3aecc5-0cd6-40f2-8b89-958e9828a092 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:02.272505 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3aecc5-0cd6-40f2-8b89-958e9828a092 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:02.272913 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3aecc5-0cd6-40f2-8b89-958e9828a092 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:02.285752 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3aecc5-0cd6-40f2-8b89-958e9828a092 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:02.287719 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3aecc5-0cd6-40f2-8b89-958e9828a092 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:02.299360 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1266/2516] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:33:02 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:33:02.391541 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d3322-992d-4eb2-af46-b74ba02901d2 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:02.403242 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d3322-992d-4eb2-af46-b74ba02901d2 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:02.407840 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf99e7-9647-4214-bb44-f7692f3c3d2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:02.408531 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf99e7-9647-4214-bb44-f7692f3c3d2e service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:02.408819 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf99e7-9647-4214-bb44-f7692f3c3d2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:02.409097 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf99e7-9647-4214-bb44-f7692f3c3d2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:02.480895 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf99e7-9647-4214-bb44-f7692f3c3d2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:02.482402 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf99e7-9647-4214-bb44-f7692f3c3d2e service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:02.494168 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1251/2517] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:33:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:33:05.547418 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3aecc5-0cd6-40f2-8b89-958e9828a092 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:05.549009 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8b3aecc5-0cd6-40f2-8b89-958e9828a092 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:05.622324 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:33:05.664081 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3aecc5-0cd6-40f2-8b89-958e9828a092 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:05.670512 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83870e33-3098-49ef-9130-9256d3323b58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:05.671193 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83870e33-3098-49ef-9130-9256d3323b58 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:05.671487 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83870e33-3098-49ef-9130-9256d3323b58 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:05.671808 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83870e33-3098-49ef-9130-9256d3323b58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:05.674058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-83870e33-3098-49ef-9130-9256d3323b58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:05.695174 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83870e33-3098-49ef-9130-9256d3323b58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:05.696970 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83870e33-3098-49ef-9130-9256d3323b58 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:05.718776 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1267/2518] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:33:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:33:09.896225 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf99e7-9647-4214-bb44-f7692f3c3d2e service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:10.011057 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf99e7-9647-4214-bb44-f7692f3c3d2e service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:10.021381 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f589fe-a032-419d-ab38-f95f9f509380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:10.023000 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f589fe-a032-419d-ab38-f95f9f509380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:10.023487 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f589fe-a032-419d-ab38-f95f9f509380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:10.023967 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f589fe-a032-419d-ab38-f95f9f509380 admin admin] PATH_INFO: `/v3/users/80e3c44f37de49469ff99291bb8986a0` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:10.025948 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f589fe-a032-419d-ab38-f95f9f509380 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80e3c44f37de49469ff99291bb8986a0)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:10.029533 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f589fe-a032-419d-ab38-f95f9f509380 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:10.094688 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-59f589fe-a032-419d-ab38-f95f9f509380 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80e3c44f37de49469ff99291bb8986a0'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:10.095732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-59f589fe-a032-419d-ab38-f95f9f509380 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80e3c44f37de49469ff99291bb8986a0'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:10.097090 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:33:10.117464 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-59f589fe-a032-419d-ab38-f95f9f509380 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80e3c44f37de49469ff99291bb8986a0'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:10.128035 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-59f589fe-a032-419d-ab38-f95f9f509380 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80e3c44f37de49469ff99291bb8986a0'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:10.138198 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-59f589fe-a032-419d-ab38-f95f9f509380 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80e3c44f37de49469ff99291bb8986a0'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:10.145785 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1252/2519] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:33:09 2022] DELETE /identity/v3/users/80e3c44f37de49469ff99291bb8986a0 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:33:10.150682 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6395e-8417-4a17-b37e-e5cee0eb5bac None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:10.151236 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6395e-8417-4a17-b37e-e5cee0eb5bac None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:10.151382 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6395e-8417-4a17-b37e-e5cee0eb5bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:10.171412 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-0ab6395e-8417-4a17-b37e-e5cee0eb5bac None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:33:10.173420 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0ab6395e-8417-4a17-b37e-e5cee0eb5bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:10.244426 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1268/2520] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:33:10.255407 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f589fe-a032-419d-ab38-f95f9f509380 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:10.257126 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-59f589fe-a032-419d-ab38-f95f9f509380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:10.330731 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f589fe-a032-419d-ab38-f95f9f509380 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:10.335006 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc924ed-3283-4b99-9bda-014113325178 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:10.335715 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc924ed-3283-4b99-9bda-014113325178 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:10.336142 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc924ed-3283-4b99-9bda-014113325178 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:10.336429 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc924ed-3283-4b99-9bda-014113325178 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:10.347237 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc924ed-3283-4b99-9bda-014113325178 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:10.348884 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc924ed-3283-4b99-9bda-014113325178 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:10.361756 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1253/2521] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:33:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:33:10.682146 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6395e-8417-4a17-b37e-e5cee0eb5bac None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:10.684798 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0ab6395e-8417-4a17-b37e-e5cee0eb5bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:10.705848 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6395e-8417-4a17-b37e-e5cee0eb5bac None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:10.714077 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77c622-e9c6-4f0c-8e6e-b9b912bb5453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:10.715605 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77c622-e9c6-4f0c-8e6e-b9b912bb5453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:10.716072 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77c622-e9c6-4f0c-8e6e-b9b912bb5453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:10.716650 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77c622-e9c6-4f0c-8e6e-b9b912bb5453 admin admin] PATH_INFO: `/v3/projects/689099b2b4c84c3d8b67cdba4a81926c` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:10.719211 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77c622-e9c6-4f0c-8e6e-b9b912bb5453 admin admin] RBAC: Authorizing `identity:delete_project(project_id=689099b2b4c84c3d8b67cdba4a81926c)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:10.722859 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77c622-e9c6-4f0c-8e6e-b9b912bb5453 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:10.798787 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-af77c622-e9c6-4f0c-8e6e-b9b912bb5453 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '689099b2b4c84c3d8b67cdba4a81926c', 'request_id': 'req-af77c622-e9c6-4f0c-8e6e-b9b912bb5453'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:10.805685 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-af77c622-e9c6-4f0c-8e6e-b9b912bb5453 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '689099b2b4c84c3d8b67cdba4a81926c', 'request_id': 'req-af77c622-e9c6-4f0c-8e6e-b9b912bb5453'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:10.815198 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-af77c622-e9c6-4f0c-8e6e-b9b912bb5453 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '689099b2b4c84c3d8b67cdba4a81926c', 'request_id': 'req-af77c622-e9c6-4f0c-8e6e-b9b912bb5453'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:10.831222 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-af77c622-e9c6-4f0c-8e6e-b9b912bb5453 admin admin] The token cache is being invalidate because project 689099b2b4c84c3d8b67cdba4a81926c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:33:10.831593 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-af77c622-e9c6-4f0c-8e6e-b9b912bb5453 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:10.832327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-af77c622-e9c6-4f0c-8e6e-b9b912bb5453 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:10.834250 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1269/2522] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:33:10 2022] DELETE /identity/v3/projects/689099b2b4c84c3d8b67cdba4a81926c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:33:10.839466 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc924ed-3283-4b99-9bda-014113325178 service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:10.859748 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc924ed-3283-4b99-9bda-014113325178 service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:10.926576 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50671eb-5070-4b41-a755-db46de1448e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:10.927477 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50671eb-5070-4b41-a755-db46de1448e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:10.927752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50671eb-5070-4b41-a755-db46de1448e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:10.928022 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50671eb-5070-4b41-a755-db46de1448e1 admin admin] PATH_INFO: `/v3/users/2e1a01888e8d411ea47d4d025d139438` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:10.929281 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50671eb-5070-4b41-a755-db46de1448e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e1a01888e8d411ea47d4d025d139438)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:10.931255 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50671eb-5070-4b41-a755-db46de1448e1 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:10.985384 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b50671eb-5070-4b41-a755-db46de1448e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e1a01888e8d411ea47d4d025d139438'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:10.986227 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b50671eb-5070-4b41-a755-db46de1448e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e1a01888e8d411ea47d4d025d139438'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:11.000440 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b50671eb-5070-4b41-a755-db46de1448e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e1a01888e8d411ea47d4d025d139438'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:11.005765 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:33:11.011697 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b50671eb-5070-4b41-a755-db46de1448e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e1a01888e8d411ea47d4d025d139438'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:11.021712 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b50671eb-5070-4b41-a755-db46de1448e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e1a01888e8d411ea47d4d025d139438'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:11.029338 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1254/2523] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:33:10 2022] DELETE /identity/v3/users/2e1a01888e8d411ea47d4d025d139438 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:33:11.542741 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77c622-e9c6-4f0c-8e6e-b9b912bb5453 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:11.545127 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-af77c622-e9c6-4f0c-8e6e-b9b912bb5453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:11.566094 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77c622-e9c6-4f0c-8e6e-b9b912bb5453 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:11.625344 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:33:11.640711 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8cb1f-b61a-4cc1-af9b-3a6b851ca60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:11.641601 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8cb1f-b61a-4cc1-af9b-3a6b851ca60a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:11.641883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8cb1f-b61a-4cc1-af9b-3a6b851ca60a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:11.642201 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8cb1f-b61a-4cc1-af9b-3a6b851ca60a admin admin] PATH_INFO: `/v3/projects/84946fa24b90429b82caf0e0c532c238` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:11.643582 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8cb1f-b61a-4cc1-af9b-3a6b851ca60a admin admin] RBAC: Authorizing `identity:delete_project(project_id=84946fa24b90429b82caf0e0c532c238)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:11.645512 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8cb1f-b61a-4cc1-af9b-3a6b851ca60a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:11.699553 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6dc8cb1f-b61a-4cc1-af9b-3a6b851ca60a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84946fa24b90429b82caf0e0c532c238', 'request_id': 'req-6dc8cb1f-b61a-4cc1-af9b-3a6b851ca60a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:11.706004 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6dc8cb1f-b61a-4cc1-af9b-3a6b851ca60a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84946fa24b90429b82caf0e0c532c238', 'request_id': 'req-6dc8cb1f-b61a-4cc1-af9b-3a6b851ca60a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:11.714453 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6dc8cb1f-b61a-4cc1-af9b-3a6b851ca60a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84946fa24b90429b82caf0e0c532c238', 'request_id': 'req-6dc8cb1f-b61a-4cc1-af9b-3a6b851ca60a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:11.727436 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6dc8cb1f-b61a-4cc1-af9b-3a6b851ca60a admin admin] The token cache is being invalidate because project 84946fa24b90429b82caf0e0c532c238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:33:11.727738 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6dc8cb1f-b61a-4cc1-af9b-3a6b851ca60a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:11.728398 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6dc8cb1f-b61a-4cc1-af9b-3a6b851ca60a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:11.730226 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1270/2524] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:33:11 2022] DELETE /identity/v3/projects/84946fa24b90429b82caf0e0c532c238 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:33:11.735922 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde2eef-2afb-4937-a37a-44b9399804a1 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:11.736209 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde2eef-2afb-4937-a37a-44b9399804a1 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:11.736488 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde2eef-2afb-4937-a37a-44b9399804a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:11.755071 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-2cde2eef-2afb-4937-a37a-44b9399804a1 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:33:11.756307 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-2cde2eef-2afb-4937-a37a-44b9399804a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:11.826639 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1255/2525] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:33:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:33:11.836550 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086b39a-c462-4d64-8404-0c6aeff13fe7 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:11.836831 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086b39a-c462-4d64-8404-0c6aeff13fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:11.837112 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086b39a-c462-4d64-8404-0c6aeff13fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:11.857580 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7086b39a-c462-4d64-8404-0c6aeff13fe7 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:33:11.859250 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7086b39a-c462-4d64-8404-0c6aeff13fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:11.867530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1271/2526] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:33:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:33:11.872012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde2eef-2afb-4937-a37a-44b9399804a1 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:11.882667 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde2eef-2afb-4937-a37a-44b9399804a1 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:11.887623 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35a41d-684b-4165-bee1-aef37c4ab86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:11.888410 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35a41d-684b-4165-bee1-aef37c4ab86f admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:11.888741 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35a41d-684b-4165-bee1-aef37c4ab86f admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:11.889060 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35a41d-684b-4165-bee1-aef37c4ab86f admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:11.889842 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35a41d-684b-4165-bee1-aef37c4ab86f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:33:11.890746 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35a41d-684b-4165-bee1-aef37c4ab86f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:11.892443 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35a41d-684b-4165-bee1-aef37c4ab86f admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:11.907084 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1256/2527] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:33:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:33:11.911750 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086b39a-c462-4d64-8404-0c6aeff13fe7 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:11.923069 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086b39a-c462-4d64-8404-0c6aeff13fe7 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:11.928143 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9a25f-06a4-4d82-b700-02872d1b2079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:11.928826 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9a25f-06a4-4d82-b700-02872d1b2079 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:11.929109 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9a25f-06a4-4d82-b700-02872d1b2079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:11.929387 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9a25f-06a4-4d82-b700-02872d1b2079 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:11.930133 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c9a25f-06a4-4d82-b700-02872d1b2079 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:11.932137 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c9a25f-06a4-4d82-b700-02872d1b2079 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:11.963166 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1272/2528] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:33:11 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:33:11.969488 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35a41d-684b-4165-bee1-aef37c4ab86f admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:11.985260 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35a41d-684b-4165-bee1-aef37c4ab86f admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:12.051733 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1cf2a4-1832-46be-bae2-4d7436a71afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:12.052442 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1cf2a4-1832-46be-bae2-4d7436a71afd admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:12.052725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1cf2a4-1832-46be-bae2-4d7436a71afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:12.053000 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1cf2a4-1832-46be-bae2-4d7436a71afd admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:12.053695 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1cf2a4-1832-46be-bae2-4d7436a71afd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:12.055702 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1cf2a4-1832-46be-bae2-4d7436a71afd admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:12.079897 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1257/2529] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:33:11 2022] POST /identity/v3/users => generated 283 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:33:12.084266 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9a25f-06a4-4d82-b700-02872d1b2079 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:12.096552 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9a25f-06a4-4d82-b700-02872d1b2079 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:12.102865 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07d6c7-d29a-4c87-9573-512a0d5fcb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:12.103757 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07d6c7-d29a-4c87-9573-512a0d5fcb50 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:12.104092 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07d6c7-d29a-4c87-9573-512a0d5fcb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:12.104418 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07d6c7-d29a-4c87-9573-512a0d5fcb50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:12.105257 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec07d6c7-d29a-4c87-9573-512a0d5fcb50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:12.107147 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec07d6c7-d29a-4c87-9573-512a0d5fcb50 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:12.119761 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1273/2530] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:33:12.124353 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1cf2a4-1832-46be-bae2-4d7436a71afd admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:12.138713 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1cf2a4-1832-46be-bae2-4d7436a71afd admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:12.148196 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a48b1-01e7-49ab-81e2-a4e71e2d4fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:12.149326 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a48b1-01e7-49ab-81e2-a4e71e2d4fff admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:12.149831 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a48b1-01e7-49ab-81e2-a4e71e2d4fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:12.150373 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a48b1-01e7-49ab-81e2-a4e71e2d4fff admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:12.151792 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a48b1-01e7-49ab-81e2-a4e71e2d4fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:12.154986 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a48b1-01e7-49ab-81e2-a4e71e2d4fff admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:12.171222 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1258/2531] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 04:33:12.175770 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07d6c7-d29a-4c87-9573-512a0d5fcb50 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:12.186687 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07d6c7-d29a-4c87-9573-512a0d5fcb50 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:12.192256 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb4d75-573c-4476-a491-b4423bcacdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:12.193180 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb4d75-573c-4476-a491-b4423bcacdd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:12.193466 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb4d75-573c-4476-a491-b4423bcacdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:12.193749 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb4d75-573c-4476-a491-b4423bcacdd5 admin admin] PATH_INFO: `/v3/projects/06a9cb3dfd0848dca005b31f2009dddd/users/b327c2f1edec41fda4b195c3be108cfc/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:12.212394 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb4d75-573c-4476-a491-b4423bcacdd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06a9cb3dfd0848dca005b31f2009dddd, user_id=b327c2f1edec41fda4b195c3be108cfc, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:12.215233 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb4d75-573c-4476-a491-b4423bcacdd5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:12.232315 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1274/2532] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:33:12 2022] PUT /identity/v3/projects/06a9cb3dfd0848dca005b31f2009dddd/users/b327c2f1edec41fda4b195c3be108cfc/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:33:12.243740 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1efa6-73ba-4464-b511-45476ad41486 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:12.244097 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1efa6-73ba-4464-b511-45476ad41486 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:12.244515 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1efa6-73ba-4464-b511-45476ad41486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:12.276137 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-ebc1efa6-73ba-4464-b511-45476ad41486 None None] MFA Rules not processed for user `b327c2f1edec41fda4b195c3be108cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:33:12.277395 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-ebc1efa6-73ba-4464-b511-45476ad41486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:12.358183 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:33:12.391072 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1259/2533] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:33:12 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:33:12.397585 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb4d75-573c-4476-a491-b4423bcacdd5 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:12.475485 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb4d75-573c-4476-a491-b4423bcacdd5 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:12.483260 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26797784-a195-4ddc-89f8-41fca110ec2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:12.484355 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26797784-a195-4ddc-89f8-41fca110ec2a admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:12.484837 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26797784-a195-4ddc-89f8-41fca110ec2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:12.485313 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26797784-a195-4ddc-89f8-41fca110ec2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:12.486595 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26797784-a195-4ddc-89f8-41fca110ec2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:12.489074 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26797784-a195-4ddc-89f8-41fca110ec2a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:12.516037 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:33:12.527919 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1275/2534] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:33:12 2022] POST /identity/v3/projects => generated 365 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:33:12.533725 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1efa6-73ba-4464-b511-45476ad41486 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:12.547408 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1efa6-73ba-4464-b511-45476ad41486 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:12.621738 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc336ba-7ec6-4ab7-a089-2666a8627338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:12.622477 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc336ba-7ec6-4ab7-a089-2666a8627338 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:12.622769 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc336ba-7ec6-4ab7-a089-2666a8627338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:12.623052 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc336ba-7ec6-4ab7-a089-2666a8627338 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:12.623769 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc336ba-7ec6-4ab7-a089-2666a8627338 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:12.625809 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc336ba-7ec6-4ab7-a089-2666a8627338 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:12.648574 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1260/2535] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:33:12 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:33:12.652781 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26797784-a195-4ddc-89f8-41fca110ec2a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:12.665477 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26797784-a195-4ddc-89f8-41fca110ec2a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:12.671835 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6df97-2c4d-4f1e-9b58-1f4f6828d4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:12.672880 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6df97-2c4d-4f1e-9b58-1f4f6828d4a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:12.673317 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6df97-2c4d-4f1e-9b58-1f4f6828d4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:12.673773 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6df97-2c4d-4f1e-9b58-1f4f6828d4a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:12.674754 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d6df97-2c4d-4f1e-9b58-1f4f6828d4a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:12.676457 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d6df97-2c4d-4f1e-9b58-1f4f6828d4a9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:12.690516 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1276/2536] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 04:33:12.697206 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc336ba-7ec6-4ab7-a089-2666a8627338 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:12.709822 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc336ba-7ec6-4ab7-a089-2666a8627338 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:12.714984 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36bd03-e689-4b08-b5c6-302169afe943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:12.715945 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36bd03-e689-4b08-b5c6-302169afe943 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:12.716235 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36bd03-e689-4b08-b5c6-302169afe943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:12.716521 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36bd03-e689-4b08-b5c6-302169afe943 admin admin] PATH_INFO: `/v3/projects/48667311b1e34a3fa8035e36d05bedeb/users/4c0becaaccb048a59fed56ebe1d07022/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:12.737333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36bd03-e689-4b08-b5c6-302169afe943 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48667311b1e34a3fa8035e36d05bedeb, user_id=4c0becaaccb048a59fed56ebe1d07022, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:12.743124 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36bd03-e689-4b08-b5c6-302169afe943 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:12.763103 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1261/2537] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:33:12 2022] PUT /identity/v3/projects/48667311b1e34a3fa8035e36d05bedeb/users/4c0becaaccb048a59fed56ebe1d07022/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:33:12.768156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6df97-2c4d-4f1e-9b58-1f4f6828d4a9 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:12.779295 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6df97-2c4d-4f1e-9b58-1f4f6828d4a9 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:12.849806 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a97286-3291-4a7d-b91f-8b8c7b694c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:12.850620 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a97286-3291-4a7d-b91f-8b8c7b694c83 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:12.850908 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a97286-3291-4a7d-b91f-8b8c7b694c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:12.851191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a97286-3291-4a7d-b91f-8b8c7b694c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:12.851940 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a97286-3291-4a7d-b91f-8b8c7b694c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:12.853639 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a97286-3291-4a7d-b91f-8b8c7b694c83 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:12.865674 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1277/2538] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:33:12.871516 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36bd03-e689-4b08-b5c6-302169afe943 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:12.885565 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36bd03-e689-4b08-b5c6-302169afe943 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:12.894287 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc96299-19b2-4f96-9401-d6ad115507e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:12.895522 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc96299-19b2-4f96-9401-d6ad115507e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:12.895999 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc96299-19b2-4f96-9401-d6ad115507e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:12.896291 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc96299-19b2-4f96-9401-d6ad115507e8 admin admin] PATH_INFO: `/v3/projects/48667311b1e34a3fa8035e36d05bedeb/users/4c0becaaccb048a59fed56ebe1d07022/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:12.898774 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc96299-19b2-4f96-9401-d6ad115507e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48667311b1e34a3fa8035e36d05bedeb, user_id=4c0becaaccb048a59fed56ebe1d07022, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:12.901502 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc96299-19b2-4f96-9401-d6ad115507e8 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:12.914458 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1262/2539] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:33:12 2022] PUT /identity/v3/projects/48667311b1e34a3fa8035e36d05bedeb/users/4c0becaaccb048a59fed56ebe1d07022/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:33:12.927127 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a026e-53b2-4779-94fa-4cae8c2442a1 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:12.927650 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a026e-53b2-4779-94fa-4cae8c2442a1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:12.927982 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a026e-53b2-4779-94fa-4cae8c2442a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:12.965332 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7d6a026e-53b2-4779-94fa-4cae8c2442a1 None None] MFA Rules not processed for user `4c0becaaccb048a59fed56ebe1d07022`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:33:12.966628 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7d6a026e-53b2-4779-94fa-4cae8c2442a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:13.048969 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1278/2540] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:33:12 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:33:13.065641 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc96299-19b2-4f96-9401-d6ad115507e8 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:13.067903 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-ccc96299-19b2-4f96-9401-d6ad115507e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:13.153064 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc96299-19b2-4f96-9401-d6ad115507e8 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:13.158625 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52eba0-ab84-402c-9472-9657f427e944 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:13.159309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52eba0-ab84-402c-9472-9657f427e944 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:13.159598 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52eba0-ab84-402c-9472-9657f427e944 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:13.159882 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52eba0-ab84-402c-9472-9657f427e944 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:13.172464 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52eba0-ab84-402c-9472-9657f427e944 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:13.173949 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52eba0-ab84-402c-9472-9657f427e944 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:13.185368 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1263/2541] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:33:13 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:33:13.277384 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a026e-53b2-4779-94fa-4cae8c2442a1 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:13.297853 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a026e-53b2-4779-94fa-4cae8c2442a1 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:13.301697 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5d6f5-6030-4609-a5bd-91dedc6eac96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:13.302801 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5d6f5-6030-4609-a5bd-91dedc6eac96 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:13.303318 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5d6f5-6030-4609-a5bd-91dedc6eac96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:13.303828 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5d6f5-6030-4609-a5bd-91dedc6eac96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:13.380007 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5d6f5-6030-4609-a5bd-91dedc6eac96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:13.381620 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5d6f5-6030-4609-a5bd-91dedc6eac96 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:13.392905 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1279/2542] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:33:13 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:33:16.377008 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52eba0-ab84-402c-9472-9657f427e944 service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:16.467592 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:33:16.498869 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52eba0-ab84-402c-9472-9657f427e944 service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:16.505471 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fb08e-ad3d-4789-9726-6b3942a2dc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:16.506494 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fb08e-ad3d-4789-9726-6b3942a2dc43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:16.506843 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fb08e-ad3d-4789-9726-6b3942a2dc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:16.507293 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fb08e-ad3d-4789-9726-6b3942a2dc43 admin admin] PATH_INFO: `/v3/users/b327c2f1edec41fda4b195c3be108cfc` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:16.508853 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fb08e-ad3d-4789-9726-6b3942a2dc43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b327c2f1edec41fda4b195c3be108cfc)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:16.510964 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fb08e-ad3d-4789-9726-6b3942a2dc43 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:16.580439 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-737fb08e-ad3d-4789-9726-6b3942a2dc43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b327c2f1edec41fda4b195c3be108cfc'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:16.581397 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-737fb08e-ad3d-4789-9726-6b3942a2dc43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b327c2f1edec41fda4b195c3be108cfc'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:16.604478 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-737fb08e-ad3d-4789-9726-6b3942a2dc43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b327c2f1edec41fda4b195c3be108cfc'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:16.613735 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-737fb08e-ad3d-4789-9726-6b3942a2dc43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b327c2f1edec41fda4b195c3be108cfc'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:16.623288 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-737fb08e-ad3d-4789-9726-6b3942a2dc43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b327c2f1edec41fda4b195c3be108cfc'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:16.630708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1264/2543] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:33:16 2022] DELETE /identity/v3/users/b327c2f1edec41fda4b195c3be108cfc => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:33:16.635567 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52694a13-5afc-44b5-899a-ea86ffea290b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:16.636154 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52694a13-5afc-44b5-899a-ea86ffea290b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:16.636154 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52694a13-5afc-44b5-899a-ea86ffea290b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:16.655497 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-52694a13-5afc-44b5-899a-ea86ffea290b None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:33:16.657553 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-52694a13-5afc-44b5-899a-ea86ffea290b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:16.662185 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:33:16.739193 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1280/2544] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:33:16.756095 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fb08e-ad3d-4789-9726-6b3942a2dc43 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:16.758157 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-737fb08e-ad3d-4789-9726-6b3942a2dc43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:16.834649 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc92a1-efff-433c-88fe-572540d7dcd0 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:16.834952 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc92a1-efff-433c-88fe-572540d7dcd0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:16.835395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc92a1-efff-433c-88fe-572540d7dcd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:16.848838 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fb08e-ad3d-4789-9726-6b3942a2dc43 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:16.854582 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4adad3-6cfb-4693-b53e-6e41b63d05ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:16.855687 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4adad3-6cfb-4693-b53e-6e41b63d05ea service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:16.856015 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4adad3-6cfb-4693-b53e-6e41b63d05ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:16.856343 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-3bfc92a1-efff-433c-88fe-572540d7dcd0 None None] MFA Rules not processed for user `3fa2ad34164a4631adf76fbd042679ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:33:16.856626 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4adad3-6cfb-4693-b53e-6e41b63d05ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:16.858156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3bfc92a1-efff-433c-88fe-572540d7dcd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:16.873817 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4adad3-6cfb-4693-b53e-6e41b63d05ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:16.877093 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4adad3-6cfb-4693-b53e-6e41b63d05ea service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:16.891499 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1265/2545] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:33:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:33:16.962705 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1281/2546] 10.222.0.32 () {58 vars in 1009 bytes} [Wed Jun 1 04:33:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:33:17.053801 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4adad3-6cfb-4693-b53e-6e41b63d05ea service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:17.055522 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-8c4adad3-6cfb-4693-b53e-6e41b63d05ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:17.200226 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:33:17.243289 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4adad3-6cfb-4693-b53e-6e41b63d05ea service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:17.253281 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98baf5b3-577c-43c5-88d4-32284541a9aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413c6613b4ec4e53aeeaf6828c807273', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:17.254551 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baf5b3-577c-43c5-88d4-32284541a9aa service swift] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:17.255033 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baf5b3-577c-43c5-88d4-32284541a9aa service swift] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:17.255542 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baf5b3-577c-43c5-88d4-32284541a9aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:17.278094 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98baf5b3-577c-43c5-88d4-32284541a9aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:17.282844 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98baf5b3-577c-43c5-88d4-32284541a9aa service swift] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:17.306117 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1266/2547] 10.222.0.32 () {60 vars in 1384 bytes} [Wed Jun 1 04:33:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 01 04:33:17.394927 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc92a1-efff-433c-88fe-572540d7dcd0 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:17.398495 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3bfc92a1-efff-433c-88fe-572540d7dcd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:17.438927 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc92a1-efff-433c-88fe-572540d7dcd0 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:17.450161 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ea043-47f2-4bfd-93e6-9d95392adb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:17.451659 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ea043-47f2-4bfd-93e6-9d95392adb68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:17.452145 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ea043-47f2-4bfd-93e6-9d95392adb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:17.452692 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ea043-47f2-4bfd-93e6-9d95392adb68 admin admin] PATH_INFO: `/v3/projects/06a9cb3dfd0848dca005b31f2009dddd` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:17.455015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ea043-47f2-4bfd-93e6-9d95392adb68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06a9cb3dfd0848dca005b31f2009dddd)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:17.458733 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ea043-47f2-4bfd-93e6-9d95392adb68 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:17.610385 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-327ea043-47f2-4bfd-93e6-9d95392adb68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06a9cb3dfd0848dca005b31f2009dddd', 'request_id': 'req-327ea043-47f2-4bfd-93e6-9d95392adb68'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:17.624597 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-327ea043-47f2-4bfd-93e6-9d95392adb68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06a9cb3dfd0848dca005b31f2009dddd', 'request_id': 'req-327ea043-47f2-4bfd-93e6-9d95392adb68'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:17.643728 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-327ea043-47f2-4bfd-93e6-9d95392adb68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06a9cb3dfd0848dca005b31f2009dddd', 'request_id': 'req-327ea043-47f2-4bfd-93e6-9d95392adb68'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:17.672305 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-327ea043-47f2-4bfd-93e6-9d95392adb68 admin admin] The token cache is being invalidate because project 06a9cb3dfd0848dca005b31f2009dddd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:33:17.673023 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-327ea043-47f2-4bfd-93e6-9d95392adb68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:17.674390 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-327ea043-47f2-4bfd-93e6-9d95392adb68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:17.676725 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1282/2548] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:33:17 2022] DELETE /identity/v3/projects/06a9cb3dfd0848dca005b31f2009dddd => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:33:17.681582 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98baf5b3-577c-43c5-88d4-32284541a9aa service swift] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:17.742103 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98baf5b3-577c-43c5-88d4-32284541a9aa service swift] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:17.884973 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60ec73-2c1b-4221-b5e1-799e4440ceab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:17.885888 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60ec73-2c1b-4221-b5e1-799e4440ceab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:17.886215 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60ec73-2c1b-4221-b5e1-799e4440ceab admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:17.886500 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60ec73-2c1b-4221-b5e1-799e4440ceab admin admin] PATH_INFO: `/v3/users/4c0becaaccb048a59fed56ebe1d07022` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:17.887871 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60ec73-2c1b-4221-b5e1-799e4440ceab admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c0becaaccb048a59fed56ebe1d07022)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:17.889873 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60ec73-2c1b-4221-b5e1-799e4440ceab admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:17.978877 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-aa60ec73-2c1b-4221-b5e1-799e4440ceab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c0becaaccb048a59fed56ebe1d07022'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:17.979959 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-aa60ec73-2c1b-4221-b5e1-799e4440ceab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c0becaaccb048a59fed56ebe1d07022'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:18.002096 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-aa60ec73-2c1b-4221-b5e1-799e4440ceab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c0becaaccb048a59fed56ebe1d07022'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:18.013236 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-aa60ec73-2c1b-4221-b5e1-799e4440ceab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c0becaaccb048a59fed56ebe1d07022'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:18.031939 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-aa60ec73-2c1b-4221-b5e1-799e4440ceab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c0becaaccb048a59fed56ebe1d07022'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:18.048806 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1267/2549] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:33:17 2022] DELETE /identity/v3/users/4c0becaaccb048a59fed56ebe1d07022 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:33:18.438568 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ea043-47f2-4bfd-93e6-9d95392adb68 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:18.441344 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-327ea043-47f2-4bfd-93e6-9d95392adb68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:18.473853 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ea043-47f2-4bfd-93e6-9d95392adb68 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:18.537306 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:33:18.588406 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7f96d-3bc7-4328-908c-317c06e65662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:18.589509 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7f96d-3bc7-4328-908c-317c06e65662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:18.589819 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7f96d-3bc7-4328-908c-317c06e65662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:18.590111 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7f96d-3bc7-4328-908c-317c06e65662 admin admin] PATH_INFO: `/v3/projects/48667311b1e34a3fa8035e36d05bedeb` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:18.591543 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb7f96d-3bc7-4328-908c-317c06e65662 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48667311b1e34a3fa8035e36d05bedeb)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:18.593725 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb7f96d-3bc7-4328-908c-317c06e65662 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:18.673073 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1eb7f96d-3bc7-4328-908c-317c06e65662 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48667311b1e34a3fa8035e36d05bedeb', 'request_id': 'req-1eb7f96d-3bc7-4328-908c-317c06e65662'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:18.684579 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1eb7f96d-3bc7-4328-908c-317c06e65662 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48667311b1e34a3fa8035e36d05bedeb', 'request_id': 'req-1eb7f96d-3bc7-4328-908c-317c06e65662'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:18.698999 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1eb7f96d-3bc7-4328-908c-317c06e65662 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48667311b1e34a3fa8035e36d05bedeb', 'request_id': 'req-1eb7f96d-3bc7-4328-908c-317c06e65662'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:18.720633 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1eb7f96d-3bc7-4328-908c-317c06e65662 admin admin] The token cache is being invalidate because project 48667311b1e34a3fa8035e36d05bedeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:33:18.721280 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1eb7f96d-3bc7-4328-908c-317c06e65662 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:18.722221 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1eb7f96d-3bc7-4328-908c-317c06e65662 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:18.728510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1283/2550] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:33:18 2022] DELETE /identity/v3/projects/48667311b1e34a3fa8035e36d05bedeb => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:33:18.731570 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414093a-ecbd-4ed5-95cb-b3ded2cb26cb None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:18.732372 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414093a-ecbd-4ed5-95cb-b3ded2cb26cb None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:18.733017 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414093a-ecbd-4ed5-95cb-b3ded2cb26cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:18.767860 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-f414093a-ecbd-4ed5-95cb-b3ded2cb26cb None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:33:18.770003 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f414093a-ecbd-4ed5-95cb-b3ded2cb26cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:18.855675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:33:18.884594 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1268/2551] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:33:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:33:18.907962 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f017fb9-ead8-4e5b-b46c-5a705981410d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:18.907962 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f017fb9-ead8-4e5b-b46c-5a705981410d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:18.907962 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f017fb9-ead8-4e5b-b46c-5a705981410d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:18.977111 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2f017fb9-ead8-4e5b-b46c-5a705981410d None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:33:18.980171 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2f017fb9-ead8-4e5b-b46c-5a705981410d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:19.012798 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1284/2552] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:33:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:33:19.017329 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414093a-ecbd-4ed5-95cb-b3ded2cb26cb None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:19.039744 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414093a-ecbd-4ed5-95cb-b3ded2cb26cb None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:19.048627 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4884a-acf6-4879-923a-20e493509d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:19.050978 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4884a-acf6-4879-923a-20e493509d2e admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:19.050978 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4884a-acf6-4879-923a-20e493509d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:19.050978 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4884a-acf6-4879-923a-20e493509d2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:19.051691 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4884a-acf6-4879-923a-20e493509d2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:33:19.052570 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4884a-acf6-4879-923a-20e493509d2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:19.054303 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4884a-acf6-4879-923a-20e493509d2e admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:19.076875 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1269/2553] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:33:19.082916 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f017fb9-ead8-4e5b-b46c-5a705981410d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:19.122561 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f017fb9-ead8-4e5b-b46c-5a705981410d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:19.145531 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1908fcb-1277-4393-9d56-f6038ae3db26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:19.147545 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1908fcb-1277-4393-9d56-f6038ae3db26 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:19.148140 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1908fcb-1277-4393-9d56-f6038ae3db26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:19.148690 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1908fcb-1277-4393-9d56-f6038ae3db26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:19.150192 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1908fcb-1277-4393-9d56-f6038ae3db26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:19.156158 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1908fcb-1277-4393-9d56-f6038ae3db26 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:19.261042 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1285/2554] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:33:19 2022] POST /identity/v3/projects => generated 369 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:33:19.266343 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4884a-acf6-4879-923a-20e493509d2e admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:19.287665 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4884a-acf6-4879-923a-20e493509d2e admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:19.500829 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea4f2e-39cc-4f24-866f-5df6a62bf1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:19.502046 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea4f2e-39cc-4f24-866f-5df6a62bf1b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:19.502528 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea4f2e-39cc-4f24-866f-5df6a62bf1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:19.503003 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea4f2e-39cc-4f24-866f-5df6a62bf1b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:19.509602 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea4f2e-39cc-4f24-866f-5df6a62bf1b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:19.519470 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea4f2e-39cc-4f24-866f-5df6a62bf1b0 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:19.580292 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1270/2555] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:33:19 2022] POST /identity/v3/users => generated 285 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:33:19.585130 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1908fcb-1277-4393-9d56-f6038ae3db26 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:19.612988 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1908fcb-1277-4393-9d56-f6038ae3db26 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:19.622050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d63b62-597f-4e4b-ae83-af428d8101e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:19.623259 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d63b62-597f-4e4b-ae83-af428d8101e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:19.623763 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d63b62-597f-4e4b-ae83-af428d8101e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:19.624269 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d63b62-597f-4e4b-ae83-af428d8101e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:19.626183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d63b62-597f-4e4b-ae83-af428d8101e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:19.629363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d63b62-597f-4e4b-ae83-af428d8101e2 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:19.651653 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1286/2556] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:33:19.657637 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea4f2e-39cc-4f24-866f-5df6a62bf1b0 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:19.672762 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea4f2e-39cc-4f24-866f-5df6a62bf1b0 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:19.678174 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4220376-ad20-4c5d-a314-06f95f3da2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:19.679223 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4220376-ad20-4c5d-a314-06f95f3da2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:19.679557 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4220376-ad20-4c5d-a314-06f95f3da2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:19.679830 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4220376-ad20-4c5d-a314-06f95f3da2d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:19.680548 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4220376-ad20-4c5d-a314-06f95f3da2d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:19.682611 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4220376-ad20-4c5d-a314-06f95f3da2d3 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:19.696299 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1271/2557] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 04:33:19.701772 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d63b62-597f-4e4b-ae83-af428d8101e2 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:19.721541 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d63b62-597f-4e4b-ae83-af428d8101e2 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:19.729528 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58ab06-4f1c-48a3-80d7-b8313c8e15cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:19.731230 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58ab06-4f1c-48a3-80d7-b8313c8e15cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:19.731735 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58ab06-4f1c-48a3-80d7-b8313c8e15cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:19.732241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58ab06-4f1c-48a3-80d7-b8313c8e15cf admin admin] PATH_INFO: `/v3/projects/09040c788c1d4dd5a44907e8c049a07c/users/b4598bea328644c29f6efc1bf61f8d2f/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:19.763281 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58ab06-4f1c-48a3-80d7-b8313c8e15cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=09040c788c1d4dd5a44907e8c049a07c, user_id=b4598bea328644c29f6efc1bf61f8d2f, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:19.769645 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58ab06-4f1c-48a3-80d7-b8313c8e15cf admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:19.797907 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1287/2558] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:33:19 2022] PUT /identity/v3/projects/09040c788c1d4dd5a44907e8c049a07c/users/b4598bea328644c29f6efc1bf61f8d2f/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:33:19.818307 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a0c2f-c5c7-4dec-8940-fc72ba5a529d None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:19.819462 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a0c2f-c5c7-4dec-8940-fc72ba5a529d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:19.819462 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a0c2f-c5c7-4dec-8940-fc72ba5a529d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:19.854744 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-190a0c2f-c5c7-4dec-8940-fc72ba5a529d None None] MFA Rules not processed for user `b4598bea328644c29f6efc1bf61f8d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:33:19.856183 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-190a0c2f-c5c7-4dec-8940-fc72ba5a529d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:19.978923 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1272/2559] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:33:19 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:33:19.985501 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58ab06-4f1c-48a3-80d7-b8313c8e15cf admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:20.120604 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58ab06-4f1c-48a3-80d7-b8313c8e15cf admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:20.131841 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1e32f-79c3-42eb-af48-0143fea698a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:20.132833 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1e32f-79c3-42eb-af48-0143fea698a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:20.133150 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1e32f-79c3-42eb-af48-0143fea698a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:20.133852 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1e32f-79c3-42eb-af48-0143fea698a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:20.135184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb1e32f-79c3-42eb-af48-0143fea698a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:20.139222 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb1e32f-79c3-42eb-af48-0143fea698a2 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:20.152325 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:33:20.192653 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1288/2560] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:33:19 2022] POST /identity/v3/projects => generated 369 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:33:20.198852 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a0c2f-c5c7-4dec-8940-fc72ba5a529d None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:20.220056 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a0c2f-c5c7-4dec-8940-fc72ba5a529d None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:20.312998 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:33:20.330940 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca236a-79b0-4dbc-b276-dad2b3c7598f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:20.332577 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca236a-79b0-4dbc-b276-dad2b3c7598f admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:20.333576 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca236a-79b0-4dbc-b276-dad2b3c7598f admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:20.334458 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca236a-79b0-4dbc-b276-dad2b3c7598f admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:20.336106 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca236a-79b0-4dbc-b276-dad2b3c7598f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:20.339008 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca236a-79b0-4dbc-b276-dad2b3c7598f admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:20.376865 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1273/2561] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:33:20 2022] POST /identity/v3/users => generated 291 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:33:20.382613 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1e32f-79c3-42eb-af48-0143fea698a2 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:20.404628 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1e32f-79c3-42eb-af48-0143fea698a2 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:20.424141 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd74760-cf8f-476e-98a8-ad0f4eda497d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:20.425337 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd74760-cf8f-476e-98a8-ad0f4eda497d admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:20.425938 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd74760-cf8f-476e-98a8-ad0f4eda497d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:20.426359 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd74760-cf8f-476e-98a8-ad0f4eda497d admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:20.427800 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd74760-cf8f-476e-98a8-ad0f4eda497d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:20.430743 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd74760-cf8f-476e-98a8-ad0f4eda497d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:20.469053 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1289/2562] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:33:20.471519 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca236a-79b0-4dbc-b276-dad2b3c7598f admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:20.490556 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca236a-79b0-4dbc-b276-dad2b3c7598f admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:20.501159 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3cf71-d2d6-4a4f-90fc-d8b692f548ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:20.503484 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3cf71-d2d6-4a4f-90fc-d8b692f548ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:20.504378 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3cf71-d2d6-4a4f-90fc-d8b692f548ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:20.518204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3cf71-d2d6-4a4f-90fc-d8b692f548ce admin admin] PATH_INFO: `/v3/projects/6449e73e394f4b9ebb6ce17577b90e23/users/346c70a90eac4ca69571ac5515dd9512/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:20.584756 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3cf71-d2d6-4a4f-90fc-d8b692f548ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=6449e73e394f4b9ebb6ce17577b90e23, user_id=346c70a90eac4ca69571ac5515dd9512, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:20.587892 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3cf71-d2d6-4a4f-90fc-d8b692f548ce admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:20.625299 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1274/2563] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:33:20 2022] PUT /identity/v3/projects/6449e73e394f4b9ebb6ce17577b90e23/users/346c70a90eac4ca69571ac5515dd9512/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:33:20.637334 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd74760-cf8f-476e-98a8-ad0f4eda497d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:20.693000 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd74760-cf8f-476e-98a8-ad0f4eda497d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:20.815282 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12429bda-58de-4164-adcf-5b217898388c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:20.816818 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12429bda-58de-4164-adcf-5b217898388c admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:20.817011 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12429bda-58de-4164-adcf-5b217898388c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:20.817569 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12429bda-58de-4164-adcf-5b217898388c admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:20.819517 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12429bda-58de-4164-adcf-5b217898388c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:20.822772 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12429bda-58de-4164-adcf-5b217898388c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:20.852858 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1290/2564] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:33:20.853162 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3cf71-d2d6-4a4f-90fc-d8b692f548ce admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:20.876559 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3cf71-d2d6-4a4f-90fc-d8b692f548ce admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:20.886512 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e3526-af7f-4990-bccd-875446734ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:20.888127 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e3526-af7f-4990-bccd-875446734ccc admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:20.888749 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e3526-af7f-4990-bccd-875446734ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:20.889226 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e3526-af7f-4990-bccd-875446734ccc admin admin] PATH_INFO: `/v3/projects/6449e73e394f4b9ebb6ce17577b90e23/users/346c70a90eac4ca69571ac5515dd9512/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:20.891780 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e3526-af7f-4990-bccd-875446734ccc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6449e73e394f4b9ebb6ce17577b90e23, user_id=346c70a90eac4ca69571ac5515dd9512, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:20.896740 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e3526-af7f-4990-bccd-875446734ccc admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:20.918850 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1275/2565] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:33:20 2022] PUT /identity/v3/projects/6449e73e394f4b9ebb6ce17577b90e23/users/346c70a90eac4ca69571ac5515dd9512/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:33:20.932445 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444ddb6-d851-48b4-a0d9-4acffe62e612 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:20.933252 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444ddb6-d851-48b4-a0d9-4acffe62e612 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:20.933902 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444ddb6-d851-48b4-a0d9-4acffe62e612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:21.012070 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-0444ddb6-d851-48b4-a0d9-4acffe62e612 None None] MFA Rules not processed for user `346c70a90eac4ca69571ac5515dd9512`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:33:21.015240 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0444ddb6-d851-48b4-a0d9-4acffe62e612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:21.213447 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1291/2566] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:33:20 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:33:21.231474 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e3526-af7f-4990-bccd-875446734ccc admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:21.233324 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3c5e3526-af7f-4990-bccd-875446734ccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:21.406982 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e3526-af7f-4990-bccd-875446734ccc admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:21.413239 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8030164-9140-483c-bae0-1e75e5f04158 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:21.413992 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8030164-9140-483c-bae0-1e75e5f04158 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:21.414316 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8030164-9140-483c-bae0-1e75e5f04158 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:21.414609 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8030164-9140-483c-bae0-1e75e5f04158 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:21.428145 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8030164-9140-483c-bae0-1e75e5f04158 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:21.430000 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8030164-9140-483c-bae0-1e75e5f04158 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:21.444429 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1276/2567] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:33:21 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:33:24.012121 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444ddb6-d851-48b4-a0d9-4acffe62e612 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:24.108504 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444ddb6-d851-48b4-a0d9-4acffe62e612 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:24.115928 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56133806-4512-4207-bde2-1da12b0dc061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:24.117292 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56133806-4512-4207-bde2-1da12b0dc061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:24.117726 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56133806-4512-4207-bde2-1da12b0dc061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:24.118181 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56133806-4512-4207-bde2-1da12b0dc061 admin admin] PATH_INFO: `/v3/users/b4598bea328644c29f6efc1bf61f8d2f` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:24.119905 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56133806-4512-4207-bde2-1da12b0dc061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4598bea328644c29f6efc1bf61f8d2f)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:24.122728 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56133806-4512-4207-bde2-1da12b0dc061 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:24.126427 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:33:24.223254 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-56133806-4512-4207-bde2-1da12b0dc061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4598bea328644c29f6efc1bf61f8d2f'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:24.224996 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-56133806-4512-4207-bde2-1da12b0dc061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4598bea328644c29f6efc1bf61f8d2f'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:24.248848 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-56133806-4512-4207-bde2-1da12b0dc061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4598bea328644c29f6efc1bf61f8d2f'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:24.267399 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-56133806-4512-4207-bde2-1da12b0dc061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4598bea328644c29f6efc1bf61f8d2f'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:24.268639 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-56133806-4512-4207-bde2-1da12b0dc061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4598bea328644c29f6efc1bf61f8d2f'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:24.297470 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1292/2568] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:33:24 2022] DELETE /identity/v3/users/b4598bea328644c29f6efc1bf61f8d2f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:33:24.302285 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706ee51-f61c-438f-ac01-d3714ebe80fc None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:24.303382 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706ee51-f61c-438f-ac01-d3714ebe80fc None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:24.303964 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706ee51-f61c-438f-ac01-d3714ebe80fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:24.333613 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-f706ee51-f61c-438f-ac01-d3714ebe80fc None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:33:24.335275 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f706ee51-f61c-438f-ac01-d3714ebe80fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:24.439910 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1277/2569] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:33:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:33:24.454519 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56133806-4512-4207-bde2-1da12b0dc061 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:24.457556 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-56133806-4512-4207-bde2-1da12b0dc061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:24.614059 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56133806-4512-4207-bde2-1da12b0dc061 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:24.621868 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde7a8d-ef81-44e1-b025-a433eddf427f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:24.623408 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde7a8d-ef81-44e1-b025-a433eddf427f service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:24.625113 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde7a8d-ef81-44e1-b025-a433eddf427f service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:24.628740 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde7a8d-ef81-44e1-b025-a433eddf427f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:24.649790 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde7a8d-ef81-44e1-b025-a433eddf427f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:24.652980 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde7a8d-ef81-44e1-b025-a433eddf427f service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:24.676610 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1293/2570] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:33:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:33:25.431646 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706ee51-f61c-438f-ac01-d3714ebe80fc None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:25.434224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f706ee51-f61c-438f-ac01-d3714ebe80fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:25.458711 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706ee51-f61c-438f-ac01-d3714ebe80fc None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:25.466900 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede282aa-7ece-4fac-a3c3-4c5ee8c98f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:25.468801 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede282aa-7ece-4fac-a3c3-4c5ee8c98f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:25.469275 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede282aa-7ece-4fac-a3c3-4c5ee8c98f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:25.470591 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede282aa-7ece-4fac-a3c3-4c5ee8c98f3a admin admin] PATH_INFO: `/v3/projects/09040c788c1d4dd5a44907e8c049a07c` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:25.473251 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede282aa-7ece-4fac-a3c3-4c5ee8c98f3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=09040c788c1d4dd5a44907e8c049a07c)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:25.477154 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede282aa-7ece-4fac-a3c3-4c5ee8c98f3a admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:25.596461 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:33:25.604499 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ede282aa-7ece-4fac-a3c3-4c5ee8c98f3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09040c788c1d4dd5a44907e8c049a07c', 'request_id': 'req-ede282aa-7ece-4fac-a3c3-4c5ee8c98f3a'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:25.621240 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ede282aa-7ece-4fac-a3c3-4c5ee8c98f3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09040c788c1d4dd5a44907e8c049a07c', 'request_id': 'req-ede282aa-7ece-4fac-a3c3-4c5ee8c98f3a'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:25.637184 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ede282aa-7ece-4fac-a3c3-4c5ee8c98f3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09040c788c1d4dd5a44907e8c049a07c', 'request_id': 'req-ede282aa-7ece-4fac-a3c3-4c5ee8c98f3a'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:25.660705 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ede282aa-7ece-4fac-a3c3-4c5ee8c98f3a admin admin] The token cache is being invalidate because project 09040c788c1d4dd5a44907e8c049a07c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:33:25.661161 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ede282aa-7ece-4fac-a3c3-4c5ee8c98f3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:25.662347 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ede282aa-7ece-4fac-a3c3-4c5ee8c98f3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:25.664868 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1278/2571] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:33:25 2022] DELETE /identity/v3/projects/09040c788c1d4dd5a44907e8c049a07c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:33:25.670036 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde7a8d-ef81-44e1-b025-a433eddf427f service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:25.693029 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde7a8d-ef81-44e1-b025-a433eddf427f service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:25.817203 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5001e14-5182-4892-a69b-a4b20710dfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:25.818163 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5001e14-5182-4892-a69b-a4b20710dfd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:25.818554 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5001e14-5182-4892-a69b-a4b20710dfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:25.819011 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5001e14-5182-4892-a69b-a4b20710dfd2 admin admin] PATH_INFO: `/v3/users/346c70a90eac4ca69571ac5515dd9512` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:25.820931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5001e14-5182-4892-a69b-a4b20710dfd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=346c70a90eac4ca69571ac5515dd9512)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:25.824925 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5001e14-5182-4892-a69b-a4b20710dfd2 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:25.866023 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:33:25.919133 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b5001e14-5182-4892-a69b-a4b20710dfd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '346c70a90eac4ca69571ac5515dd9512'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:25.920308 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b5001e14-5182-4892-a69b-a4b20710dfd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '346c70a90eac4ca69571ac5515dd9512'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:25.949701 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b5001e14-5182-4892-a69b-a4b20710dfd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '346c70a90eac4ca69571ac5515dd9512'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:25.965954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b5001e14-5182-4892-a69b-a4b20710dfd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '346c70a90eac4ca69571ac5515dd9512'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:25.967496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b5001e14-5182-4892-a69b-a4b20710dfd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '346c70a90eac4ca69571ac5515dd9512'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:25.989276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1294/2572] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:33:25 2022] DELETE /identity/v3/users/346c70a90eac4ca69571ac5515dd9512 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:33:26.482523 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede282aa-7ece-4fac-a3c3-4c5ee8c98f3a admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:26.484119 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-ede282aa-7ece-4fac-a3c3-4c5ee8c98f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:26.498492 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede282aa-7ece-4fac-a3c3-4c5ee8c98f3a admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:26.633251 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a574d4-996f-4716-8bb0-3d5e4f3497f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:26.635381 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a574d4-996f-4716-8bb0-3d5e4f3497f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:26.636131 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a574d4-996f-4716-8bb0-3d5e4f3497f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:26.636805 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a574d4-996f-4716-8bb0-3d5e4f3497f5 admin admin] PATH_INFO: `/v3/projects/6449e73e394f4b9ebb6ce17577b90e23` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:26.640158 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a574d4-996f-4716-8bb0-3d5e4f3497f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6449e73e394f4b9ebb6ce17577b90e23)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:26.644009 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a574d4-996f-4716-8bb0-3d5e4f3497f5 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:26.737608 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b0a574d4-996f-4716-8bb0-3d5e4f3497f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6449e73e394f4b9ebb6ce17577b90e23', 'request_id': 'req-b0a574d4-996f-4716-8bb0-3d5e4f3497f5'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:26.755341 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b0a574d4-996f-4716-8bb0-3d5e4f3497f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6449e73e394f4b9ebb6ce17577b90e23', 'request_id': 'req-b0a574d4-996f-4716-8bb0-3d5e4f3497f5'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:26.768093 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b0a574d4-996f-4716-8bb0-3d5e4f3497f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6449e73e394f4b9ebb6ce17577b90e23', 'request_id': 'req-b0a574d4-996f-4716-8bb0-3d5e4f3497f5'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:26.785139 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b0a574d4-996f-4716-8bb0-3d5e4f3497f5 admin admin] The token cache is being invalidate because project 6449e73e394f4b9ebb6ce17577b90e23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:33:26.785422 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b0a574d4-996f-4716-8bb0-3d5e4f3497f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:26.786370 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b0a574d4-996f-4716-8bb0-3d5e4f3497f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:33:26.788160 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1279/2573] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:33:26 2022] DELETE /identity/v3/projects/6449e73e394f4b9ebb6ce17577b90e23 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:33:26.797046 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9455534-02ef-47df-983e-0cc8b401c4fe None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:26.797711 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9455534-02ef-47df-983e-0cc8b401c4fe None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:26.797711 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9455534-02ef-47df-983e-0cc8b401c4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:26.825870 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-f9455534-02ef-47df-983e-0cc8b401c4fe None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:33:26.828691 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f9455534-02ef-47df-983e-0cc8b401c4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:26.964514 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1295/2574] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:33:26.973712 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a75ca-2c41-4de6-819f-a2a3bfc11704 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:26.974408 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a75ca-2c41-4de6-819f-a2a3bfc11704 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:26.975027 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a75ca-2c41-4de6-819f-a2a3bfc11704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:27.008219 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-1d6a75ca-2c41-4de6-819f-a2a3bfc11704 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:33:27.010565 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-1d6a75ca-2c41-4de6-819f-a2a3bfc11704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:27.024498 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1280/2575] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:33:27.033331 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9455534-02ef-47df-983e-0cc8b401c4fe None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:27.055933 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9455534-02ef-47df-983e-0cc8b401c4fe None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:27.064272 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48148434-b76e-441e-816e-5a1c4b0192ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:27.065078 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48148434-b76e-441e-816e-5a1c4b0192ba admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:27.065597 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48148434-b76e-441e-816e-5a1c4b0192ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:27.066157 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48148434-b76e-441e-816e-5a1c4b0192ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:27.067191 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48148434-b76e-441e-816e-5a1c4b0192ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:33:27.067551 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48148434-b76e-441e-816e-5a1c4b0192ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:27.069485 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48148434-b76e-441e-816e-5a1c4b0192ba admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:27.092311 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1296/2576] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:33:27.098296 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a75ca-2c41-4de6-819f-a2a3bfc11704 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:27.112928 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a75ca-2c41-4de6-819f-a2a3bfc11704 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:27.119771 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be744a-2600-47ab-98c1-bd0029c1143d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:27.121152 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be744a-2600-47ab-98c1-bd0029c1143d admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:27.121737 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be744a-2600-47ab-98c1-bd0029c1143d admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:27.122377 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be744a-2600-47ab-98c1-bd0029c1143d admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:27.123854 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be744a-2600-47ab-98c1-bd0029c1143d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:27.126900 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be744a-2600-47ab-98c1-bd0029c1143d admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:27.183319 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1281/2577] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:33:27 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:33:27.185237 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48148434-b76e-441e-816e-5a1c4b0192ba admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:27.200644 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48148434-b76e-441e-816e-5a1c4b0192ba admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:27.312458 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267525c9-66b9-4444-8224-3556aede24a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:27.313514 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267525c9-66b9-4444-8224-3556aede24a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:27.314548 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267525c9-66b9-4444-8224-3556aede24a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:27.314548 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267525c9-66b9-4444-8224-3556aede24a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:27.315943 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267525c9-66b9-4444-8224-3556aede24a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:27.319777 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267525c9-66b9-4444-8224-3556aede24a7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:27.361318 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1297/2578] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:33:27 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:33:27.363604 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be744a-2600-47ab-98c1-bd0029c1143d admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:27.384500 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be744a-2600-47ab-98c1-bd0029c1143d admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:27.397250 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50be59-8e0d-4dbe-a895-0c69b9152a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:27.398943 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50be59-8e0d-4dbe-a895-0c69b9152a8b admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:27.399452 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50be59-8e0d-4dbe-a895-0c69b9152a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:27.399900 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50be59-8e0d-4dbe-a895-0c69b9152a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:27.401232 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50be59-8e0d-4dbe-a895-0c69b9152a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:27.404280 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50be59-8e0d-4dbe-a895-0c69b9152a8b admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:27.436022 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1282/2579] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:33:27.442850 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267525c9-66b9-4444-8224-3556aede24a7 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:27.463362 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267525c9-66b9-4444-8224-3556aede24a7 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:27.472762 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25484fa3-238f-4997-ac3c-bd21ebe38281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:27.474222 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25484fa3-238f-4997-ac3c-bd21ebe38281 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:27.474751 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25484fa3-238f-4997-ac3c-bd21ebe38281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:27.475676 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25484fa3-238f-4997-ac3c-bd21ebe38281 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:27.476947 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25484fa3-238f-4997-ac3c-bd21ebe38281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:27.480449 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25484fa3-238f-4997-ac3c-bd21ebe38281 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:27.501635 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1298/2580] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:33:27.507054 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50be59-8e0d-4dbe-a895-0c69b9152a8b admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:27.528635 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50be59-8e0d-4dbe-a895-0c69b9152a8b admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:27.542964 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2ac0a-0ec9-4a02-aa77-85600b57f8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:27.542964 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2ac0a-0ec9-4a02-aa77-85600b57f8f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:27.542964 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2ac0a-0ec9-4a02-aa77-85600b57f8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:27.542964 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2ac0a-0ec9-4a02-aa77-85600b57f8f7 admin admin] PATH_INFO: `/v3/projects/4bd43a8efe194f6995e86f5bf4c9a315/users/3a6a607473134b38958de91af1c71975/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:27.578096 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2ac0a-0ec9-4a02-aa77-85600b57f8f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bd43a8efe194f6995e86f5bf4c9a315, user_id=3a6a607473134b38958de91af1c71975, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:27.583723 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2ac0a-0ec9-4a02-aa77-85600b57f8f7 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:27.599236 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:33:27.617163 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1283/2581] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:33:27 2022] PUT /identity/v3/projects/4bd43a8efe194f6995e86f5bf4c9a315/users/3a6a607473134b38958de91af1c71975/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:33:27.630792 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3fa2d-0b1a-4e29-a91a-19ffdd18b94f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:27.631982 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3fa2d-0b1a-4e29-a91a-19ffdd18b94f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:27.632883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3fa2d-0b1a-4e29-a91a-19ffdd18b94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:27.658425 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:33:27.672686 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-bef3fa2d-0b1a-4e29-a91a-19ffdd18b94f None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:33:27.677428 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-bef3fa2d-0b1a-4e29-a91a-19ffdd18b94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:27.782197 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1299/2582] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:33:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:33:27.795672 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2ac0a-0ec9-4a02-aa77-85600b57f8f7 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:27.799678 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-70b2ac0a-0ec9-4a02-aa77-85600b57f8f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:27.903220 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2ac0a-0ec9-4a02-aa77-85600b57f8f7 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:27.907991 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8376da5-f146-4e14-9c9d-f2ac454472e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:27.908726 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8376da5-f146-4e14-9c9d-f2ac454472e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:27.909009 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8376da5-f146-4e14-9c9d-f2ac454472e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:27.909289 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8376da5-f146-4e14-9c9d-f2ac454472e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:27.920216 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8376da5-f146-4e14-9c9d-f2ac454472e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:27.921733 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8376da5-f146-4e14-9c9d-f2ac454472e3 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:27.943692 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1284/2583] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:33:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:33:29.023383 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353fade-18cc-4ca1-86a0-dc98db0a014b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:29.024279 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353fade-18cc-4ca1-86a0-dc98db0a014b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:29.026153 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353fade-18cc-4ca1-86a0-dc98db0a014b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:29.083427 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-0353fade-18cc-4ca1-86a0-dc98db0a014b None None] MFA Rules not processed for user `3a6a607473134b38958de91af1c71975`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:33:29.085043 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0353fade-18cc-4ca1-86a0-dc98db0a014b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:29.164829 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1300/2584] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:33:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:33:29.176533 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8376da5-f146-4e14-9c9d-f2ac454472e3 service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:29.178482 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a8376da5-f146-4e14-9c9d-f2ac454472e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:29.259643 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8376da5-f146-4e14-9c9d-f2ac454472e3 service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:29.265196 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45377b8d-b0b4-445f-9115-b5fa2bd4f500 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:29.266349 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45377b8d-b0b4-445f-9115-b5fa2bd4f500 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:29.266700 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45377b8d-b0b4-445f-9115-b5fa2bd4f500 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:29.268095 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45377b8d-b0b4-445f-9115-b5fa2bd4f500 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:29.285738 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45377b8d-b0b4-445f-9115-b5fa2bd4f500 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:29.288370 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45377b8d-b0b4-445f-9115-b5fa2bd4f500 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:29.299575 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1285/2585] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:33:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:33:30.040765 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353fade-18cc-4ca1-86a0-dc98db0a014b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:30.043031 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0353fade-18cc-4ca1-86a0-dc98db0a014b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:30.140597 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353fade-18cc-4ca1-86a0-dc98db0a014b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:30.150213 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ebb0e-7280-4dae-884b-499a040d3fb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:30.151415 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ebb0e-7280-4dae-884b-499a040d3fb0 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:30.151924 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ebb0e-7280-4dae-884b-499a040d3fb0 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:30.152418 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ebb0e-7280-4dae-884b-499a040d3fb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:30.156614 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-677ebb0e-7280-4dae-884b-499a040d3fb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:30.204400 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:33:30.237727 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ebb0e-7280-4dae-884b-499a040d3fb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:30.240346 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ebb0e-7280-4dae-884b-499a040d3fb0 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:30.252547 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1301/2586] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:33:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:33:30.735156 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ba14e-d2dc-4066-884e-24e685257c5a None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:30.735711 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ba14e-d2dc-4066-884e-24e685257c5a None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:30.735711 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ba14e-d2dc-4066-884e-24e685257c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:30.755412 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-6a4ba14e-d2dc-4066-884e-24e685257c5a None None] MFA Rules not processed for user `3a6a607473134b38958de91af1c71975`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:33:30.756682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6a4ba14e-d2dc-4066-884e-24e685257c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:30.764170 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1286/2587] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:33:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:33:31.020288 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ebb0e-7280-4dae-884b-499a040d3fb0 service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:31.037156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ebb0e-7280-4dae-884b-499a040d3fb0 service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:31.043290 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873cbdc-ceb5-4615-82e8-8cd32f7d6ab4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:31.044065 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873cbdc-ceb5-4615-82e8-8cd32f7d6ab4 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:31.044452 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873cbdc-ceb5-4615-82e8-8cd32f7d6ab4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:31.044616 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873cbdc-ceb5-4615-82e8-8cd32f7d6ab4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:31.046711 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3873cbdc-ceb5-4615-82e8-8cd32f7d6ab4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:31.057542 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873cbdc-ceb5-4615-82e8-8cd32f7d6ab4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:31.059031 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873cbdc-ceb5-4615-82e8-8cd32f7d6ab4 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:31.068665 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1302/2588] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:33:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:33:35.441947 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ba14e-d2dc-4066-884e-24e685257c5a None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:35.443537 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6a4ba14e-d2dc-4066-884e-24e685257c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:35.463430 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ba14e-d2dc-4066-884e-24e685257c5a None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:35.470436 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04cf89a-c41a-44e8-abdf-09e489b9249e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:35.471198 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cf89a-c41a-44e8-abdf-09e489b9249e service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:35.471562 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cf89a-c41a-44e8-abdf-09e489b9249e service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:35.471843 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cf89a-c41a-44e8-abdf-09e489b9249e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:35.473927 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e04cf89a-c41a-44e8-abdf-09e489b9249e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:35.490534 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04cf89a-c41a-44e8-abdf-09e489b9249e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:35.493747 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04cf89a-c41a-44e8-abdf-09e489b9249e service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:35.517670 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1287/2589] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:33:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:33:37.764372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa343932-e155-49c4-9661-0c5db6e5d1de None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:37.765226 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa343932-e155-49c4-9661-0c5db6e5d1de None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:37.765226 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa343932-e155-49c4-9661-0c5db6e5d1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:37.785095 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-fa343932-e155-49c4-9661-0c5db6e5d1de None None] MFA Rules not processed for user `3fa2ad34164a4631adf76fbd042679ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:33:37.786418 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-fa343932-e155-49c4-9661-0c5db6e5d1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:37.851399 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1303/2590] 10.222.0.32 () {58 vars in 1009 bytes} [Wed Jun 1 04:33:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:33:37.864313 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04cf89a-c41a-44e8-abdf-09e489b9249e service nova] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:37.865834 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e04cf89a-c41a-44e8-abdf-09e489b9249e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:37.945164 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04cf89a-c41a-44e8-abdf-09e489b9249e service nova] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:37.954215 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2584e-f7e3-470a-8ee9-e89f9f148ab4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413c6613b4ec4e53aeeaf6828c807273', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:37.955593 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2584e-f7e3-470a-8ee9-e89f9f148ab4 service swift] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:37.955991 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2584e-f7e3-470a-8ee9-e89f9f148ab4 service swift] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:37.956387 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2584e-f7e3-470a-8ee9-e89f9f148ab4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:37.970494 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2584e-f7e3-470a-8ee9-e89f9f148ab4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:37.972341 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2584e-f7e3-470a-8ee9-e89f9f148ab4 service swift] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:37.982544 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1288/2591] 10.222.0.32 () {60 vars in 1384 bytes} [Wed Jun 1 04:33:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 01 04:33:47.844283 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=43 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:33:47.978154 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=94 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:33:53.345286 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c36fc4-4491-4748-bc2f-61e4badaa59f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:53.346806 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c36fc4-4491-4748-bc2f-61e4badaa59f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:53.347744 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c36fc4-4491-4748-bc2f-61e4badaa59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:53.383754 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-20c36fc4-4491-4748-bc2f-61e4badaa59f None None] MFA Rules not processed for user `84e5577e32e545c0a060cce6238208eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:33:53.386402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-20c36fc4-4491-4748-bc2f-61e4badaa59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:53.485201 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1304/2592] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:33:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:33:54.242855 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f55fd-0a2a-48af-bfff-65c6d61f079b None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:54.243691 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f55fd-0a2a-48af-bfff-65c6d61f079b None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:54.243691 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f55fd-0a2a-48af-bfff-65c6d61f079b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:54.264922 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-b01f55fd-0a2a-48af-bfff-65c6d61f079b None None] MFA Rules not processed for user `3fa2ad34164a4631adf76fbd042679ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:33:54.266526 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-b01f55fd-0a2a-48af-bfff-65c6d61f079b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:54.275194 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1289/2593] 10.222.0.32 () {58 vars in 967 bytes} [Wed Jun 1 04:33:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:33:54.294600 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c36fc4-4491-4748-bc2f-61e4badaa59f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:33:54.321310 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c36fc4-4491-4748-bc2f-61e4badaa59f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:33:54.330779 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a4fb68-1d93-4a08-a48e-0d6beddd6d3b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413c6613b4ec4e53aeeaf6828c807273', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:33:54.331925 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4fb68-1d93-4a08-a48e-0d6beddd6d3b service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:54.332419 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4fb68-1d93-4a08-a48e-0d6beddd6d3b service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:54.332898 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4fb68-1d93-4a08-a48e-0d6beddd6d3b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:54.349847 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a4fb68-1d93-4a08-a48e-0d6beddd6d3b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:33:54.353010 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a4fb68-1d93-4a08-a48e-0d6beddd6d3b service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:33:54.371698 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1305/2594] 10.222.0.32 () {60 vars in 1384 bytes} [Wed Jun 1 04:33:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 01 04:33:55.035779 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87414f80-08b8-46b2-9cdd-1a4d49d7a6d8 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:33:55.036389 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87414f80-08b8-46b2-9cdd-1a4d49d7a6d8 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:33:55.036674 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87414f80-08b8-46b2-9cdd-1a4d49d7a6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:33:55.062137 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-87414f80-08b8-46b2-9cdd-1a4d49d7a6d8 None None] MFA Rules not processed for user `3a6a607473134b38958de91af1c71975`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:33:55.064124 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-87414f80-08b8-46b2-9cdd-1a4d49d7a6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:33:55.077275 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1290/2595] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:33:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:34:04.363577 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=31 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:05.054824 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=6 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:15.505493 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2fa9d-0a4c-4387-9e9f-3f00f223ff95 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:15.506157 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2fa9d-0a4c-4387-9e9f-3f00f223ff95 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:15.506157 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2fa9d-0a4c-4387-9e9f-3f00f223ff95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:15.535714 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-15c2fa9d-0a4c-4387-9e9f-3f00f223ff95 None None] MFA Rules not processed for user `3fa2ad34164a4631adf76fbd042679ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:34:15.538217 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-15c2fa9d-0a4c-4387-9e9f-3f00f223ff95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:15.551887 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1306/2596] 10.222.0.32 () {58 vars in 1009 bytes} [Wed Jun 1 04:34:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:34:15.566361 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87414f80-08b8-46b2-9cdd-1a4d49d7a6d8 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:15.580154 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87414f80-08b8-46b2-9cdd-1a4d49d7a6d8 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:15.585462 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23e19b-99cb-4b2b-8c8d-c024a6d1ad93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413c6613b4ec4e53aeeaf6828c807273', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:15.586160 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23e19b-99cb-4b2b-8c8d-c024a6d1ad93 service swift] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:15.586455 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23e19b-99cb-4b2b-8c8d-c024a6d1ad93 service swift] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:15.586737 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23e19b-99cb-4b2b-8c8d-c024a6d1ad93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:15.596188 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a23e19b-99cb-4b2b-8c8d-c024a6d1ad93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:15.597835 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a23e19b-99cb-4b2b-8c8d-c024a6d1ad93 service swift] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:15.608593 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1291/2597] 10.222.0.32 () {60 vars in 1384 bytes} [Wed Jun 1 04:34:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 01 04:34:25.526192 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:25.603883 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=6 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:33.562149 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b0df8-2a2b-403b-a873-175686ab25de None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:33.562811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b0df8-2a2b-403b-a873-175686ab25de None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:33.563131 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b0df8-2a2b-403b-a873-175686ab25de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:33.595351 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-fd0b0df8-2a2b-403b-a873-175686ab25de None None] MFA Rules not processed for user `3fa2ad34164a4631adf76fbd042679ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:34:33.597487 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-fd0b0df8-2a2b-403b-a873-175686ab25de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:33.610843 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1307/2598] 10.222.0.32 () {58 vars in 967 bytes} [Wed Jun 1 04:34:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:34:33.624769 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23e19b-99cb-4b2b-8c8d-c024a6d1ad93 service swift] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:33.638079 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23e19b-99cb-4b2b-8c8d-c024a6d1ad93 service swift] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:33.644009 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5be9ee-6f02-450c-94f1-2eb424c77e2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '413c6613b4ec4e53aeeaf6828c807273', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:33.644764 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5be9ee-6f02-450c-94f1-2eb424c77e2a service swift] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:33.645111 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5be9ee-6f02-450c-94f1-2eb424c77e2a service swift] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:33.645457 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5be9ee-6f02-450c-94f1-2eb424c77e2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:33.656619 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5be9ee-6f02-450c-94f1-2eb424c77e2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:33.658311 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5be9ee-6f02-450c-94f1-2eb424c77e2a service swift] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:33.669175 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1292/2599] 10.222.0.32 () {60 vars in 1384 bytes} [Wed Jun 1 04:34:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 01 04:34:36.565688 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b0df8-2a2b-403b-a873-175686ab25de None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:36.579162 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b0df8-2a2b-403b-a873-175686ab25de None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:36.584606 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a4e04-0245-4da1-b2d7-ea42a78733d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:36.585520 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a4e04-0245-4da1-b2d7-ea42a78733d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:36.585811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a4e04-0245-4da1-b2d7-ea42a78733d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:36.586143 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a4e04-0245-4da1-b2d7-ea42a78733d6 admin admin] PATH_INFO: `/v3/users/3a6a607473134b38958de91af1c71975` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:36.587578 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a4e04-0245-4da1-b2d7-ea42a78733d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a6a607473134b38958de91af1c71975)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:36.589590 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a4e04-0245-4da1-b2d7-ea42a78733d6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:36.648800 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5a3a4e04-0245-4da1-b2d7-ea42a78733d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a6a607473134b38958de91af1c71975'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:36.649513 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5a3a4e04-0245-4da1-b2d7-ea42a78733d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a6a607473134b38958de91af1c71975'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:36.665548 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5a3a4e04-0245-4da1-b2d7-ea42a78733d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a6a607473134b38958de91af1c71975'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:36.677130 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5a3a4e04-0245-4da1-b2d7-ea42a78733d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a6a607473134b38958de91af1c71975'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:36.677718 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5a3a4e04-0245-4da1-b2d7-ea42a78733d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a6a607473134b38958de91af1c71975'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:36.693235 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1308/2600] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:34:36 2022] DELETE /identity/v3/users/3a6a607473134b38958de91af1c71975 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:34:36.901605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5be9ee-6f02-450c-94f1-2eb424c77e2a service swift] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:36.919468 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5be9ee-6f02-450c-94f1-2eb424c77e2a service swift] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:37.006418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a693328-2392-4fd7-a3e3-42f5eb9fa970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:37.007655 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a693328-2392-4fd7-a3e3-42f5eb9fa970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:37.007994 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a693328-2392-4fd7-a3e3-42f5eb9fa970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:37.008420 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a693328-2392-4fd7-a3e3-42f5eb9fa970 admin admin] PATH_INFO: `/v3/projects/4bd43a8efe194f6995e86f5bf4c9a315` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:37.009871 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a693328-2392-4fd7-a3e3-42f5eb9fa970 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bd43a8efe194f6995e86f5bf4c9a315)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:37.011913 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a693328-2392-4fd7-a3e3-42f5eb9fa970 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:37.070207 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-2a693328-2392-4fd7-a3e3-42f5eb9fa970 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bd43a8efe194f6995e86f5bf4c9a315', 'request_id': 'req-2a693328-2392-4fd7-a3e3-42f5eb9fa970'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:37.080148 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-2a693328-2392-4fd7-a3e3-42f5eb9fa970 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bd43a8efe194f6995e86f5bf4c9a315', 'request_id': 'req-2a693328-2392-4fd7-a3e3-42f5eb9fa970'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:37.087410 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-2a693328-2392-4fd7-a3e3-42f5eb9fa970 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bd43a8efe194f6995e86f5bf4c9a315', 'request_id': 'req-2a693328-2392-4fd7-a3e3-42f5eb9fa970'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:37.102404 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-2a693328-2392-4fd7-a3e3-42f5eb9fa970 admin admin] The token cache is being invalidate because project 4bd43a8efe194f6995e86f5bf4c9a315 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:34:37.102886 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-2a693328-2392-4fd7-a3e3-42f5eb9fa970 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:37.103988 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-2a693328-2392-4fd7-a3e3-42f5eb9fa970 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:37.106772 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1293/2601] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:34:36 2022] DELETE /identity/v3/projects/4bd43a8efe194f6995e86f5bf4c9a315 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:34:37.116475 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fd9ef-618a-4505-b737-0a2dc8f71851 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:37.116979 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fd9ef-618a-4505-b737-0a2dc8f71851 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:37.117485 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fd9ef-618a-4505-b737-0a2dc8f71851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:37.148666 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-360fd9ef-618a-4505-b737-0a2dc8f71851 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:34:37.150867 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-360fd9ef-618a-4505-b737-0a2dc8f71851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:37.267945 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1309/2602] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:34:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:34:37.276888 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fbb77-b2ca-4a48-a529-49dc8ee6eb3e None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:37.277370 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fbb77-b2ca-4a48-a529-49dc8ee6eb3e None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:37.277878 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fbb77-b2ca-4a48-a529-49dc8ee6eb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:37.307883 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-567fbb77-b2ca-4a48-a529-49dc8ee6eb3e None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:34:37.309738 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-567fbb77-b2ca-4a48-a529-49dc8ee6eb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:37.319787 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1294/2603] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:34:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:34:37.326070 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fd9ef-618a-4505-b737-0a2dc8f71851 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:37.337452 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fd9ef-618a-4505-b737-0a2dc8f71851 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:37.343171 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ccb6c8-6b45-4f4a-9903-42cd4eb86a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:37.343856 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccb6c8-6b45-4f4a-9903-42cd4eb86a32 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:37.344141 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccb6c8-6b45-4f4a-9903-42cd4eb86a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:37.344419 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccb6c8-6b45-4f4a-9903-42cd4eb86a32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:37.345160 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ccb6c8-6b45-4f4a-9903-42cd4eb86a32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:34:37.345477 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ccb6c8-6b45-4f4a-9903-42cd4eb86a32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:37.347150 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ccb6c8-6b45-4f4a-9903-42cd4eb86a32 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:37.361660 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1310/2604] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:34:37.367539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567fbb77-b2ca-4a48-a529-49dc8ee6eb3e None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:37.380724 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567fbb77-b2ca-4a48-a529-49dc8ee6eb3e None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:37.385949 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbc9f2-b1fa-488c-846d-968d18426043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:37.386823 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbc9f2-b1fa-488c-846d-968d18426043 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:37.387675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbc9f2-b1fa-488c-846d-968d18426043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:37.387970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbc9f2-b1fa-488c-846d-968d18426043 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:37.388801 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcbc9f2-b1fa-488c-846d-968d18426043 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:37.390932 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcbc9f2-b1fa-488c-846d-968d18426043 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:37.456114 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1295/2605] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:34:37 2022] POST /identity/v3/projects => generated 385 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:34:37.460523 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ccb6c8-6b45-4f4a-9903-42cd4eb86a32 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:37.472846 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ccb6c8-6b45-4f4a-9903-42cd4eb86a32 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:37.533968 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:37.546477 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd39c3-74e6-4b56-9f28-a0e368089be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:37.547598 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd39c3-74e6-4b56-9f28-a0e368089be9 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:37.548340 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd39c3-74e6-4b56-9f28-a0e368089be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:37.548862 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd39c3-74e6-4b56-9f28-a0e368089be9 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:37.550167 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dd39c3-74e6-4b56-9f28-a0e368089be9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:37.553883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dd39c3-74e6-4b56-9f28-a0e368089be9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:37.587352 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1311/2606] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:34:37 2022] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:34:37.592625 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbc9f2-b1fa-488c-846d-968d18426043 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:37.607461 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbc9f2-b1fa-488c-846d-968d18426043 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:37.613017 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fcf784-d6ae-4a56-9824-8185e730b1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:37.613732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcf784-d6ae-4a56-9824-8185e730b1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:37.614044 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcf784-d6ae-4a56-9824-8185e730b1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:37.614322 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcf784-d6ae-4a56-9824-8185e730b1f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:37.615091 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fcf784-d6ae-4a56-9824-8185e730b1f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:37.617177 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fcf784-d6ae-4a56-9824-8185e730b1f3 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:37.630177 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1296/2607] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:34:37.637054 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd39c3-74e6-4b56-9f28-a0e368089be9 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:37.655921 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd39c3-74e6-4b56-9f28-a0e368089be9 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:37.663850 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185416e9-27c0-4589-968a-f3108e3981ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:37.664622 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185416e9-27c0-4589-968a-f3108e3981ea admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:37.664954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185416e9-27c0-4589-968a-f3108e3981ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:37.665276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185416e9-27c0-4589-968a-f3108e3981ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:37.666146 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185416e9-27c0-4589-968a-f3108e3981ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:37.667932 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185416e9-27c0-4589-968a-f3108e3981ea admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:37.681862 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1312/2608] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:34:37.688374 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fcf784-d6ae-4a56-9824-8185e730b1f3 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:37.700629 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fcf784-d6ae-4a56-9824-8185e730b1f3 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:37.707286 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d83d1-6555-44cc-89de-bbbc1758d5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:37.708912 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d83d1-6555-44cc-89de-bbbc1758d5fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:37.709413 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d83d1-6555-44cc-89de-bbbc1758d5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:37.709916 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d83d1-6555-44cc-89de-bbbc1758d5fd admin admin] PATH_INFO: `/v3/projects/7b3f7bc03f6a4c1795e004d9044972fb/users/ea091da3c0c04edfad070b54b8cb07f8/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:37.736877 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d83d1-6555-44cc-89de-bbbc1758d5fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b3f7bc03f6a4c1795e004d9044972fb, user_id=ea091da3c0c04edfad070b54b8cb07f8, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:37.739965 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d83d1-6555-44cc-89de-bbbc1758d5fd admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:37.760916 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1297/2609] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:34:37 2022] PUT /identity/v3/projects/7b3f7bc03f6a4c1795e004d9044972fb/users/ea091da3c0c04edfad070b54b8cb07f8/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:34:37.779163 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b0cff-0cc6-4d53-8fef-60db7cdb88a5 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:37.779484 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b0cff-0cc6-4d53-8fef-60db7cdb88a5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:37.779779 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b0cff-0cc6-4d53-8fef-60db7cdb88a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:37.820624 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b02b0cff-0cc6-4d53-8fef-60db7cdb88a5 None None] MFA Rules not processed for user `ea091da3c0c04edfad070b54b8cb07f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:34:37.822653 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b02b0cff-0cc6-4d53-8fef-60db7cdb88a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:37.905944 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1313/2610] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:34:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:34:37.919218 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d83d1-6555-44cc-89de-bbbc1758d5fd admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:37.921072 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d06d83d1-6555-44cc-89de-bbbc1758d5fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:37.928071 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:37.991686 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d83d1-6555-44cc-89de-bbbc1758d5fd admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:37.996139 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088649ae-d20d-461f-b385-f5bb40e19e5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:37.997218 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088649ae-d20d-461f-b385-f5bb40e19e5d service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:37.997585 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088649ae-d20d-461f-b385-f5bb40e19e5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:37.997901 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088649ae-d20d-461f-b385-f5bb40e19e5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:38.007910 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088649ae-d20d-461f-b385-f5bb40e19e5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:38.009431 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088649ae-d20d-461f-b385-f5bb40e19e5d service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:38.020064 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1298/2611] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:34:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:34:38.615564 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b0cff-0cc6-4d53-8fef-60db7cdb88a5 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:38.617169 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b02b0cff-0cc6-4d53-8fef-60db7cdb88a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:38.686956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b0cff-0cc6-4d53-8fef-60db7cdb88a5 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:38.691291 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfbc68-1fa1-4cb7-8707-804d8f186e83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:38.692113 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfbc68-1fa1-4cb7-8707-804d8f186e83 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:38.692497 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfbc68-1fa1-4cb7-8707-804d8f186e83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:38.692871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfbc68-1fa1-4cb7-8707-804d8f186e83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:38.695052 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a3dfbc68-1fa1-4cb7-8707-804d8f186e83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:38.783513 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dfbc68-1fa1-4cb7-8707-804d8f186e83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:38.784905 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dfbc68-1fa1-4cb7-8707-804d8f186e83 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:38.797965 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1314/2612] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:34:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:34:40.784278 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088649ae-d20d-461f-b385-f5bb40e19e5d service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:40.797046 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088649ae-d20d-461f-b385-f5bb40e19e5d service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:40.802902 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a606b-286e-43cf-9b06-b8b55efe244c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:40.803837 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a606b-286e-43cf-9b06-b8b55efe244c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:40.804103 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a606b-286e-43cf-9b06-b8b55efe244c admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:40.804397 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a606b-286e-43cf-9b06-b8b55efe244c admin admin] PATH_INFO: `/v3/users/ea091da3c0c04edfad070b54b8cb07f8` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:40.805898 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a606b-286e-43cf-9b06-b8b55efe244c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea091da3c0c04edfad070b54b8cb07f8)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:40.808049 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a606b-286e-43cf-9b06-b8b55efe244c admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:40.874352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-516a606b-286e-43cf-9b06-b8b55efe244c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea091da3c0c04edfad070b54b8cb07f8'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:40.875088 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-516a606b-286e-43cf-9b06-b8b55efe244c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea091da3c0c04edfad070b54b8cb07f8'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:40.900639 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-516a606b-286e-43cf-9b06-b8b55efe244c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea091da3c0c04edfad070b54b8cb07f8'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:40.910592 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-516a606b-286e-43cf-9b06-b8b55efe244c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea091da3c0c04edfad070b54b8cb07f8'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:40.925439 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-516a606b-286e-43cf-9b06-b8b55efe244c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea091da3c0c04edfad070b54b8cb07f8'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:40.939215 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1299/2613] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:34:40 2022] DELETE /identity/v3/users/ea091da3c0c04edfad070b54b8cb07f8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:34:40.940936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c1927-ab7a-45aa-b66c-84519d83bf65 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:40.941804 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c1927-ab7a-45aa-b66c-84519d83bf65 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:40.941804 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c1927-ab7a-45aa-b66c-84519d83bf65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:40.963637 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-187c1927-ab7a-45aa-b66c-84519d83bf65 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:34:40.964971 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-187c1927-ab7a-45aa-b66c-84519d83bf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:40.971648 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:41.075864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1315/2614] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:34:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:34:41.092232 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a606b-286e-43cf-9b06-b8b55efe244c admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:41.093841 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-516a606b-286e-43cf-9b06-b8b55efe244c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:41.215774 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a606b-286e-43cf-9b06-b8b55efe244c admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:41.222861 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521586f9-1998-43a2-a285-ec35c723e806 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:41.224424 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521586f9-1998-43a2-a285-ec35c723e806 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:41.225456 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521586f9-1998-43a2-a285-ec35c723e806 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:41.225701 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521586f9-1998-43a2-a285-ec35c723e806 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:41.244513 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521586f9-1998-43a2-a285-ec35c723e806 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:41.249511 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521586f9-1998-43a2-a285-ec35c723e806 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:41.268202 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1300/2615] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:34:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:34:41.610267 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c1927-ab7a-45aa-b66c-84519d83bf65 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:41.614434 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-187c1927-ab7a-45aa-b66c-84519d83bf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:41.637362 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c1927-ab7a-45aa-b66c-84519d83bf65 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:41.646339 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478effa-d599-41cf-b32c-c37f6efd772d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:41.647945 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478effa-d599-41cf-b32c-c37f6efd772d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:41.648414 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478effa-d599-41cf-b32c-c37f6efd772d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:41.648875 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478effa-d599-41cf-b32c-c37f6efd772d admin admin] PATH_INFO: `/v3/projects/7b3f7bc03f6a4c1795e004d9044972fb` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:41.674229 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478effa-d599-41cf-b32c-c37f6efd772d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b3f7bc03f6a4c1795e004d9044972fb)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:41.677602 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478effa-d599-41cf-b32c-c37f6efd772d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:41.772549 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2478effa-d599-41cf-b32c-c37f6efd772d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b3f7bc03f6a4c1795e004d9044972fb', 'request_id': 'req-2478effa-d599-41cf-b32c-c37f6efd772d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:41.782829 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2478effa-d599-41cf-b32c-c37f6efd772d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b3f7bc03f6a4c1795e004d9044972fb', 'request_id': 'req-2478effa-d599-41cf-b32c-c37f6efd772d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:41.800667 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2478effa-d599-41cf-b32c-c37f6efd772d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b3f7bc03f6a4c1795e004d9044972fb', 'request_id': 'req-2478effa-d599-41cf-b32c-c37f6efd772d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:41.820299 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2478effa-d599-41cf-b32c-c37f6efd772d admin admin] The token cache is being invalidate because project 7b3f7bc03f6a4c1795e004d9044972fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:34:41.820299 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2478effa-d599-41cf-b32c-c37f6efd772d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:41.826331 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2478effa-d599-41cf-b32c-c37f6efd772d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:41.834107 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1316/2616] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:34:41 2022] DELETE /identity/v3/projects/7b3f7bc03f6a4c1795e004d9044972fb => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:34:43.014571 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521586f9-1998-43a2-a285-ec35c723e806 service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:43.017215 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-521586f9-1998-43a2-a285-ec35c723e806 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:43.058341 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:43.075457 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478effa-d599-41cf-b32c-c37f6efd772d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:43.078636 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2478effa-d599-41cf-b32c-c37f6efd772d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:43.179384 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521586f9-1998-43a2-a285-ec35c723e806 service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:43.198039 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478effa-d599-41cf-b32c-c37f6efd772d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:43.204299 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a96544-54ee-46d7-8c4c-35001233b03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:43.206073 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a96544-54ee-46d7-8c4c-35001233b03e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:43.206581 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a96544-54ee-46d7-8c4c-35001233b03e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:43.207093 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a96544-54ee-46d7-8c4c-35001233b03e admin admin] PATH_INFO: `/v3/users/d5a8390d1220475582b70d1347a1ef14` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:43.209460 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a96544-54ee-46d7-8c4c-35001233b03e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5a8390d1220475582b70d1347a1ef14)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:43.213472 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a96544-54ee-46d7-8c4c-35001233b03e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:43.255959 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e25b5-3d74-44de-851c-1416c184ceb1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0433f6219478476286ea27c5c82d41a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:43.256793 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e25b5-3d74-44de-851c-1416c184ceb1 service placement] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:43.257019 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e25b5-3d74-44de-851c-1416c184ceb1 service placement] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:43.257300 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e25b5-3d74-44de-851c-1416c184ceb1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:43.259438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-063e25b5-3d74-44de-851c-1416c184ceb1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:43.274353 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e25b5-3d74-44de-851c-1416c184ceb1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:43.277072 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e25b5-3d74-44de-851c-1416c184ceb1 service placement] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:43.287859 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:43.290841 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1301/2617] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:34:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:34:43.305463 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d5a96544-54ee-46d7-8c4c-35001233b03e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5a8390d1220475582b70d1347a1ef14'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:43.308097 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d5a96544-54ee-46d7-8c4c-35001233b03e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5a8390d1220475582b70d1347a1ef14'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:43.328375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d5a96544-54ee-46d7-8c4c-35001233b03e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5a8390d1220475582b70d1347a1ef14'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:43.339400 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d5a96544-54ee-46d7-8c4c-35001233b03e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5a8390d1220475582b70d1347a1ef14'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:43.340158 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d5a96544-54ee-46d7-8c4c-35001233b03e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5a8390d1220475582b70d1347a1ef14'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:43.354781 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1317/2618] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:34:43 2022] DELETE /identity/v3/users/d5a8390d1220475582b70d1347a1ef14 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:34:43.623957 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e25b5-3d74-44de-851c-1416c184ceb1 service placement] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:43.641642 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e25b5-3d74-44de-851c-1416c184ceb1 service placement] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:43.734744 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d06746-6bc8-4e62-9cbe-d3dd563c067e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:43.735847 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d06746-6bc8-4e62-9cbe-d3dd563c067e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:43.736142 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d06746-6bc8-4e62-9cbe-d3dd563c067e admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:43.736424 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d06746-6bc8-4e62-9cbe-d3dd563c067e admin admin] PATH_INFO: `/v3/projects/e007a22c150b4988983eaacfb5b9b2b8` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:43.738109 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d06746-6bc8-4e62-9cbe-d3dd563c067e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e007a22c150b4988983eaacfb5b9b2b8)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:43.740119 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d06746-6bc8-4e62-9cbe-d3dd563c067e admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:43.800359 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-64d06746-6bc8-4e62-9cbe-d3dd563c067e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e007a22c150b4988983eaacfb5b9b2b8', 'request_id': 'req-64d06746-6bc8-4e62-9cbe-d3dd563c067e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:43.810027 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-64d06746-6bc8-4e62-9cbe-d3dd563c067e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e007a22c150b4988983eaacfb5b9b2b8', 'request_id': 'req-64d06746-6bc8-4e62-9cbe-d3dd563c067e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:43.811910 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:43.821884 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-64d06746-6bc8-4e62-9cbe-d3dd563c067e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e007a22c150b4988983eaacfb5b9b2b8', 'request_id': 'req-64d06746-6bc8-4e62-9cbe-d3dd563c067e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:43.838338 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-64d06746-6bc8-4e62-9cbe-d3dd563c067e admin admin] The token cache is being invalidate because project e007a22c150b4988983eaacfb5b9b2b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:34:43.838841 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-64d06746-6bc8-4e62-9cbe-d3dd563c067e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:43.840235 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-64d06746-6bc8-4e62-9cbe-d3dd563c067e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:43.841962 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1302/2619] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:34:43 2022] DELETE /identity/v3/projects/e007a22c150b4988983eaacfb5b9b2b8 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:34:43.848626 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e43a9-5f15-4ec2-85ee-f7aab4a5cfee None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:43.849121 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e43a9-5f15-4ec2-85ee-f7aab4a5cfee None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:43.849422 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e43a9-5f15-4ec2-85ee-f7aab4a5cfee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:43.876115 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-098e43a9-5f15-4ec2-85ee-f7aab4a5cfee None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:34:43.877382 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-098e43a9-5f15-4ec2-85ee-f7aab4a5cfee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:43.957798 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1318/2620] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:34:43.966777 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36493f-cb8f-468b-8f30-bf56f53d2dea None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:43.967121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36493f-cb8f-468b-8f30-bf56f53d2dea None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:43.967344 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36493f-cb8f-468b-8f30-bf56f53d2dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:43.987904 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-ea36493f-cb8f-468b-8f30-bf56f53d2dea None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:34:43.989155 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-ea36493f-cb8f-468b-8f30-bf56f53d2dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:43.997642 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1303/2621] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:34:44.002982 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e43a9-5f15-4ec2-85ee-f7aab4a5cfee None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:44.014101 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e43a9-5f15-4ec2-85ee-f7aab4a5cfee None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:44.019269 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c08c0-3923-4c3c-928a-bb664b137e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:44.019964 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c08c0-3923-4c3c-928a-bb664b137e35 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:44.020251 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c08c0-3923-4c3c-928a-bb664b137e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:44.020530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c08c0-3923-4c3c-928a-bb664b137e35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:44.021283 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c08c0-3923-4c3c-928a-bb664b137e35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:34:44.021595 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c08c0-3923-4c3c-928a-bb664b137e35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:44.023476 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c08c0-3923-4c3c-928a-bb664b137e35 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:44.037768 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1319/2622] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:34:44.044896 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36493f-cb8f-468b-8f30-bf56f53d2dea None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:44.060695 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36493f-cb8f-468b-8f30-bf56f53d2dea None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:44.067848 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93539385-df5f-4a2d-aac0-d024b037102c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:44.068827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93539385-df5f-4a2d-aac0-d024b037102c admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:44.069260 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93539385-df5f-4a2d-aac0-d024b037102c admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:44.069735 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93539385-df5f-4a2d-aac0-d024b037102c admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:44.070932 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93539385-df5f-4a2d-aac0-d024b037102c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:44.075026 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93539385-df5f-4a2d-aac0-d024b037102c admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:44.113063 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1304/2623] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:34:44 2022] POST /identity/v3/projects => generated 371 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:34:44.117485 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c08c0-3923-4c3c-928a-bb664b137e35 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:44.128540 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c08c0-3923-4c3c-928a-bb664b137e35 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:44.201080 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48f11a-7ed7-4ed3-95bc-3c2bc2528dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:44.201847 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48f11a-7ed7-4ed3-95bc-3c2bc2528dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:44.202266 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48f11a-7ed7-4ed3-95bc-3c2bc2528dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:44.202666 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48f11a-7ed7-4ed3-95bc-3c2bc2528dd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:44.203524 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e48f11a-7ed7-4ed3-95bc-3c2bc2528dd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:44.205510 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e48f11a-7ed7-4ed3-95bc-3c2bc2528dd5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:44.228904 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1320/2624] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:34:44 2022] POST /identity/v3/users => generated 286 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:34:44.234695 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93539385-df5f-4a2d-aac0-d024b037102c admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:44.246173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93539385-df5f-4a2d-aac0-d024b037102c admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:44.251711 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410dd86-7f25-4019-9964-96bf2ae00b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:44.252399 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410dd86-7f25-4019-9964-96bf2ae00b97 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:44.252680 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410dd86-7f25-4019-9964-96bf2ae00b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:44.252956 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410dd86-7f25-4019-9964-96bf2ae00b97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:44.253700 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1410dd86-7f25-4019-9964-96bf2ae00b97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:44.255370 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1410dd86-7f25-4019-9964-96bf2ae00b97 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:44.268308 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1305/2625] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:34:44.272891 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48f11a-7ed7-4ed3-95bc-3c2bc2528dd5 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:44.284128 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48f11a-7ed7-4ed3-95bc-3c2bc2528dd5 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:44.289372 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c781c-8d11-43b2-b61d-e628416bfd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:44.290102 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c781c-8d11-43b2-b61d-e628416bfd66 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:44.290387 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c781c-8d11-43b2-b61d-e628416bfd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:44.290664 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c781c-8d11-43b2-b61d-e628416bfd66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:44.291417 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c781c-8d11-43b2-b61d-e628416bfd66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:44.293060 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c781c-8d11-43b2-b61d-e628416bfd66 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:44.304679 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1321/2626] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:34:44.309465 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410dd86-7f25-4019-9964-96bf2ae00b97 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:44.321692 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410dd86-7f25-4019-9964-96bf2ae00b97 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:44.327457 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b2f18-3c7f-4ae6-9326-28d0cb4a3611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:44.328363 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b2f18-3c7f-4ae6-9326-28d0cb4a3611 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:44.328645 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b2f18-3c7f-4ae6-9326-28d0cb4a3611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:44.328924 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b2f18-3c7f-4ae6-9326-28d0cb4a3611 admin admin] PATH_INFO: `/v3/projects/e5d4fa7f0350460193fe1be9164e22e7/users/cc1f436aef3640e9bd6f28f19a842b26/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:44.346192 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b2f18-3c7f-4ae6-9326-28d0cb4a3611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5d4fa7f0350460193fe1be9164e22e7, user_id=cc1f436aef3640e9bd6f28f19a842b26, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:44.349091 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b2f18-3c7f-4ae6-9326-28d0cb4a3611 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:44.365090 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1306/2627] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:34:44 2022] PUT /identity/v3/projects/e5d4fa7f0350460193fe1be9164e22e7/users/cc1f436aef3640e9bd6f28f19a842b26/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:34:44.376540 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc6cc7-e54d-4114-8635-40bcdc86058e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:44.376993 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc6cc7-e54d-4114-8635-40bcdc86058e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:44.377366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc6cc7-e54d-4114-8635-40bcdc86058e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:44.409682 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c7dc6cc7-e54d-4114-8635-40bcdc86058e None None] MFA Rules not processed for user `cc1f436aef3640e9bd6f28f19a842b26`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:34:44.411481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c7dc6cc7-e54d-4114-8635-40bcdc86058e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:44.421747 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:44.492261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1322/2628] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:34:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:34:44.504658 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b2f18-3c7f-4ae6-9326-28d0cb4a3611 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:44.506625 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-060b2f18-3c7f-4ae6-9326-28d0cb4a3611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:44.588354 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b2f18-3c7f-4ae6-9326-28d0cb4a3611 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:44.594692 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1701741-d669-4fd4-ad32-802a6a74b01d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:44.595362 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1701741-d669-4fd4-ad32-802a6a74b01d service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:44.595647 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1701741-d669-4fd4-ad32-802a6a74b01d service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:44.595924 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1701741-d669-4fd4-ad32-802a6a74b01d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:44.604726 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1701741-d669-4fd4-ad32-802a6a74b01d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:44.606915 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1701741-d669-4fd4-ad32-802a6a74b01d service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:44.617090 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1307/2629] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:34:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:34:47.409413 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc6cc7-e54d-4114-8635-40bcdc86058e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:47.488164 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc6cc7-e54d-4114-8635-40bcdc86058e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:47.493551 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a338fc-091d-4111-be0f-716a7acde1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:47.494483 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a338fc-091d-4111-be0f-716a7acde1f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:47.494774 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a338fc-091d-4111-be0f-716a7acde1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:47.495054 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a338fc-091d-4111-be0f-716a7acde1f5 admin admin] PATH_INFO: `/v3/users/cc1f436aef3640e9bd6f28f19a842b26` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:47.496361 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a338fc-091d-4111-be0f-716a7acde1f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc1f436aef3640e9bd6f28f19a842b26)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:47.498357 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a338fc-091d-4111-be0f-716a7acde1f5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:47.554890 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-00a338fc-091d-4111-be0f-716a7acde1f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc1f436aef3640e9bd6f28f19a842b26'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:47.555595 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-00a338fc-091d-4111-be0f-716a7acde1f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc1f436aef3640e9bd6f28f19a842b26'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:47.571227 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-00a338fc-091d-4111-be0f-716a7acde1f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc1f436aef3640e9bd6f28f19a842b26'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:47.580144 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-00a338fc-091d-4111-be0f-716a7acde1f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc1f436aef3640e9bd6f28f19a842b26'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:47.580946 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-00a338fc-091d-4111-be0f-716a7acde1f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc1f436aef3640e9bd6f28f19a842b26'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:47.596276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1323/2630] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:34:47 2022] DELETE /identity/v3/users/cc1f436aef3640e9bd6f28f19a842b26 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:34:47.601438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118094d-7c71-44fb-8567-8ca42bdbdf9d None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:47.604431 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118094d-7c71-44fb-8567-8ca42bdbdf9d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:47.604431 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118094d-7c71-44fb-8567-8ca42bdbdf9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:47.622845 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-3118094d-7c71-44fb-8567-8ca42bdbdf9d None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:34:47.624110 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3118094d-7c71-44fb-8567-8ca42bdbdf9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:47.695874 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1308/2631] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:34:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:34:47.707829 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a338fc-091d-4111-be0f-716a7acde1f5 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:47.709321 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-00a338fc-091d-4111-be0f-716a7acde1f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:47.754945 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:47.789610 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a338fc-091d-4111-be0f-716a7acde1f5 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:47.794615 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9112d-77e2-4d6b-85d7-609e1efcd9a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:47.795296 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9112d-77e2-4d6b-85d7-609e1efcd9a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:47.795612 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9112d-77e2-4d6b-85d7-609e1efcd9a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:47.795924 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9112d-77e2-4d6b-85d7-609e1efcd9a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:47.807386 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c9112d-77e2-4d6b-85d7-609e1efcd9a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:47.810126 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c9112d-77e2-4d6b-85d7-609e1efcd9a5 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:47.826065 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1324/2632] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:34:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:34:48.146472 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118094d-7c71-44fb-8567-8ca42bdbdf9d None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:48.156121 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3118094d-7c71-44fb-8567-8ca42bdbdf9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:48.176006 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118094d-7c71-44fb-8567-8ca42bdbdf9d None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:48.181220 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341bbf5-4b24-4bc1-a879-760b3ec92795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:48.182377 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341bbf5-4b24-4bc1-a879-760b3ec92795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:48.182745 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341bbf5-4b24-4bc1-a879-760b3ec92795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:48.183090 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341bbf5-4b24-4bc1-a879-760b3ec92795 admin admin] PATH_INFO: `/v3/projects/e5d4fa7f0350460193fe1be9164e22e7` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:48.186074 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341bbf5-4b24-4bc1-a879-760b3ec92795 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5d4fa7f0350460193fe1be9164e22e7)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:48.189233 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341bbf5-4b24-4bc1-a879-760b3ec92795 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:48.192170 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:48.248882 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-e341bbf5-4b24-4bc1-a879-760b3ec92795 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5d4fa7f0350460193fe1be9164e22e7', 'request_id': 'req-e341bbf5-4b24-4bc1-a879-760b3ec92795'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:48.258492 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-e341bbf5-4b24-4bc1-a879-760b3ec92795 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5d4fa7f0350460193fe1be9164e22e7', 'request_id': 'req-e341bbf5-4b24-4bc1-a879-760b3ec92795'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:48.266923 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-e341bbf5-4b24-4bc1-a879-760b3ec92795 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5d4fa7f0350460193fe1be9164e22e7', 'request_id': 'req-e341bbf5-4b24-4bc1-a879-760b3ec92795'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:48.279787 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-e341bbf5-4b24-4bc1-a879-760b3ec92795 admin admin] The token cache is being invalidate because project e5d4fa7f0350460193fe1be9164e22e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:34:48.280097 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-e341bbf5-4b24-4bc1-a879-760b3ec92795 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:48.280772 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-e341bbf5-4b24-4bc1-a879-760b3ec92795 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:48.282429 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1309/2633] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:34:48 2022] DELETE /identity/v3/projects/e5d4fa7f0350460193fe1be9164e22e7 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:34:48.288026 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f665902-e1b1-4408-a67c-ec85c725bf60 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:48.288488 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f665902-e1b1-4408-a67c-ec85c725bf60 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:48.288879 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f665902-e1b1-4408-a67c-ec85c725bf60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:48.309455 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-4f665902-e1b1-4408-a67c-ec85c725bf60 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:34:48.310817 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4f665902-e1b1-4408-a67c-ec85c725bf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:48.414962 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1325/2634] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:34:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:34:48.425368 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fba59-0766-4abb-97e3-c17b198cf5ec None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:48.425658 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fba59-0766-4abb-97e3-c17b198cf5ec None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:48.425933 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fba59-0766-4abb-97e3-c17b198cf5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:48.448340 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-059fba59-0766-4abb-97e3-c17b198cf5ec None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:34:48.450770 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-059fba59-0766-4abb-97e3-c17b198cf5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:48.461248 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1310/2635] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:34:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:34:48.466580 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f665902-e1b1-4408-a67c-ec85c725bf60 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:48.477826 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f665902-e1b1-4408-a67c-ec85c725bf60 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:48.483838 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc7cc7-7c10-472a-9666-2ecd630c48f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:48.484535 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc7cc7-7c10-472a-9666-2ecd630c48f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:48.484826 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc7cc7-7c10-472a-9666-2ecd630c48f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:48.485109 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc7cc7-7c10-472a-9666-2ecd630c48f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:48.485863 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc7cc7-7c10-472a-9666-2ecd630c48f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:34:48.486222 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc7cc7-7c10-472a-9666-2ecd630c48f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:48.487903 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc7cc7-7c10-472a-9666-2ecd630c48f3 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:48.502360 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1326/2636] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:34:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:34:48.507118 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059fba59-0766-4abb-97e3-c17b198cf5ec None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:48.517527 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059fba59-0766-4abb-97e3-c17b198cf5ec None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:48.522983 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19c772-c5c4-4d2c-840c-5531d909de8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:48.523820 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19c772-c5c4-4d2c-840c-5531d909de8b admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:48.524204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19c772-c5c4-4d2c-840c-5531d909de8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:48.524582 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19c772-c5c4-4d2c-840c-5531d909de8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:48.525394 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f19c772-c5c4-4d2c-840c-5531d909de8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:48.528106 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f19c772-c5c4-4d2c-840c-5531d909de8b admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:48.560027 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1311/2637] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:34:48 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:34:48.565257 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc7cc7-7c10-472a-9666-2ecd630c48f3 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:48.576855 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc7cc7-7c10-472a-9666-2ecd630c48f3 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:48.645830 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d5f2d-7716-41cd-9a5b-f09ea2cc741a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:48.646611 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d5f2d-7716-41cd-9a5b-f09ea2cc741a admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:48.646938 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d5f2d-7716-41cd-9a5b-f09ea2cc741a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:48.647277 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d5f2d-7716-41cd-9a5b-f09ea2cc741a admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:48.648035 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d5f2d-7716-41cd-9a5b-f09ea2cc741a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:48.650203 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d5f2d-7716-41cd-9a5b-f09ea2cc741a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:48.674616 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1327/2638] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:34:48 2022] POST /identity/v3/users => generated 283 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:34:48.679120 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19c772-c5c4-4d2c-840c-5531d909de8b admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:48.692366 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19c772-c5c4-4d2c-840c-5531d909de8b admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:48.697743 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22704c05-c3ed-43bd-a685-7b984883be0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:48.698467 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22704c05-c3ed-43bd-a685-7b984883be0d admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:48.698756 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22704c05-c3ed-43bd-a685-7b984883be0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:48.699585 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22704c05-c3ed-43bd-a685-7b984883be0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:48.700338 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22704c05-c3ed-43bd-a685-7b984883be0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:48.702098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22704c05-c3ed-43bd-a685-7b984883be0d admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:48.716758 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1312/2639] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:34:48.721906 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d5f2d-7716-41cd-9a5b-f09ea2cc741a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:48.738665 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d5f2d-7716-41cd-9a5b-f09ea2cc741a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:48.746845 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7054a7-9b6c-4df0-bc59-958d30eed052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:48.747414 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7054a7-9b6c-4df0-bc59-958d30eed052 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:48.747873 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7054a7-9b6c-4df0-bc59-958d30eed052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:48.748309 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7054a7-9b6c-4df0-bc59-958d30eed052 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:48.749647 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7054a7-9b6c-4df0-bc59-958d30eed052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:48.752706 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7054a7-9b6c-4df0-bc59-958d30eed052 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:48.772658 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1328/2640] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:34:48.778071 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22704c05-c3ed-43bd-a685-7b984883be0d admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:48.790051 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22704c05-c3ed-43bd-a685-7b984883be0d admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:48.795429 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631edc8-320b-4f4c-9730-f8e68b3164a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:48.796351 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631edc8-320b-4f4c-9730-f8e68b3164a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:48.796634 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631edc8-320b-4f4c-9730-f8e68b3164a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:48.796916 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631edc8-320b-4f4c-9730-f8e68b3164a3 admin admin] PATH_INFO: `/v3/projects/7f803aa5ab0f452ba4a5147832bd834f/users/8fb60a04d4234a44b58a3eaaaa1df0d7/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:48.814124 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631edc8-320b-4f4c-9730-f8e68b3164a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f803aa5ab0f452ba4a5147832bd834f, user_id=8fb60a04d4234a44b58a3eaaaa1df0d7, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:48.816812 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631edc8-320b-4f4c-9730-f8e68b3164a3 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:48.835163 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1313/2641] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:34:48 2022] PUT /identity/v3/projects/7f803aa5ab0f452ba4a5147832bd834f/users/8fb60a04d4234a44b58a3eaaaa1df0d7/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:34:48.852026 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb757a-3094-4ebe-a924-33985bda9ca3 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:48.852304 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb757a-3094-4ebe-a924-33985bda9ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:48.852590 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb757a-3094-4ebe-a924-33985bda9ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:48.883377 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e3eb757a-3094-4ebe-a924-33985bda9ca3 None None] MFA Rules not processed for user `8fb60a04d4234a44b58a3eaaaa1df0d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:34:48.884616 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e3eb757a-3094-4ebe-a924-33985bda9ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:48.917330 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:48.971875 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1329/2642] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:34:48 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:34:48.976903 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631edc8-320b-4f4c-9730-f8e68b3164a3 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:49.050480 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631edc8-320b-4f4c-9730-f8e68b3164a3 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:49.060020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840afeb-d299-4345-bb61-0c5d7a3c163f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:49.061136 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840afeb-d299-4345-bb61-0c5d7a3c163f admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:49.061710 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840afeb-d299-4345-bb61-0c5d7a3c163f admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:49.062417 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840afeb-d299-4345-bb61-0c5d7a3c163f admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:49.063738 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840afeb-d299-4345-bb61-0c5d7a3c163f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:49.067373 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840afeb-d299-4345-bb61-0c5d7a3c163f admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:49.110910 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1314/2643] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:34:48 2022] POST /identity/v3/projects => generated 365 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:34:49.115948 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb757a-3094-4ebe-a924-33985bda9ca3 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:49.129470 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb757a-3094-4ebe-a924-33985bda9ca3 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:49.202760 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91c1d0-92a9-49cd-8512-35d44bf6fe0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:49.203453 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91c1d0-92a9-49cd-8512-35d44bf6fe0f admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:49.203732 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91c1d0-92a9-49cd-8512-35d44bf6fe0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:49.204010 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91c1d0-92a9-49cd-8512-35d44bf6fe0f admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:49.204758 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91c1d0-92a9-49cd-8512-35d44bf6fe0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:49.206806 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91c1d0-92a9-49cd-8512-35d44bf6fe0f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:49.230063 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1330/2644] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:34:49 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:34:49.236470 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840afeb-d299-4345-bb61-0c5d7a3c163f admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:49.256033 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840afeb-d299-4345-bb61-0c5d7a3c163f admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:49.264708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0efecc-1ba7-404b-9f6e-e86c875fa3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:49.265613 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0efecc-1ba7-404b-9f6e-e86c875fa3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:49.266092 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0efecc-1ba7-404b-9f6e-e86c875fa3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:49.266531 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0efecc-1ba7-404b-9f6e-e86c875fa3f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:49.267621 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0efecc-1ba7-404b-9f6e-e86c875fa3f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:49.269550 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0efecc-1ba7-404b-9f6e-e86c875fa3f0 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:49.276739 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:49.286173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1315/2645] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:34:49.290615 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91c1d0-92a9-49cd-8512-35d44bf6fe0f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:49.302414 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91c1d0-92a9-49cd-8512-35d44bf6fe0f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:49.307592 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d366a5e2-f85c-48a4-bb69-7a28efc45124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:49.309285 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366a5e2-f85c-48a4-bb69-7a28efc45124 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:49.309569 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366a5e2-f85c-48a4-bb69-7a28efc45124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:49.310030 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366a5e2-f85c-48a4-bb69-7a28efc45124 admin admin] PATH_INFO: `/v3/projects/d00a4d181b3647f5a1097066f85e6fc8/users/14b04bdc96054a65ad1c2c4c23ba5a29/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:49.330444 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d366a5e2-f85c-48a4-bb69-7a28efc45124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d00a4d181b3647f5a1097066f85e6fc8, user_id=14b04bdc96054a65ad1c2c4c23ba5a29, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:49.333370 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d366a5e2-f85c-48a4-bb69-7a28efc45124 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:49.349484 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1331/2646] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:34:49 2022] PUT /identity/v3/projects/d00a4d181b3647f5a1097066f85e6fc8/users/14b04bdc96054a65ad1c2c4c23ba5a29/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:34:49.354190 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0efecc-1ba7-404b-9f6e-e86c875fa3f0 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:49.367767 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0efecc-1ba7-404b-9f6e-e86c875fa3f0 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:49.433037 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a9584-28e6-4568-a8d6-6d02bee833f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:49.433751 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a9584-28e6-4568-a8d6-6d02bee833f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:49.434066 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a9584-28e6-4568-a8d6-6d02bee833f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:49.434350 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a9584-28e6-4568-a8d6-6d02bee833f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:49.435090 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a9584-28e6-4568-a8d6-6d02bee833f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:49.436713 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a9584-28e6-4568-a8d6-6d02bee833f2 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:49.449715 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1316/2647] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:34:49.454595 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d366a5e2-f85c-48a4-bb69-7a28efc45124 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:49.466740 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d366a5e2-f85c-48a4-bb69-7a28efc45124 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:49.471713 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3828d1-4232-4dac-8420-57a696acce8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:49.472632 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3828d1-4232-4dac-8420-57a696acce8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:49.472913 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3828d1-4232-4dac-8420-57a696acce8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:49.473189 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3828d1-4232-4dac-8420-57a696acce8f admin admin] PATH_INFO: `/v3/projects/d00a4d181b3647f5a1097066f85e6fc8/users/14b04bdc96054a65ad1c2c4c23ba5a29/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:49.475315 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3828d1-4232-4dac-8420-57a696acce8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d00a4d181b3647f5a1097066f85e6fc8, user_id=14b04bdc96054a65ad1c2c4c23ba5a29, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:49.478009 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3828d1-4232-4dac-8420-57a696acce8f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:49.491615 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1332/2648] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:34:49 2022] PUT /identity/v3/projects/d00a4d181b3647f5a1097066f85e6fc8/users/14b04bdc96054a65ad1c2c4c23ba5a29/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:34:49.503466 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5719c77-049e-4bfc-91ae-396c2893bd07 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:49.503793 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5719c77-049e-4bfc-91ae-396c2893bd07 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:49.504147 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5719c77-049e-4bfc-91ae-396c2893bd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:49.533605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-e5719c77-049e-4bfc-91ae-396c2893bd07 None None] MFA Rules not processed for user `14b04bdc96054a65ad1c2c4c23ba5a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:34:49.534887 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e5719c77-049e-4bfc-91ae-396c2893bd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:49.619673 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1317/2649] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:34:49 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:34:49.633090 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3828d1-4232-4dac-8420-57a696acce8f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:49.635340 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1e3828d1-4232-4dac-8420-57a696acce8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:49.705004 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3828d1-4232-4dac-8420-57a696acce8f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:49.708951 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ea782-6fc2-446d-a9e6-a0516c861680 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:49.709623 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ea782-6fc2-446d-a9e6-a0516c861680 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:49.709917 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ea782-6fc2-446d-a9e6-a0516c861680 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:49.710230 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ea782-6fc2-446d-a9e6-a0516c861680 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:49.721161 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ea782-6fc2-446d-a9e6-a0516c861680 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:49.722692 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ea782-6fc2-446d-a9e6-a0516c861680 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:49.734297 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1333/2650] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:34:49 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:34:50.288232 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5719c77-049e-4bfc-91ae-396c2893bd07 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:50.361342 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5719c77-049e-4bfc-91ae-396c2893bd07 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:50.366287 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d94846-1385-407b-8975-0ce7d3eb1642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:50.367183 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d94846-1385-407b-8975-0ce7d3eb1642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:50.367467 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d94846-1385-407b-8975-0ce7d3eb1642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:50.367763 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d94846-1385-407b-8975-0ce7d3eb1642 admin admin] PATH_INFO: `/v3/users/8fb60a04d4234a44b58a3eaaaa1df0d7` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:50.369002 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d94846-1385-407b-8975-0ce7d3eb1642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fb60a04d4234a44b58a3eaaaa1df0d7)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:50.371579 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d94846-1385-407b-8975-0ce7d3eb1642 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:50.398675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:50.427783 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-e8d94846-1385-407b-8975-0ce7d3eb1642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fb60a04d4234a44b58a3eaaaa1df0d7'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:50.428464 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-e8d94846-1385-407b-8975-0ce7d3eb1642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fb60a04d4234a44b58a3eaaaa1df0d7'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:50.442503 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-e8d94846-1385-407b-8975-0ce7d3eb1642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fb60a04d4234a44b58a3eaaaa1df0d7'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:50.451546 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-e8d94846-1385-407b-8975-0ce7d3eb1642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fb60a04d4234a44b58a3eaaaa1df0d7'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:50.460640 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-e8d94846-1385-407b-8975-0ce7d3eb1642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fb60a04d4234a44b58a3eaaaa1df0d7'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:50.468795 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1318/2651] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:34:50 2022] DELETE /identity/v3/users/8fb60a04d4234a44b58a3eaaaa1df0d7 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:34:50.473818 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb825862-1581-4265-9a0a-4ff1bdfbf401 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:50.474752 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb825862-1581-4265-9a0a-4ff1bdfbf401 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:50.474752 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb825862-1581-4265-9a0a-4ff1bdfbf401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:50.494327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-cb825862-1581-4265-9a0a-4ff1bdfbf401 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:34:50.495578 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cb825862-1581-4265-9a0a-4ff1bdfbf401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:50.514954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:50.571058 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1334/2652] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:34:50.584946 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d94846-1385-407b-8975-0ce7d3eb1642 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:50.586559 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e8d94846-1385-407b-8975-0ce7d3eb1642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:50.655283 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d94846-1385-407b-8975-0ce7d3eb1642 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:50.659381 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28690df4-e68e-4244-ab66-4206bcd2deae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:50.660066 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28690df4-e68e-4244-ab66-4206bcd2deae service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:50.660354 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28690df4-e68e-4244-ab66-4206bcd2deae service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:50.660638 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28690df4-e68e-4244-ab66-4206bcd2deae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:50.671794 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28690df4-e68e-4244-ab66-4206bcd2deae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:50.673355 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28690df4-e68e-4244-ab66-4206bcd2deae service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:50.684891 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1319/2653] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:34:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:34:51.008310 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb825862-1581-4265-9a0a-4ff1bdfbf401 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:51.010409 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cb825862-1581-4265-9a0a-4ff1bdfbf401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:51.028936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb825862-1581-4265-9a0a-4ff1bdfbf401 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:51.035075 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cbe59-34e6-4368-8ae0-c8c4993af313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:51.036252 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cbe59-34e6-4368-8ae0-c8c4993af313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:51.036688 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cbe59-34e6-4368-8ae0-c8c4993af313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:51.037187 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cbe59-34e6-4368-8ae0-c8c4993af313 admin admin] PATH_INFO: `/v3/projects/7f803aa5ab0f452ba4a5147832bd834f` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:51.038838 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00cbe59-34e6-4368-8ae0-c8c4993af313 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f803aa5ab0f452ba4a5147832bd834f)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:51.040931 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00cbe59-34e6-4368-8ae0-c8c4993af313 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:51.104518 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c00cbe59-34e6-4368-8ae0-c8c4993af313 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f803aa5ab0f452ba4a5147832bd834f', 'request_id': 'req-c00cbe59-34e6-4368-8ae0-c8c4993af313'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:51.111419 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c00cbe59-34e6-4368-8ae0-c8c4993af313 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f803aa5ab0f452ba4a5147832bd834f', 'request_id': 'req-c00cbe59-34e6-4368-8ae0-c8c4993af313'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:51.121208 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c00cbe59-34e6-4368-8ae0-c8c4993af313 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f803aa5ab0f452ba4a5147832bd834f', 'request_id': 'req-c00cbe59-34e6-4368-8ae0-c8c4993af313'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:51.135978 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c00cbe59-34e6-4368-8ae0-c8c4993af313 admin admin] The token cache is being invalidate because project 7f803aa5ab0f452ba4a5147832bd834f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:34:51.137009 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c00cbe59-34e6-4368-8ae0-c8c4993af313 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:51.138537 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c00cbe59-34e6-4368-8ae0-c8c4993af313 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:51.141239 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1335/2654] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:34:51 2022] DELETE /identity/v3/projects/7f803aa5ab0f452ba4a5147832bd834f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:34:51.147618 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28690df4-e68e-4244-ab66-4206bcd2deae service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:51.162327 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28690df4-e68e-4244-ab66-4206bcd2deae service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:51.253771 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2afa3e-0787-429c-bd07-535555ab15ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:51.255335 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2afa3e-0787-429c-bd07-535555ab15ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:51.255903 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2afa3e-0787-429c-bd07-535555ab15ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:51.256382 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2afa3e-0787-429c-bd07-535555ab15ce admin admin] PATH_INFO: `/v3/users/14b04bdc96054a65ad1c2c4c23ba5a29` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:51.258714 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2afa3e-0787-429c-bd07-535555ab15ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=14b04bdc96054a65ad1c2c4c23ba5a29)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:51.262886 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2afa3e-0787-429c-bd07-535555ab15ce admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:51.332860 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:51.335766 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-8b2afa3e-0787-429c-bd07-535555ab15ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14b04bdc96054a65ad1c2c4c23ba5a29'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:51.336693 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-8b2afa3e-0787-429c-bd07-535555ab15ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14b04bdc96054a65ad1c2c4c23ba5a29'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:51.355765 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-8b2afa3e-0787-429c-bd07-535555ab15ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14b04bdc96054a65ad1c2c4c23ba5a29'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:51.366387 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-8b2afa3e-0787-429c-bd07-535555ab15ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14b04bdc96054a65ad1c2c4c23ba5a29'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:51.376014 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-8b2afa3e-0787-429c-bd07-535555ab15ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14b04bdc96054a65ad1c2c4c23ba5a29'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:51.383172 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1320/2655] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:34:51 2022] DELETE /identity/v3/users/14b04bdc96054a65ad1c2c4c23ba5a29 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:34:51.728315 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cbe59-34e6-4368-8ae0-c8c4993af313 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:51.730795 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c00cbe59-34e6-4368-8ae0-c8c4993af313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:51.748871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cbe59-34e6-4368-8ae0-c8c4993af313 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:51.825452 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd203adc-fb9d-429b-b33e-b199d6310649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:51.827013 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd203adc-fb9d-429b-b33e-b199d6310649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:51.827561 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd203adc-fb9d-429b-b33e-b199d6310649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:51.828054 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd203adc-fb9d-429b-b33e-b199d6310649 admin admin] PATH_INFO: `/v3/projects/d00a4d181b3647f5a1097066f85e6fc8` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:51.830340 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd203adc-fb9d-429b-b33e-b199d6310649 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d00a4d181b3647f5a1097066f85e6fc8)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:51.834162 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd203adc-fb9d-429b-b33e-b199d6310649 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:51.896209 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:51.898483 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bd203adc-fb9d-429b-b33e-b199d6310649 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd00a4d181b3647f5a1097066f85e6fc8', 'request_id': 'req-bd203adc-fb9d-429b-b33e-b199d6310649'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:51.911343 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bd203adc-fb9d-429b-b33e-b199d6310649 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd00a4d181b3647f5a1097066f85e6fc8', 'request_id': 'req-bd203adc-fb9d-429b-b33e-b199d6310649'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:51.923786 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bd203adc-fb9d-429b-b33e-b199d6310649 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd00a4d181b3647f5a1097066f85e6fc8', 'request_id': 'req-bd203adc-fb9d-429b-b33e-b199d6310649'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:51.938393 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bd203adc-fb9d-429b-b33e-b199d6310649 admin admin] The token cache is being invalidate because project d00a4d181b3647f5a1097066f85e6fc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:34:51.938682 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bd203adc-fb9d-429b-b33e-b199d6310649 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:51.939704 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bd203adc-fb9d-429b-b33e-b199d6310649 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:51.941529 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1336/2656] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:34:51 2022] DELETE /identity/v3/projects/d00a4d181b3647f5a1097066f85e6fc8 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:34:51.948543 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f3ba4-e4e1-4233-a2da-46d4efb70eb6 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:51.949554 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f3ba4-e4e1-4233-a2da-46d4efb70eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:51.950058 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f3ba4-e4e1-4233-a2da-46d4efb70eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:51.972190 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-a49f3ba4-e4e1-4233-a2da-46d4efb70eb6 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:34:51.973517 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a49f3ba4-e4e1-4233-a2da-46d4efb70eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:52.046590 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1321/2657] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:34:52.056124 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e8f9f-976f-4e90-b21e-77dc962f067f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:52.056590 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e8f9f-976f-4e90-b21e-77dc962f067f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:52.056879 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e8f9f-976f-4e90-b21e-77dc962f067f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:52.079180 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7b7e8f9f-976f-4e90-b21e-77dc962f067f None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:34:52.080426 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7b7e8f9f-976f-4e90-b21e-77dc962f067f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:52.088717 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1337/2658] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:34:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:34:52.093804 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f3ba4-e4e1-4233-a2da-46d4efb70eb6 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:52.104484 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f3ba4-e4e1-4233-a2da-46d4efb70eb6 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:52.110001 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49799bba-cb25-45cc-994e-8a5810ce0623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:52.110699 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49799bba-cb25-45cc-994e-8a5810ce0623 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:52.110988 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49799bba-cb25-45cc-994e-8a5810ce0623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:52.111270 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49799bba-cb25-45cc-994e-8a5810ce0623 admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:52.112023 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49799bba-cb25-45cc-994e-8a5810ce0623 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:34:52.112340 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49799bba-cb25-45cc-994e-8a5810ce0623 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:52.114048 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49799bba-cb25-45cc-994e-8a5810ce0623 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:52.128681 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1322/2659] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:34:52.133719 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e8f9f-976f-4e90-b21e-77dc962f067f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:52.150781 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e8f9f-976f-4e90-b21e-77dc962f067f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:52.157075 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db073ed9-fd7b-4567-890c-d4316c3c5bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:52.157795 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db073ed9-fd7b-4567-890c-d4316c3c5bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:52.158124 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db073ed9-fd7b-4567-890c-d4316c3c5bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:52.158414 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db073ed9-fd7b-4567-890c-d4316c3c5bb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:52.159136 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db073ed9-fd7b-4567-890c-d4316c3c5bb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:52.161093 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db073ed9-fd7b-4567-890c-d4316c3c5bb3 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:52.191350 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1338/2660] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:34:52 2022] POST /identity/v3/projects => generated 387 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:34:52.196173 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49799bba-cb25-45cc-994e-8a5810ce0623 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:52.207793 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49799bba-cb25-45cc-994e-8a5810ce0623 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:52.275422 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b8e8c-21ed-4d1d-b87b-785080d5b174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:52.276309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b8e8c-21ed-4d1d-b87b-785080d5b174 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:52.276638 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b8e8c-21ed-4d1d-b87b-785080d5b174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:52.277448 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b8e8c-21ed-4d1d-b87b-785080d5b174 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:52.278306 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b8e8c-21ed-4d1d-b87b-785080d5b174 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:52.280663 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b8e8c-21ed-4d1d-b87b-785080d5b174 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:52.305430 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1323/2661] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:34:52 2022] POST /identity/v3/users => generated 294 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:34:52.310233 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db073ed9-fd7b-4567-890c-d4316c3c5bb3 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:52.321623 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db073ed9-fd7b-4567-890c-d4316c3c5bb3 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:52.328089 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6930325-b1f8-4d29-99e9-fb2f046a4df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:52.328892 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6930325-b1f8-4d29-99e9-fb2f046a4df6 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:52.329290 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6930325-b1f8-4d29-99e9-fb2f046a4df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:52.329613 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6930325-b1f8-4d29-99e9-fb2f046a4df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:52.330474 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6930325-b1f8-4d29-99e9-fb2f046a4df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:52.332280 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6930325-b1f8-4d29-99e9-fb2f046a4df6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:52.345837 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1339/2662] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:34:52.350325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b8e8c-21ed-4d1d-b87b-785080d5b174 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:52.361153 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b8e8c-21ed-4d1d-b87b-785080d5b174 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:52.366405 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee3302-9bf4-4500-8165-ef41b6f3516a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:52.367304 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee3302-9bf4-4500-8165-ef41b6f3516a admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:52.367784 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee3302-9bf4-4500-8165-ef41b6f3516a admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:52.368102 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee3302-9bf4-4500-8165-ef41b6f3516a admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:52.368899 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee3302-9bf4-4500-8165-ef41b6f3516a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:52.370765 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee3302-9bf4-4500-8165-ef41b6f3516a admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:52.384904 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1324/2663] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:34:52.391974 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6930325-b1f8-4d29-99e9-fb2f046a4df6 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:52.404289 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6930325-b1f8-4d29-99e9-fb2f046a4df6 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:52.410076 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c576d6-085e-448a-b15a-6305db954b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:52.411045 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c576d6-085e-448a-b15a-6305db954b3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:52.411464 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c576d6-085e-448a-b15a-6305db954b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:52.411790 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c576d6-085e-448a-b15a-6305db954b3d admin admin] PATH_INFO: `/v3/projects/c89b836cba6e4cad837f37828c4a8324/users/b4a0f7dfe0ab43d8b03815356ef3a173/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:52.429743 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c576d6-085e-448a-b15a-6305db954b3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c89b836cba6e4cad837f37828c4a8324, user_id=b4a0f7dfe0ab43d8b03815356ef3a173, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:52.432517 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c576d6-085e-448a-b15a-6305db954b3d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:52.450362 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1340/2664] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:34:52 2022] PUT /identity/v3/projects/c89b836cba6e4cad837f37828c4a8324/users/b4a0f7dfe0ab43d8b03815356ef3a173/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:34:52.461823 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b936aaa-850d-40c5-801d-338e53e2c5de None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:52.462376 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b936aaa-850d-40c5-801d-338e53e2c5de None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:52.462793 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b936aaa-850d-40c5-801d-338e53e2c5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:52.497221 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-4b936aaa-850d-40c5-801d-338e53e2c5de None None] MFA Rules not processed for user `b4a0f7dfe0ab43d8b03815356ef3a173`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:34:52.498717 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-4b936aaa-850d-40c5-801d-338e53e2c5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:52.518669 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:52.587156 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1325/2665] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:34:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:34:52.592668 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c576d6-085e-448a-b15a-6305db954b3d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:52.673735 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c576d6-085e-448a-b15a-6305db954b3d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:52.679183 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a59fa6-70f3-481a-875e-b61e0bb9e25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:52.679993 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a59fa6-70f3-481a-875e-b61e0bb9e25a admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:52.680431 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a59fa6-70f3-481a-875e-b61e0bb9e25a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:52.680835 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a59fa6-70f3-481a-875e-b61e0bb9e25a admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:52.681699 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a59fa6-70f3-481a-875e-b61e0bb9e25a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:52.683904 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a59fa6-70f3-481a-875e-b61e0bb9e25a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:52.717658 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1341/2666] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:34:52 2022] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:34:52.724000 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b936aaa-850d-40c5-801d-338e53e2c5de None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:52.742800 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b936aaa-850d-40c5-801d-338e53e2c5de None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:52.827087 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff87da6-3448-42af-a083-60f21d27fa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:52.827999 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff87da6-3448-42af-a083-60f21d27fa92 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:52.828331 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff87da6-3448-42af-a083-60f21d27fa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:52.828653 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff87da6-3448-42af-a083-60f21d27fa92 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:52.829580 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff87da6-3448-42af-a083-60f21d27fa92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:52.831752 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff87da6-3448-42af-a083-60f21d27fa92 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:52.855093 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1326/2667] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:34:52 2022] POST /identity/v3/users => generated 300 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:34:52.859540 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a59fa6-70f3-481a-875e-b61e0bb9e25a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:52.871986 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a59fa6-70f3-481a-875e-b61e0bb9e25a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:52.877354 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe25d4a-99ca-4ae9-b760-2fe513565915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:52.878275 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe25d4a-99ca-4ae9-b760-2fe513565915 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:52.878738 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe25d4a-99ca-4ae9-b760-2fe513565915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:52.879078 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe25d4a-99ca-4ae9-b760-2fe513565915 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:52.879917 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe25d4a-99ca-4ae9-b760-2fe513565915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:52.881776 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe25d4a-99ca-4ae9-b760-2fe513565915 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:52.895325 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1342/2668] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:34:52.900082 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff87da6-3448-42af-a083-60f21d27fa92 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:52.911233 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff87da6-3448-42af-a083-60f21d27fa92 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:52.916525 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71733a-c99a-46b3-be19-81445523cf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:52.917506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71733a-c99a-46b3-be19-81445523cf3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:52.917834 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71733a-c99a-46b3-be19-81445523cf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:52.918198 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71733a-c99a-46b3-be19-81445523cf3a admin admin] PATH_INFO: `/v3/projects/f656069a9d674274b39a442961341a67/users/5203e8d8686c42d2bca48f99fa440266/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:52.936426 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71733a-c99a-46b3-be19-81445523cf3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f656069a9d674274b39a442961341a67, user_id=5203e8d8686c42d2bca48f99fa440266, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:52.939309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71733a-c99a-46b3-be19-81445523cf3a admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:52.956478 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1327/2669] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:34:52 2022] PUT /identity/v3/projects/f656069a9d674274b39a442961341a67/users/5203e8d8686c42d2bca48f99fa440266/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:34:52.961081 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe25d4a-99ca-4ae9-b760-2fe513565915 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:52.971873 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe25d4a-99ca-4ae9-b760-2fe513565915 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:53.026502 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:53.043373 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b5c55-8e0d-418d-b081-405d084ae661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:53.044074 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b5c55-8e0d-418d-b081-405d084ae661 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:53.044369 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b5c55-8e0d-418d-b081-405d084ae661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:53.044635 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b5c55-8e0d-418d-b081-405d084ae661 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:53.045389 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b5c55-8e0d-418d-b081-405d084ae661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:53.047152 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b5c55-8e0d-418d-b081-405d084ae661 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:53.059803 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1343/2670] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:34:53.064887 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71733a-c99a-46b3-be19-81445523cf3a admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:53.076901 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71733a-c99a-46b3-be19-81445523cf3a admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:53.082030 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f55abe-6b4d-48e4-b159-d3e4b643f9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:53.083213 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f55abe-6b4d-48e4-b159-d3e4b643f9f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:53.083590 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f55abe-6b4d-48e4-b159-d3e4b643f9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:53.083988 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f55abe-6b4d-48e4-b159-d3e4b643f9f5 admin admin] PATH_INFO: `/v3/projects/f656069a9d674274b39a442961341a67/users/5203e8d8686c42d2bca48f99fa440266/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:53.086350 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f55abe-6b4d-48e4-b159-d3e4b643f9f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f656069a9d674274b39a442961341a67, user_id=5203e8d8686c42d2bca48f99fa440266, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:53.089209 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f55abe-6b4d-48e4-b159-d3e4b643f9f5 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:53.102371 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1328/2671] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:34:53 2022] PUT /identity/v3/projects/f656069a9d674274b39a442961341a67/users/5203e8d8686c42d2bca48f99fa440266/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:34:53.115185 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfec105-4a66-4ae3-a514-971123078041 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:53.115433 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfec105-4a66-4ae3-a514-971123078041 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:53.115776 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfec105-4a66-4ae3-a514-971123078041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:53.147689 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-4cfec105-4a66-4ae3-a514-971123078041 None None] MFA Rules not processed for user `5203e8d8686c42d2bca48f99fa440266`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:34:53.149053 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4cfec105-4a66-4ae3-a514-971123078041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:53.240652 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1344/2672] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:34:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:34:53.252918 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f55abe-6b4d-48e4-b159-d3e4b643f9f5 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:53.254703 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e8f55abe-6b4d-48e4-b159-d3e4b643f9f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:53.320857 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f55abe-6b4d-48e4-b159-d3e4b643f9f5 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:53.325683 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd793d6-1773-4076-9790-e299b06b10d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:53.326463 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd793d6-1773-4076-9790-e299b06b10d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:53.326753 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd793d6-1773-4076-9790-e299b06b10d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:53.327029 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd793d6-1773-4076-9790-e299b06b10d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:53.344987 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd793d6-1773-4076-9790-e299b06b10d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:53.347885 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd793d6-1773-4076-9790-e299b06b10d4 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:53.367228 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1329/2673] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:34:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:34:54.070066 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfec105-4a66-4ae3-a514-971123078041 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:54.145629 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfec105-4a66-4ae3-a514-971123078041 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:54.150783 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777ae1b-9427-4065-9fb5-e35f47aab4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:54.151698 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777ae1b-9427-4065-9fb5-e35f47aab4ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:54.152572 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777ae1b-9427-4065-9fb5-e35f47aab4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:54.152853 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777ae1b-9427-4065-9fb5-e35f47aab4ca admin admin] PATH_INFO: `/v3/users/b4a0f7dfe0ab43d8b03815356ef3a173` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:54.154289 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777ae1b-9427-4065-9fb5-e35f47aab4ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4a0f7dfe0ab43d8b03815356ef3a173)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:54.156289 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777ae1b-9427-4065-9fb5-e35f47aab4ca admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:54.214429 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2777ae1b-9427-4065-9fb5-e35f47aab4ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4a0f7dfe0ab43d8b03815356ef3a173'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:54.215219 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2777ae1b-9427-4065-9fb5-e35f47aab4ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4a0f7dfe0ab43d8b03815356ef3a173'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:54.232830 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2777ae1b-9427-4065-9fb5-e35f47aab4ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4a0f7dfe0ab43d8b03815356ef3a173'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:54.238681 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:54.245481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2777ae1b-9427-4065-9fb5-e35f47aab4ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4a0f7dfe0ab43d8b03815356ef3a173'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:54.246994 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2777ae1b-9427-4065-9fb5-e35f47aab4ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4a0f7dfe0ab43d8b03815356ef3a173'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:54.266304 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1345/2674] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:34:54 2022] DELETE /identity/v3/users/b4a0f7dfe0ab43d8b03815356ef3a173 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:34:54.271341 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8caf53-6252-420c-860d-9b65c73e8ebc None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:54.271770 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8caf53-6252-420c-860d-9b65c73e8ebc None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:54.271953 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8caf53-6252-420c-860d-9b65c73e8ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:54.291486 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-6a8caf53-6252-420c-860d-9b65c73e8ebc None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:34:54.292729 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6a8caf53-6252-420c-860d-9b65c73e8ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:54.302595 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:54.364867 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1330/2675] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:34:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:34:54.376229 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777ae1b-9427-4065-9fb5-e35f47aab4ca admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:54.377717 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2777ae1b-9427-4065-9fb5-e35f47aab4ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:54.444382 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777ae1b-9427-4065-9fb5-e35f47aab4ca admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:54.448497 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aef6e7-bfb4-4d08-956a-8995b950f99a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:54.449792 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aef6e7-bfb4-4d08-956a-8995b950f99a service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:54.450195 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aef6e7-bfb4-4d08-956a-8995b950f99a service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:54.450660 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aef6e7-bfb4-4d08-956a-8995b950f99a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:54.460987 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aef6e7-bfb4-4d08-956a-8995b950f99a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:54.462583 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aef6e7-bfb4-4d08-956a-8995b950f99a service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:54.473770 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1346/2676] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:34:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:34:54.861385 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8caf53-6252-420c-860d-9b65c73e8ebc None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:54.863531 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6a8caf53-6252-420c-860d-9b65c73e8ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:54.880352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8caf53-6252-420c-860d-9b65c73e8ebc None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:54.886914 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e30cb-b83b-49af-b795-f79ef2f92ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:54.888041 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e30cb-b83b-49af-b795-f79ef2f92ab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:54.888422 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e30cb-b83b-49af-b795-f79ef2f92ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:54.888856 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e30cb-b83b-49af-b795-f79ef2f92ab3 admin admin] PATH_INFO: `/v3/projects/c89b836cba6e4cad837f37828c4a8324` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:54.890648 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e30cb-b83b-49af-b795-f79ef2f92ab3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c89b836cba6e4cad837f37828c4a8324)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:54.893375 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e30cb-b83b-49af-b795-f79ef2f92ab3 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:54.950425 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-216e30cb-b83b-49af-b795-f79ef2f92ab3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c89b836cba6e4cad837f37828c4a8324', 'request_id': 'req-216e30cb-b83b-49af-b795-f79ef2f92ab3'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:54.959722 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-216e30cb-b83b-49af-b795-f79ef2f92ab3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c89b836cba6e4cad837f37828c4a8324', 'request_id': 'req-216e30cb-b83b-49af-b795-f79ef2f92ab3'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:54.967824 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-216e30cb-b83b-49af-b795-f79ef2f92ab3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c89b836cba6e4cad837f37828c4a8324', 'request_id': 'req-216e30cb-b83b-49af-b795-f79ef2f92ab3'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:54.982153 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-216e30cb-b83b-49af-b795-f79ef2f92ab3 admin admin] The token cache is being invalidate because project c89b836cba6e4cad837f37828c4a8324 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:34:54.982758 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-216e30cb-b83b-49af-b795-f79ef2f92ab3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:54.983559 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-216e30cb-b83b-49af-b795-f79ef2f92ab3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:54.985205 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1331/2677] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:34:54 2022] DELETE /identity/v3/projects/c89b836cba6e4cad837f37828c4a8324 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:34:54.990834 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aef6e7-bfb4-4d08-956a-8995b950f99a service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:55.004634 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aef6e7-bfb4-4d08-956a-8995b950f99a service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:55.080917 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80df5b-4188-48c7-a776-56792912a5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:55.081817 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80df5b-4188-48c7-a776-56792912a5ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:55.082148 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80df5b-4188-48c7-a776-56792912a5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:55.082428 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80df5b-4188-48c7-a776-56792912a5ff admin admin] PATH_INFO: `/v3/users/5203e8d8686c42d2bca48f99fa440266` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:55.083733 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80df5b-4188-48c7-a776-56792912a5ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=5203e8d8686c42d2bca48f99fa440266)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:55.085735 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80df5b-4188-48c7-a776-56792912a5ff admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:55.141752 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cc80df5b-4188-48c7-a776-56792912a5ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5203e8d8686c42d2bca48f99fa440266'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:55.142568 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cc80df5b-4188-48c7-a776-56792912a5ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5203e8d8686c42d2bca48f99fa440266'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:55.161611 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cc80df5b-4188-48c7-a776-56792912a5ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5203e8d8686c42d2bca48f99fa440266'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:55.171870 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cc80df5b-4188-48c7-a776-56792912a5ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5203e8d8686c42d2bca48f99fa440266'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:55.172739 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cc80df5b-4188-48c7-a776-56792912a5ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5203e8d8686c42d2bca48f99fa440266'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:55.194292 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1347/2678] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:34:54 2022] DELETE /identity/v3/users/5203e8d8686c42d2bca48f99fa440266 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:34:55.559552 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e30cb-b83b-49af-b795-f79ef2f92ab3 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:55.561238 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-216e30cb-b83b-49af-b795-f79ef2f92ab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:55.589016 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e30cb-b83b-49af-b795-f79ef2f92ab3 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:55.687474 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691d726-2982-487b-a441-28ae21fe2488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:55.689294 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691d726-2982-487b-a441-28ae21fe2488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:55.689917 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691d726-2982-487b-a441-28ae21fe2488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:55.690549 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691d726-2982-487b-a441-28ae21fe2488 admin admin] PATH_INFO: `/v3/projects/f656069a9d674274b39a442961341a67` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:55.692904 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6691d726-2982-487b-a441-28ae21fe2488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f656069a9d674274b39a442961341a67)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:55.696201 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6691d726-2982-487b-a441-28ae21fe2488 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:55.756013 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:55.767862 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-6691d726-2982-487b-a441-28ae21fe2488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f656069a9d674274b39a442961341a67', 'request_id': 'req-6691d726-2982-487b-a441-28ae21fe2488'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:55.780897 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-6691d726-2982-487b-a441-28ae21fe2488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f656069a9d674274b39a442961341a67', 'request_id': 'req-6691d726-2982-487b-a441-28ae21fe2488'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:55.789494 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-6691d726-2982-487b-a441-28ae21fe2488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f656069a9d674274b39a442961341a67', 'request_id': 'req-6691d726-2982-487b-a441-28ae21fe2488'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:55.807658 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-6691d726-2982-487b-a441-28ae21fe2488 admin admin] The token cache is being invalidate because project f656069a9d674274b39a442961341a67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:34:55.808682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-6691d726-2982-487b-a441-28ae21fe2488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:55.809777 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-6691d726-2982-487b-a441-28ae21fe2488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:34:55.812430 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1332/2679] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:34:55 2022] DELETE /identity/v3/projects/f656069a9d674274b39a442961341a67 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:34:55.819448 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2370d-a89f-40bd-9f65-9cb24430653c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:55.819945 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2370d-a89f-40bd-9f65-9cb24430653c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:55.820332 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2370d-a89f-40bd-9f65-9cb24430653c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:55.849137 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7de2370d-a89f-40bd-9f65-9cb24430653c None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:34:55.850440 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7de2370d-a89f-40bd-9f65-9cb24430653c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:55.856805 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:55.944934 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1348/2680] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:34:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:34:55.958506 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c4cdf-b60d-478e-aa8f-fe85685491b7 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:55.959317 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c4cdf-b60d-478e-aa8f-fe85685491b7 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:55.959477 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c4cdf-b60d-478e-aa8f-fe85685491b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:55.988290 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-c60c4cdf-b60d-478e-aa8f-fe85685491b7 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:34:55.989625 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c60c4cdf-b60d-478e-aa8f-fe85685491b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:55.999520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1333/2681] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:34:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:34:56.004501 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2370d-a89f-40bd-9f65-9cb24430653c None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:56.016846 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2370d-a89f-40bd-9f65-9cb24430653c None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:56.025745 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8bab9-9880-4876-b817-f22b2ff2ddab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:56.026597 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8bab9-9880-4876-b817-f22b2ff2ddab admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:56.027030 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8bab9-9880-4876-b817-f22b2ff2ddab admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:56.027521 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8bab9-9880-4876-b817-f22b2ff2ddab admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:56.028927 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8bab9-9880-4876-b817-f22b2ff2ddab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:34:56.029493 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8bab9-9880-4876-b817-f22b2ff2ddab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:56.031531 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8bab9-9880-4876-b817-f22b2ff2ddab admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:56.046573 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1349/2682] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:34:56.053395 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c4cdf-b60d-478e-aa8f-fe85685491b7 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:56.073341 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c4cdf-b60d-478e-aa8f-fe85685491b7 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:56.081068 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceba630-7cb4-40f7-b07c-b912017b7485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:56.082556 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceba630-7cb4-40f7-b07c-b912017b7485 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:56.082857 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceba630-7cb4-40f7-b07c-b912017b7485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:56.083172 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceba630-7cb4-40f7-b07c-b912017b7485 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:56.084290 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceba630-7cb4-40f7-b07c-b912017b7485 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:56.087211 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceba630-7cb4-40f7-b07c-b912017b7485 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:56.125861 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1334/2683] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:34:56 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:34:56.131145 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8bab9-9880-4876-b817-f22b2ff2ddab admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:56.142014 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8bab9-9880-4876-b817-f22b2ff2ddab admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:56.228170 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938022e-74cc-4fde-81d0-cc379ff6a25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:56.228864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938022e-74cc-4fde-81d0-cc379ff6a25b admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:56.229159 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938022e-74cc-4fde-81d0-cc379ff6a25b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:56.229429 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938022e-74cc-4fde-81d0-cc379ff6a25b admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:56.230766 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938022e-74cc-4fde-81d0-cc379ff6a25b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:56.232691 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938022e-74cc-4fde-81d0-cc379ff6a25b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:56.255444 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1350/2684] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:34:56 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:34:56.260466 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceba630-7cb4-40f7-b07c-b912017b7485 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:56.277823 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceba630-7cb4-40f7-b07c-b912017b7485 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:56.283765 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f0184-8983-4991-be6d-8b2d1c584b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:56.284502 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f0184-8983-4991-be6d-8b2d1c584b73 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:56.284887 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f0184-8983-4991-be6d-8b2d1c584b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:56.285214 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f0184-8983-4991-be6d-8b2d1c584b73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:56.286212 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f0184-8983-4991-be6d-8b2d1c584b73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:56.287999 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f0184-8983-4991-be6d-8b2d1c584b73 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:56.303698 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1335/2685] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:34:56.310819 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938022e-74cc-4fde-81d0-cc379ff6a25b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:56.325836 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938022e-74cc-4fde-81d0-cc379ff6a25b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:56.331257 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b527d-9271-4e30-b0d8-13a8a2c1193b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:56.331956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b527d-9271-4e30-b0d8-13a8a2c1193b admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:56.332253 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b527d-9271-4e30-b0d8-13a8a2c1193b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:56.332530 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b527d-9271-4e30-b0d8-13a8a2c1193b admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:56.333288 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b527d-9271-4e30-b0d8-13a8a2c1193b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:56.335031 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b527d-9271-4e30-b0d8-13a8a2c1193b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:56.346833 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1351/2686] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:34:56.352918 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f0184-8983-4991-be6d-8b2d1c584b73 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:56.364474 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f0184-8983-4991-be6d-8b2d1c584b73 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:56.369891 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc71bfb-6de7-470a-b274-bc08097cb762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:56.371520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc71bfb-6de7-470a-b274-bc08097cb762 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:56.371808 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc71bfb-6de7-470a-b274-bc08097cb762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:56.372117 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc71bfb-6de7-470a-b274-bc08097cb762 admin admin] PATH_INFO: `/v3/projects/eb05a7788ff04c30a4e192f36ebd5f6f/users/864871cfec4a43e1921e1c74fbcc7047/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:56.389646 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc71bfb-6de7-470a-b274-bc08097cb762 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb05a7788ff04c30a4e192f36ebd5f6f, user_id=864871cfec4a43e1921e1c74fbcc7047, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:56.392651 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc71bfb-6de7-470a-b274-bc08097cb762 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:56.412309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1336/2687] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:34:56 2022] PUT /identity/v3/projects/eb05a7788ff04c30a4e192f36ebd5f6f/users/864871cfec4a43e1921e1c74fbcc7047/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:34:56.423742 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315d07f-0054-4e82-a2d5-6431b15a9375 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:56.424015 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315d07f-0054-4e82-a2d5-6431b15a9375 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:56.424323 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315d07f-0054-4e82-a2d5-6431b15a9375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:56.456185 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a315d07f-0054-4e82-a2d5-6431b15a9375 None None] MFA Rules not processed for user `864871cfec4a43e1921e1c74fbcc7047`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:34:56.457483 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a315d07f-0054-4e82-a2d5-6431b15a9375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:56.536746 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1352/2688] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:34:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:34:56.541656 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc71bfb-6de7-470a-b274-bc08097cb762 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:56.616422 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc71bfb-6de7-470a-b274-bc08097cb762 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:56.621747 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0af656-2c17-44f0-9719-ec0822494f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:56.622457 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0af656-2c17-44f0-9719-ec0822494f10 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:56.622743 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0af656-2c17-44f0-9719-ec0822494f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:56.623022 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0af656-2c17-44f0-9719-ec0822494f10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:56.623729 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0af656-2c17-44f0-9719-ec0822494f10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:56.625776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0af656-2c17-44f0-9719-ec0822494f10 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:56.655764 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1337/2689] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:34:56 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:34:56.660317 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315d07f-0054-4e82-a2d5-6431b15a9375 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:56.670855 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:56.678491 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315d07f-0054-4e82-a2d5-6431b15a9375 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:56.771466 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc9df0-2969-41cc-83a5-79d7f0c45fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:56.772230 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc9df0-2969-41cc-83a5-79d7f0c45fb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:56.772593 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc9df0-2969-41cc-83a5-79d7f0c45fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:56.772994 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc9df0-2969-41cc-83a5-79d7f0c45fb5 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:56.773758 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc9df0-2969-41cc-83a5-79d7f0c45fb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:56.775997 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc9df0-2969-41cc-83a5-79d7f0c45fb5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:56.800146 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1353/2690] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:34:56 2022] POST /identity/v3/users => generated 299 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:34:56.805664 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0af656-2c17-44f0-9719-ec0822494f10 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:56.819347 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0af656-2c17-44f0-9719-ec0822494f10 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:56.827765 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20908b-0f89-4ea9-88ee-e0a8911afc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:56.828873 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20908b-0f89-4ea9-88ee-e0a8911afc5a admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:56.829355 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20908b-0f89-4ea9-88ee-e0a8911afc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:56.829830 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20908b-0f89-4ea9-88ee-e0a8911afc5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:56.831180 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20908b-0f89-4ea9-88ee-e0a8911afc5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:56.834250 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20908b-0f89-4ea9-88ee-e0a8911afc5a admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:56.854003 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1338/2691] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:34:56.859310 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc9df0-2969-41cc-83a5-79d7f0c45fb5 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:56.871256 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc9df0-2969-41cc-83a5-79d7f0c45fb5 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:56.876376 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772779c-5198-41e7-8ba9-699e55be0cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:56.877293 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772779c-5198-41e7-8ba9-699e55be0cf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:56.877578 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772779c-5198-41e7-8ba9-699e55be0cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:56.877859 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772779c-5198-41e7-8ba9-699e55be0cf6 admin admin] PATH_INFO: `/v3/projects/6bba32a739ba4272bbd5569a24d79071/users/a55fafb8590049a28d7bcce2b452d470/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:56.894588 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772779c-5198-41e7-8ba9-699e55be0cf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bba32a739ba4272bbd5569a24d79071, user_id=a55fafb8590049a28d7bcce2b452d470, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:56.897266 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772779c-5198-41e7-8ba9-699e55be0cf6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:56.912833 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1354/2692] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:34:56 2022] PUT /identity/v3/projects/6bba32a739ba4272bbd5569a24d79071/users/a55fafb8590049a28d7bcce2b452d470/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:34:56.918002 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20908b-0f89-4ea9-88ee-e0a8911afc5a admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:56.929113 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20908b-0f89-4ea9-88ee-e0a8911afc5a admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:56.990132 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:34:57.035507 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fade2-4847-4835-abe8-99c07bacf494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:57.036563 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fade2-4847-4835-abe8-99c07bacf494 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:57.037043 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fade2-4847-4835-abe8-99c07bacf494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:57.037523 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fade2-4847-4835-abe8-99c07bacf494 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:57.039012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01fade2-4847-4835-abe8-99c07bacf494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:57.042040 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01fade2-4847-4835-abe8-99c07bacf494 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:57.063274 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1339/2693] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:34:57.067553 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772779c-5198-41e7-8ba9-699e55be0cf6 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:57.079695 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772779c-5198-41e7-8ba9-699e55be0cf6 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:57.084960 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57110e-e022-4968-9df9-358b9f40527b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:57.085879 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57110e-e022-4968-9df9-358b9f40527b admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:57.086198 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57110e-e022-4968-9df9-358b9f40527b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:57.086480 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57110e-e022-4968-9df9-358b9f40527b admin admin] PATH_INFO: `/v3/projects/6bba32a739ba4272bbd5569a24d79071/users/a55fafb8590049a28d7bcce2b452d470/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:57.088589 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57110e-e022-4968-9df9-358b9f40527b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bba32a739ba4272bbd5569a24d79071, user_id=a55fafb8590049a28d7bcce2b452d470, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:57.091870 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57110e-e022-4968-9df9-358b9f40527b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:57.103840 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1355/2694] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:34:57 2022] PUT /identity/v3/projects/6bba32a739ba4272bbd5569a24d79071/users/a55fafb8590049a28d7bcce2b452d470/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:34:57.116145 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81508705-38f9-46f4-a2a4-13cb5cded0d0 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:57.116629 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81508705-38f9-46f4-a2a4-13cb5cded0d0 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:57.117065 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81508705-38f9-46f4-a2a4-13cb5cded0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:57.150043 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-81508705-38f9-46f4-a2a4-13cb5cded0d0 None None] MFA Rules not processed for user `a55fafb8590049a28d7bcce2b452d470`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:34:57.151176 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-81508705-38f9-46f4-a2a4-13cb5cded0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:57.250910 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1340/2695] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:34:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:34:57.265358 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57110e-e022-4968-9df9-358b9f40527b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:34:57.267850 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ce57110e-e022-4968-9df9-358b9f40527b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:34:57.370875 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57110e-e022-4968-9df9-358b9f40527b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:34:57.377722 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029ce73-09c6-4a5d-bb28-fab240c61057 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:34:57.378943 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029ce73-09c6-4a5d-bb28-fab240c61057 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:34:57.379454 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029ce73-09c6-4a5d-bb28-fab240c61057 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:34:57.380002 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029ce73-09c6-4a5d-bb28-fab240c61057 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:34:57.476595 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2029ce73-09c6-4a5d-bb28-fab240c61057 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:34:57.478212 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2029ce73-09c6-4a5d-bb28-fab240c61057 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:34:57.489539 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1356/2696] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:34:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:35:02.152476 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81508705-38f9-46f4-a2a4-13cb5cded0d0 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:35:02.163523 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81508705-38f9-46f4-a2a4-13cb5cded0d0 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:35:02.168091 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aaa35c-8e47-4c2a-bd19-6771e8b00422 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:35:02.168928 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aaa35c-8e47-4c2a-bd19-6771e8b00422 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:35:02.169231 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aaa35c-8e47-4c2a-bd19-6771e8b00422 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:35:02.169509 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aaa35c-8e47-4c2a-bd19-6771e8b00422 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:35:02.180131 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aaa35c-8e47-4c2a-bd19-6771e8b00422 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:35:02.182587 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aaa35c-8e47-4c2a-bd19-6771e8b00422 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:35:02.195443 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1341/2697] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:35:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:35:07.322886 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029ce73-09c6-4a5d-bb28-fab240c61057 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:35:07.347696 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:35:07.430360 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029ce73-09c6-4a5d-bb28-fab240c61057 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:35:07.435773 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47627432-ac7a-47bb-a265-fc467a4fa7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:35:07.436798 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47627432-ac7a-47bb-a265-fc467a4fa7e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:35:07.437200 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47627432-ac7a-47bb-a265-fc467a4fa7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:35:07.437562 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47627432-ac7a-47bb-a265-fc467a4fa7e8 admin admin] PATH_INFO: `/v3/users/864871cfec4a43e1921e1c74fbcc7047` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:35:07.439294 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47627432-ac7a-47bb-a265-fc467a4fa7e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=864871cfec4a43e1921e1c74fbcc7047)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:35:07.441366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47627432-ac7a-47bb-a265-fc467a4fa7e8 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:35:07.521607 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-47627432-ac7a-47bb-a265-fc467a4fa7e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '864871cfec4a43e1921e1c74fbcc7047'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:07.522773 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-47627432-ac7a-47bb-a265-fc467a4fa7e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '864871cfec4a43e1921e1c74fbcc7047'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:07.547264 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-47627432-ac7a-47bb-a265-fc467a4fa7e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '864871cfec4a43e1921e1c74fbcc7047'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:07.560956 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-47627432-ac7a-47bb-a265-fc467a4fa7e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '864871cfec4a43e1921e1c74fbcc7047'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:07.562151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-47627432-ac7a-47bb-a265-fc467a4fa7e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '864871cfec4a43e1921e1c74fbcc7047'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:07.587481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1357/2698] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:35:07 2022] DELETE /identity/v3/users/864871cfec4a43e1921e1c74fbcc7047 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:35:07.593747 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce63cfe-4605-465c-a54c-d1a3d91ce1a1 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:35:07.595008 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce63cfe-4605-465c-a54c-d1a3d91ce1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:35:07.595174 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce63cfe-4605-465c-a54c-d1a3d91ce1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:35:07.619382 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-4ce63cfe-4605-465c-a54c-d1a3d91ce1a1 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:35:07.621259 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-4ce63cfe-4605-465c-a54c-d1a3d91ce1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:35:07.732898 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1342/2699] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:35:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:35:07.740342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47627432-ac7a-47bb-a265-fc467a4fa7e8 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:35:07.741993 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-47627432-ac7a-47bb-a265-fc467a4fa7e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:35:07.826770 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47627432-ac7a-47bb-a265-fc467a4fa7e8 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:35:07.836587 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5b1e4-5dfb-4933-82b5-a08a65e84d27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:35:07.837406 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5b1e4-5dfb-4933-82b5-a08a65e84d27 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:35:07.837901 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5b1e4-5dfb-4933-82b5-a08a65e84d27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:35:07.838639 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5b1e4-5dfb-4933-82b5-a08a65e84d27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:35:07.855516 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5b1e4-5dfb-4933-82b5-a08a65e84d27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:35:07.858392 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5b1e4-5dfb-4933-82b5-a08a65e84d27 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:35:07.879794 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1358/2700] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:35:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:35:08.318938 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce63cfe-4605-465c-a54c-d1a3d91ce1a1 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:35:08.321142 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-4ce63cfe-4605-465c-a54c-d1a3d91ce1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:35:08.349939 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce63cfe-4605-465c-a54c-d1a3d91ce1a1 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:35:08.357047 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6af91-462d-4189-9137-5c5189700746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:35:08.358830 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6af91-462d-4189-9137-5c5189700746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:35:08.358997 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6af91-462d-4189-9137-5c5189700746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:35:08.359413 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6af91-462d-4189-9137-5c5189700746 admin admin] PATH_INFO: `/v3/projects/eb05a7788ff04c30a4e192f36ebd5f6f` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:35:08.361324 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6af91-462d-4189-9137-5c5189700746 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb05a7788ff04c30a4e192f36ebd5f6f)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:35:08.363281 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6af91-462d-4189-9137-5c5189700746 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:35:08.435090 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:35:08.446951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-76b6af91-462d-4189-9137-5c5189700746 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb05a7788ff04c30a4e192f36ebd5f6f', 'request_id': 'req-76b6af91-462d-4189-9137-5c5189700746'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:08.460474 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-76b6af91-462d-4189-9137-5c5189700746 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb05a7788ff04c30a4e192f36ebd5f6f', 'request_id': 'req-76b6af91-462d-4189-9137-5c5189700746'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:08.468294 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-76b6af91-462d-4189-9137-5c5189700746 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb05a7788ff04c30a4e192f36ebd5f6f', 'request_id': 'req-76b6af91-462d-4189-9137-5c5189700746'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:08.482510 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-76b6af91-462d-4189-9137-5c5189700746 admin admin] The token cache is being invalidate because project eb05a7788ff04c30a4e192f36ebd5f6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:35:08.482809 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-76b6af91-462d-4189-9137-5c5189700746 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:08.483554 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-76b6af91-462d-4189-9137-5c5189700746 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:08.485309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1343/2701] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:35:08 2022] DELETE /identity/v3/projects/eb05a7788ff04c30a4e192f36ebd5f6f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:35:08.491719 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5b1e4-5dfb-4933-82b5-a08a65e84d27 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:35:08.512298 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5b1e4-5dfb-4933-82b5-a08a65e84d27 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:35:08.564802 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:35:08.624871 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f848e38-d979-44b0-b4b3-9710d4ddcde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:35:08.625771 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f848e38-d979-44b0-b4b3-9710d4ddcde3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:35:08.626092 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f848e38-d979-44b0-b4b3-9710d4ddcde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:35:08.626366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f848e38-d979-44b0-b4b3-9710d4ddcde3 admin admin] PATH_INFO: `/v3/users/a55fafb8590049a28d7bcce2b452d470` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:35:08.627647 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f848e38-d979-44b0-b4b3-9710d4ddcde3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a55fafb8590049a28d7bcce2b452d470)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:35:08.629611 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f848e38-d979-44b0-b4b3-9710d4ddcde3 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:35:08.705868 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0f848e38-d979-44b0-b4b3-9710d4ddcde3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a55fafb8590049a28d7bcce2b452d470'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:08.707544 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0f848e38-d979-44b0-b4b3-9710d4ddcde3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a55fafb8590049a28d7bcce2b452d470'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:08.732448 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0f848e38-d979-44b0-b4b3-9710d4ddcde3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a55fafb8590049a28d7bcce2b452d470'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:08.744945 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0f848e38-d979-44b0-b4b3-9710d4ddcde3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a55fafb8590049a28d7bcce2b452d470'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:08.746166 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0f848e38-d979-44b0-b4b3-9710d4ddcde3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a55fafb8590049a28d7bcce2b452d470'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:08.764176 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1359/2702] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:35:08 2022] DELETE /identity/v3/users/a55fafb8590049a28d7bcce2b452d470 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:35:09.131000 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6af91-462d-4189-9137-5c5189700746 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:35:09.132812 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-76b6af91-462d-4189-9137-5c5189700746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:35:09.159109 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6af91-462d-4189-9137-5c5189700746 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:35:09.272312 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8ed81-f591-4289-a3dc-616db587cf2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:35:09.273874 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8ed81-f591-4289-a3dc-616db587cf2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:35:09.274443 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8ed81-f591-4289-a3dc-616db587cf2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:35:09.274965 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8ed81-f591-4289-a3dc-616db587cf2c admin admin] PATH_INFO: `/v3/projects/6bba32a739ba4272bbd5569a24d79071` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:35:09.277128 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e8ed81-f591-4289-a3dc-616db587cf2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bba32a739ba4272bbd5569a24d79071)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:35:09.279167 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e8ed81-f591-4289-a3dc-616db587cf2c admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:35:09.343990 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-19e8ed81-f591-4289-a3dc-616db587cf2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bba32a739ba4272bbd5569a24d79071', 'request_id': 'req-19e8ed81-f591-4289-a3dc-616db587cf2c'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:09.354973 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-19e8ed81-f591-4289-a3dc-616db587cf2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bba32a739ba4272bbd5569a24d79071', 'request_id': 'req-19e8ed81-f591-4289-a3dc-616db587cf2c'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:09.363307 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-19e8ed81-f591-4289-a3dc-616db587cf2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bba32a739ba4272bbd5569a24d79071', 'request_id': 'req-19e8ed81-f591-4289-a3dc-616db587cf2c'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:09.379722 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-19e8ed81-f591-4289-a3dc-616db587cf2c admin admin] The token cache is being invalidate because project 6bba32a739ba4272bbd5569a24d79071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:35:09.379722 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-19e8ed81-f591-4289-a3dc-616db587cf2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:09.380355 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-19e8ed81-f591-4289-a3dc-616db587cf2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:09.384197 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1344/2703] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:35:09 2022] DELETE /identity/v3/projects/6bba32a739ba4272bbd5569a24d79071 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:35:09.394670 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22482f30-f62a-45aa-97e7-14c8116a22a3 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:35:09.395084 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22482f30-f62a-45aa-97e7-14c8116a22a3 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:35:09.395473 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22482f30-f62a-45aa-97e7-14c8116a22a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:35:09.418189 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-22482f30-f62a-45aa-97e7-14c8116a22a3 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:35:09.419457 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-22482f30-f62a-45aa-97e7-14c8116a22a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:35:09.493352 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1360/2704] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:35:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:35:09.502478 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd23905-5bba-4c0f-84d0-cf1ad0390f7d None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:35:09.502776 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd23905-5bba-4c0f-84d0-cf1ad0390f7d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:35:09.503060 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd23905-5bba-4c0f-84d0-cf1ad0390f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:35:09.525249 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-5dd23905-5bba-4c0f-84d0-cf1ad0390f7d None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:35:09.526629 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-5dd23905-5bba-4c0f-84d0-cf1ad0390f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:35:09.535379 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1345/2705] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:35:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:35:09.540298 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22482f30-f62a-45aa-97e7-14c8116a22a3 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:35:09.552214 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22482f30-f62a-45aa-97e7-14c8116a22a3 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:35:09.562288 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b4546-9c1b-4daf-a7ed-0a2be898d60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:35:09.563168 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b4546-9c1b-4daf-a7ed-0a2be898d60f admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:35:09.563695 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b4546-9c1b-4daf-a7ed-0a2be898d60f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:35:09.564199 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b4546-9c1b-4daf-a7ed-0a2be898d60f admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:35:09.565199 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b4546-9c1b-4daf-a7ed-0a2be898d60f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:35:09.565673 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b4546-9c1b-4daf-a7ed-0a2be898d60f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:35:09.568754 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b4546-9c1b-4daf-a7ed-0a2be898d60f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:35:09.595713 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1361/2706] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:35:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:35:09.597694 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd23905-5bba-4c0f-84d0-cf1ad0390f7d None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:35:09.610727 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd23905-5bba-4c0f-84d0-cf1ad0390f7d None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:35:09.618472 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927dc1e-4697-4e80-ace4-1dc4f3f15b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:35:09.619695 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927dc1e-4697-4e80-ace4-1dc4f3f15b96 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:35:09.620693 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927dc1e-4697-4e80-ace4-1dc4f3f15b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:35:09.621156 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927dc1e-4697-4e80-ace4-1dc4f3f15b96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:35:09.622470 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927dc1e-4697-4e80-ace4-1dc4f3f15b96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:35:09.626174 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927dc1e-4697-4e80-ace4-1dc4f3f15b96 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:35:09.672964 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1346/2707] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:35:09 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:35:09.678041 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b4546-9c1b-4daf-a7ed-0a2be898d60f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:35:09.698506 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b4546-9c1b-4daf-a7ed-0a2be898d60f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:35:09.732292 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e87bda-b2e8-40fd-8630-af7d378c7555 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:35:09.732596 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e87bda-b2e8-40fd-8630-af7d378c7555 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:35:09.732857 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e87bda-b2e8-40fd-8630-af7d378c7555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:35:09.753708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-f8e87bda-b2e8-40fd-8630-af7d378c7555 None None] MFA Rules not processed for user `84e5577e32e545c0a060cce6238208eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:35:09.755146 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f8e87bda-b2e8-40fd-8630-af7d378c7555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:35:09.765301 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:35:09.788382 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:35:09.794046 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0dd14-cac5-4ea6-a4b0-1443eaec91b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:35:09.794906 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0dd14-cac5-4ea6-a4b0-1443eaec91b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:35:09.795195 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0dd14-cac5-4ea6-a4b0-1443eaec91b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:35:09.795471 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0dd14-cac5-4ea6-a4b0-1443eaec91b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:35:09.796444 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0dd14-cac5-4ea6-a4b0-1443eaec91b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:35:09.798907 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0dd14-cac5-4ea6-a4b0-1443eaec91b6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:35:09.826031 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1362/2708] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:35:09 2022] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:35:09.830109 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0dd14-cac5-4ea6-a4b0-1443eaec91b6 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:35:09.830665 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1347/2709] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:35:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:35:09.840854 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0dd14-cac5-4ea6-a4b0-1443eaec91b6 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:35:09.847526 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f98667-39e9-4ba0-9f35-8087bae93d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:35:09.848133 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f98667-39e9-4ba0-9f35-8087bae93d2a admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:35:09.848416 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f98667-39e9-4ba0-9f35-8087bae93d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:35:09.848693 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f98667-39e9-4ba0-9f35-8087bae93d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:35:09.849463 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f98667-39e9-4ba0-9f35-8087bae93d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:35:09.851436 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f98667-39e9-4ba0-9f35-8087bae93d2a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:35:09.864329 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1363/2710] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 04:35:09.869817 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e87bda-b2e8-40fd-8630-af7d378c7555 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:35:09.882030 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e87bda-b2e8-40fd-8630-af7d378c7555 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:35:09.887756 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d7090-c2fa-4d97-8ba0-1494414f0543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:35:09.888589 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d7090-c2fa-4d97-8ba0-1494414f0543 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:35:09.888875 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d7090-c2fa-4d97-8ba0-1494414f0543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:35:09.889150 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d7090-c2fa-4d97-8ba0-1494414f0543 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:35:09.889955 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d7090-c2fa-4d97-8ba0-1494414f0543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:35:09.892471 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d7090-c2fa-4d97-8ba0-1494414f0543 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:35:09.906732 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1348/2711] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:35:09.909123 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f98667-39e9-4ba0-9f35-8087bae93d2a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:35:09.923907 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f98667-39e9-4ba0-9f35-8087bae93d2a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:35:09.929122 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a81798-00be-4b7d-8266-ec01def2c96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:35:09.930085 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a81798-00be-4b7d-8266-ec01def2c96d admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:35:09.930377 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a81798-00be-4b7d-8266-ec01def2c96d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:35:09.930661 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a81798-00be-4b7d-8266-ec01def2c96d admin admin] PATH_INFO: `/v3/projects/173847864d7a483c98e92e23ade7b453/users/2d9e2137c210474eaadf663d867f24a4/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:35:09.950000 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a81798-00be-4b7d-8266-ec01def2c96d admin admin] RBAC: Authorizing `identity:create_grant(project_id=173847864d7a483c98e92e23ade7b453, user_id=2d9e2137c210474eaadf663d867f24a4, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:35:09.953704 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a81798-00be-4b7d-8266-ec01def2c96d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:35:09.971136 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1364/2712] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:35:09 2022] PUT /identity/v3/projects/173847864d7a483c98e92e23ade7b453/users/2d9e2137c210474eaadf663d867f24a4/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:35:09.983400 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adb043-6891-4b65-9239-c8f8db74f40d None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:35:09.983998 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adb043-6891-4b65-9239-c8f8db74f40d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:35:09.984473 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adb043-6891-4b65-9239-c8f8db74f40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:35:10.030998 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-25adb043-6891-4b65-9239-c8f8db74f40d None None] MFA Rules not processed for user `2d9e2137c210474eaadf663d867f24a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:35:10.031474 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-25adb043-6891-4b65-9239-c8f8db74f40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:35:10.122579 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1349/2713] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:35:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:35:10.136465 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a81798-00be-4b7d-8266-ec01def2c96d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:35:10.138898 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-86a81798-00be-4b7d-8266-ec01def2c96d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:35:10.223896 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a81798-00be-4b7d-8266-ec01def2c96d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:35:10.228080 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34093c-f487-4bc6-a528-1894342e82fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:35:10.228779 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34093c-f487-4bc6-a528-1894342e82fc service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:35:10.229065 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34093c-f487-4bc6-a528-1894342e82fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:35:10.229423 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34093c-f487-4bc6-a528-1894342e82fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:35:10.240540 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34093c-f487-4bc6-a528-1894342e82fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:35:10.242100 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34093c-f487-4bc6-a528-1894342e82fc service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:35:10.252965 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1365/2714] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:35:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:35:10.273820 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adb043-6891-4b65-9239-c8f8db74f40d None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:35:10.354934 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adb043-6891-4b65-9239-c8f8db74f40d None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:35:10.360139 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed3b75-6c83-41f6-b5c2-4e704ddd3c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:35:10.360987 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed3b75-6c83-41f6-b5c2-4e704ddd3c0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:35:10.361275 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed3b75-6c83-41f6-b5c2-4e704ddd3c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:35:10.361557 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed3b75-6c83-41f6-b5c2-4e704ddd3c0c admin admin] PATH_INFO: `/v3/users/2d9e2137c210474eaadf663d867f24a4` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:35:10.364137 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed3b75-6c83-41f6-b5c2-4e704ddd3c0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d9e2137c210474eaadf663d867f24a4)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:35:10.365670 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed3b75-6c83-41f6-b5c2-4e704ddd3c0c admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:35:10.424589 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-78ed3b75-6c83-41f6-b5c2-4e704ddd3c0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d9e2137c210474eaadf663d867f24a4'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:10.425312 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-78ed3b75-6c83-41f6-b5c2-4e704ddd3c0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d9e2137c210474eaadf663d867f24a4'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:10.438557 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:35:10.450001 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-78ed3b75-6c83-41f6-b5c2-4e704ddd3c0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d9e2137c210474eaadf663d867f24a4'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:10.463248 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-78ed3b75-6c83-41f6-b5c2-4e704ddd3c0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d9e2137c210474eaadf663d867f24a4'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:10.475620 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-78ed3b75-6c83-41f6-b5c2-4e704ddd3c0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d9e2137c210474eaadf663d867f24a4'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:10.487046 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1350/2715] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:35:10 2022] DELETE /identity/v3/users/2d9e2137c210474eaadf663d867f24a4 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:35:10.494302 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c30b5d-3c53-442b-8fd5-68702c302d26 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:35:10.494918 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c30b5d-3c53-442b-8fd5-68702c302d26 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:35:10.495253 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c30b5d-3c53-442b-8fd5-68702c302d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:35:10.517000 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-39c30b5d-3c53-442b-8fd5-68702c302d26 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:35:10.518474 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-39c30b5d-3c53-442b-8fd5-68702c302d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:35:10.601654 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1366/2716] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:35:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:35:10.616812 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed3b75-6c83-41f6-b5c2-4e704ddd3c0c admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:35:10.618657 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-78ed3b75-6c83-41f6-b5c2-4e704ddd3c0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:35:10.701910 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed3b75-6c83-41f6-b5c2-4e704ddd3c0c admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:35:10.706570 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b248ac-45e6-42f9-a619-0040b12379b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:35:10.707247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b248ac-45e6-42f9-a619-0040b12379b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:35:10.707540 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b248ac-45e6-42f9-a619-0040b12379b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:35:10.707832 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b248ac-45e6-42f9-a619-0040b12379b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:35:10.721373 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b248ac-45e6-42f9-a619-0040b12379b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:35:10.722960 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b248ac-45e6-42f9-a619-0040b12379b3 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:35:10.737514 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1351/2717] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:35:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:35:11.264809 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c30b5d-3c53-442b-8fd5-68702c302d26 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:35:11.267485 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-39c30b5d-3c53-442b-8fd5-68702c302d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:35:11.290033 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c30b5d-3c53-442b-8fd5-68702c302d26 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:35:11.299014 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8ec71-d912-4ee8-bf62-be2b74f813ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:35:11.300522 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8ec71-d912-4ee8-bf62-be2b74f813ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:35:11.301039 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8ec71-d912-4ee8-bf62-be2b74f813ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:35:11.301550 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8ec71-d912-4ee8-bf62-be2b74f813ff admin admin] PATH_INFO: `/v3/projects/173847864d7a483c98e92e23ade7b453` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:35:11.304023 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8ec71-d912-4ee8-bf62-be2b74f813ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=173847864d7a483c98e92e23ade7b453)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:35:11.308244 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8ec71-d912-4ee8-bf62-be2b74f813ff admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:35:11.365815 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:35:11.395503 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-fbb8ec71-d912-4ee8-bf62-be2b74f813ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '173847864d7a483c98e92e23ade7b453', 'request_id': 'req-fbb8ec71-d912-4ee8-bf62-be2b74f813ff'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:11.413917 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-fbb8ec71-d912-4ee8-bf62-be2b74f813ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '173847864d7a483c98e92e23ade7b453', 'request_id': 'req-fbb8ec71-d912-4ee8-bf62-be2b74f813ff'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:11.427881 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-fbb8ec71-d912-4ee8-bf62-be2b74f813ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '173847864d7a483c98e92e23ade7b453', 'request_id': 'req-fbb8ec71-d912-4ee8-bf62-be2b74f813ff'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:11.450756 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-fbb8ec71-d912-4ee8-bf62-be2b74f813ff admin admin] The token cache is being invalidate because project 173847864d7a483c98e92e23ade7b453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:35:11.451341 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-fbb8ec71-d912-4ee8-bf62-be2b74f813ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:11.452517 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-fbb8ec71-d912-4ee8-bf62-be2b74f813ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:11.455689 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1367/2718] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:35:11 2022] DELETE /identity/v3/projects/173847864d7a483c98e92e23ade7b453 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:35:11.462883 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe3583-d05d-4753-ba34-a008e26f967c None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:35:11.463777 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe3583-d05d-4753-ba34-a008e26f967c None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:35:11.463967 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe3583-d05d-4753-ba34-a008e26f967c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:35:11.483593 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-39fe3583-d05d-4753-ba34-a008e26f967c None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:35:11.484873 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-39fe3583-d05d-4753-ba34-a008e26f967c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:35:11.555813 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1352/2719] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:35:11.624282 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15b79e-a496-4f86-baaa-b8a2320227db None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:35:11.625192 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15b79e-a496-4f86-baaa-b8a2320227db None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:35:11.625192 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15b79e-a496-4f86-baaa-b8a2320227db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:35:11.646249 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-1a15b79e-a496-4f86-baaa-b8a2320227db None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:35:11.647528 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1a15b79e-a496-4f86-baaa-b8a2320227db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:35:11.656696 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1368/2720] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:35:11.661352 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe3583-d05d-4753-ba34-a008e26f967c None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:35:11.675012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe3583-d05d-4753-ba34-a008e26f967c None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:35:11.687424 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5594a35-9a81-400c-b1dc-4140d7132c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:35:11.688033 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5594a35-9a81-400c-b1dc-4140d7132c58 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:35:11.688332 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5594a35-9a81-400c-b1dc-4140d7132c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:35:11.688705 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5594a35-9a81-400c-b1dc-4140d7132c58 admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:35:11.689492 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5594a35-9a81-400c-b1dc-4140d7132c58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:35:11.689806 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5594a35-9a81-400c-b1dc-4140d7132c58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:35:11.691562 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5594a35-9a81-400c-b1dc-4140d7132c58 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:35:11.705865 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1353/2721] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:35:11.710960 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15b79e-a496-4f86-baaa-b8a2320227db None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:35:11.721834 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15b79e-a496-4f86-baaa-b8a2320227db None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:35:11.727521 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192847e-5129-488b-9bdc-85a3a44df307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:35:11.728342 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192847e-5129-488b-9bdc-85a3a44df307 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:35:11.728684 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192847e-5129-488b-9bdc-85a3a44df307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:35:11.730216 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192847e-5129-488b-9bdc-85a3a44df307 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:35:11.731631 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192847e-5129-488b-9bdc-85a3a44df307 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:35:11.735464 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192847e-5129-488b-9bdc-85a3a44df307 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:35:11.778859 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1369/2722] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:35:11 2022] POST /identity/v3/projects => generated 375 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:35:11.783905 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5594a35-9a81-400c-b1dc-4140d7132c58 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:35:11.806459 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5594a35-9a81-400c-b1dc-4140d7132c58 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:35:11.896191 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb976bb-329d-40a3-ad31-799969565f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:35:11.897014 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb976bb-329d-40a3-ad31-799969565f9f admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:35:11.897401 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb976bb-329d-40a3-ad31-799969565f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:35:11.897757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb976bb-329d-40a3-ad31-799969565f9f admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:35:11.898582 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb976bb-329d-40a3-ad31-799969565f9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:35:11.902026 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb976bb-329d-40a3-ad31-799969565f9f admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:35:11.912995 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:35:11.931634 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1354/2723] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:35:11 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:35:11.936695 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192847e-5129-488b-9bdc-85a3a44df307 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:35:11.955057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192847e-5129-488b-9bdc-85a3a44df307 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:35:11.960710 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0d930-4293-4f20-87c7-bfff78b6ffb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:35:11.961934 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0d930-4293-4f20-87c7-bfff78b6ffb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:35:11.962347 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0d930-4293-4f20-87c7-bfff78b6ffb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:35:11.962807 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0d930-4293-4f20-87c7-bfff78b6ffb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:35:11.963743 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb0d930-4293-4f20-87c7-bfff78b6ffb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:35:11.966715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb0d930-4293-4f20-87c7-bfff78b6ffb4 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:35:11.987942 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1370/2724] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:35:11.992682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb976bb-329d-40a3-ad31-799969565f9f admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:35:12.015134 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb976bb-329d-40a3-ad31-799969565f9f admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:35:12.027484 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8330a8e-e850-4eef-b8c0-2aca71204877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:35:12.028927 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8330a8e-e850-4eef-b8c0-2aca71204877 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:35:12.029616 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8330a8e-e850-4eef-b8c0-2aca71204877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:35:12.030295 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8330a8e-e850-4eef-b8c0-2aca71204877 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:35:12.031865 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8330a8e-e850-4eef-b8c0-2aca71204877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:35:12.035596 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8330a8e-e850-4eef-b8c0-2aca71204877 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:35:12.059805 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1355/2725] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:35:12.065211 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0d930-4293-4f20-87c7-bfff78b6ffb4 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:35:12.082971 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0d930-4293-4f20-87c7-bfff78b6ffb4 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:35:12.092348 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa45fe0-8d99-464c-aade-6247b51d969b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:35:12.094291 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa45fe0-8d99-464c-aade-6247b51d969b admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:35:12.094911 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa45fe0-8d99-464c-aade-6247b51d969b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:35:12.095552 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa45fe0-8d99-464c-aade-6247b51d969b admin admin] PATH_INFO: `/v3/projects/660f987b2c1344d59f01b6d525546cfd/users/2c158b9b4e6e4e458efca10814cf7de5/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:35:12.134812 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa45fe0-8d99-464c-aade-6247b51d969b admin admin] RBAC: Authorizing `identity:create_grant(project_id=660f987b2c1344d59f01b6d525546cfd, user_id=2c158b9b4e6e4e458efca10814cf7de5, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:35:12.142384 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa45fe0-8d99-464c-aade-6247b51d969b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:35:12.180622 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1371/2726] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:35:12 2022] PUT /identity/v3/projects/660f987b2c1344d59f01b6d525546cfd/users/2c158b9b4e6e4e458efca10814cf7de5/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:35:12.193836 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84894b-7d71-4804-a999-a3d66a301c54 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:35:12.194357 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84894b-7d71-4804-a999-a3d66a301c54 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:35:12.194743 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84894b-7d71-4804-a999-a3d66a301c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:35:12.231444 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-cd84894b-7d71-4804-a999-a3d66a301c54 None None] MFA Rules not processed for user `2c158b9b4e6e4e458efca10814cf7de5`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:35:12.232722 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-cd84894b-7d71-4804-a999-a3d66a301c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:35:12.330622 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1356/2727] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:35:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:35:12.345477 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa45fe0-8d99-464c-aade-6247b51d969b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:35:12.348272 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-bfa45fe0-8d99-464c-aade-6247b51d969b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:35:12.446644 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa45fe0-8d99-464c-aade-6247b51d969b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:35:12.452440 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a801008-ba0e-4ccf-8810-8c78716797d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:35:12.453292 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a801008-ba0e-4ccf-8810-8c78716797d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:35:12.453766 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a801008-ba0e-4ccf-8810-8c78716797d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:35:12.454231 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a801008-ba0e-4ccf-8810-8c78716797d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:35:12.465481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a801008-ba0e-4ccf-8810-8c78716797d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:35:12.467328 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a801008-ba0e-4ccf-8810-8c78716797d3 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:35:12.478823 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1372/2728] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:35:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:35:15.909337 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84894b-7d71-4804-a999-a3d66a301c54 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:35:16.029607 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84894b-7d71-4804-a999-a3d66a301c54 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:35:16.037729 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720759a-0ccd-4227-b4da-12afca8e555e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:35:16.039327 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720759a-0ccd-4227-b4da-12afca8e555e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:35:16.039873 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720759a-0ccd-4227-b4da-12afca8e555e admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:35:16.040383 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720759a-0ccd-4227-b4da-12afca8e555e admin admin] PATH_INFO: `/v3/users/2c158b9b4e6e4e458efca10814cf7de5` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:35:16.043315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720759a-0ccd-4227-b4da-12afca8e555e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c158b9b4e6e4e458efca10814cf7de5)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:35:16.047249 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720759a-0ccd-4227-b4da-12afca8e555e admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:35:16.134932 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3720759a-0ccd-4227-b4da-12afca8e555e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c158b9b4e6e4e458efca10814cf7de5'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:16.136414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3720759a-0ccd-4227-b4da-12afca8e555e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c158b9b4e6e4e458efca10814cf7de5'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:16.156147 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3720759a-0ccd-4227-b4da-12afca8e555e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c158b9b4e6e4e458efca10814cf7de5'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:16.168650 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3720759a-0ccd-4227-b4da-12afca8e555e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c158b9b4e6e4e458efca10814cf7de5'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:16.170915 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:INSERT=1,keystone:SELECT=90,keystone:DELETE=9 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:35:16.180921 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3720759a-0ccd-4227-b4da-12afca8e555e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c158b9b4e6e4e458efca10814cf7de5'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:16.193311 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1357/2729] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:35:15 2022] DELETE /identity/v3/users/2c158b9b4e6e4e458efca10814cf7de5 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:35:16.200071 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587c295-637c-43a6-9b71-dfc009c4ae74 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:35:16.200937 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587c295-637c-43a6-9b71-dfc009c4ae74 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:35:16.201267 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587c295-637c-43a6-9b71-dfc009c4ae74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:35:16.221072 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-9587c295-637c-43a6-9b71-dfc009c4ae74 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:35:16.222357 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9587c295-637c-43a6-9b71-dfc009c4ae74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:35:16.293779 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:35:16.319380 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1373/2730] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:35:16.333408 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720759a-0ccd-4227-b4da-12afca8e555e admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:35:16.335324 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3720759a-0ccd-4227-b4da-12afca8e555e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:35:16.437106 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720759a-0ccd-4227-b4da-12afca8e555e admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:35:16.443715 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0040eb-019a-48da-9eec-3b570126b40b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:35:16.444841 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0040eb-019a-48da-9eec-3b570126b40b service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:35:16.445340 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0040eb-019a-48da-9eec-3b570126b40b service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:35:16.445832 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0040eb-019a-48da-9eec-3b570126b40b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:35:16.466356 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0040eb-019a-48da-9eec-3b570126b40b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:35:16.469124 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0040eb-019a-48da-9eec-3b570126b40b service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:35:16.488198 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1358/2731] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:35:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:35:16.833655 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9587c295-637c-43a6-9b71-dfc009c4ae74 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:35:16.836199 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9587c295-637c-43a6-9b71-dfc009c4ae74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:35:16.856511 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9587c295-637c-43a6-9b71-dfc009c4ae74 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:35:16.861892 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080cba6-b056-4928-8642-8f14d67853a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:35:16.862675 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080cba6-b056-4928-8642-8f14d67853a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:35:16.862971 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080cba6-b056-4928-8642-8f14d67853a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:35:16.863294 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080cba6-b056-4928-8642-8f14d67853a6 admin admin] PATH_INFO: `/v3/projects/660f987b2c1344d59f01b6d525546cfd` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:35:16.864586 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080cba6-b056-4928-8642-8f14d67853a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=660f987b2c1344d59f01b6d525546cfd)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:35:16.866587 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080cba6-b056-4928-8642-8f14d67853a6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:35:16.923845 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8080cba6-b056-4928-8642-8f14d67853a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '660f987b2c1344d59f01b6d525546cfd', 'request_id': 'req-8080cba6-b056-4928-8642-8f14d67853a6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:16.930912 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8080cba6-b056-4928-8642-8f14d67853a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '660f987b2c1344d59f01b6d525546cfd', 'request_id': 'req-8080cba6-b056-4928-8642-8f14d67853a6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:16.946126 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8080cba6-b056-4928-8642-8f14d67853a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '660f987b2c1344d59f01b6d525546cfd', 'request_id': 'req-8080cba6-b056-4928-8642-8f14d67853a6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:16.962283 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8080cba6-b056-4928-8642-8f14d67853a6 admin admin] The token cache is being invalidate because project 660f987b2c1344d59f01b6d525546cfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:35:16.962588 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8080cba6-b056-4928-8642-8f14d67853a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:16.963240 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8080cba6-b056-4928-8642-8f14d67853a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:35:16.964937 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1374/2732] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:35:16 2022] DELETE /identity/v3/projects/660f987b2c1344d59f01b6d525546cfd => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:35:26.480054 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=28 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:35:26.958796 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=27,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:36:11.391512 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f552a9-7d00-4a5e-b3cd-9317fef837a5 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:36:11.392472 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f552a9-7d00-4a5e-b3cd-9317fef837a5 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:36:11.392472 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f552a9-7d00-4a5e-b3cd-9317fef837a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:36:11.412640 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-68f552a9-7d00-4a5e-b3cd-9317fef837a5 None None] MFA Rules not processed for user `84e5577e32e545c0a060cce6238208eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:36:11.414251 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-68f552a9-7d00-4a5e-b3cd-9317fef837a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:36:11.490395 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1359/2733] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:36:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:36:21.483224 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=25 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:36:32.097007 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080cba6-b056-4928-8642-8f14d67853a6 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:36:32.098654 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8080cba6-b056-4928-8642-8f14d67853a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:36:32.186265 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080cba6-b056-4928-8642-8f14d67853a6 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:36:32.191908 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b16ded-fd19-49f9-8462-58a3911f5b4a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0433f6219478476286ea27c5c82d41a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:36:32.192578 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b16ded-fd19-49f9-8462-58a3911f5b4a service placement] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:36:32.192859 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b16ded-fd19-49f9-8462-58a3911f5b4a service placement] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:36:32.193137 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b16ded-fd19-49f9-8462-58a3911f5b4a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:36:32.195341 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-80b16ded-fd19-49f9-8462-58a3911f5b4a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:36:32.209792 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b16ded-fd19-49f9-8462-58a3911f5b4a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:36:32.211468 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b16ded-fd19-49f9-8462-58a3911f5b4a service placement] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:36:32.224147 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1375/2734] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:36:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:36:42.218658 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=32 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:37:17.909459 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f552a9-7d00-4a5e-b3cd-9317fef837a5 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:17.910133 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-68f552a9-7d00-4a5e-b3cd-9317fef837a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:17.991326 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f552a9-7d00-4a5e-b3cd-9317fef837a5 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:17.996761 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f286d-5f38-41cb-aa8e-acae28c988ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:17.997633 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f286d-5f38-41cb-aa8e-acae28c988ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:17.997914 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f286d-5f38-41cb-aa8e-acae28c988ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:17.998220 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f286d-5f38-41cb-aa8e-acae28c988ee admin admin] PATH_INFO: `/v3/users/84e5577e32e545c0a060cce6238208eb` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:17.999418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f286d-5f38-41cb-aa8e-acae28c988ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=84e5577e32e545c0a060cce6238208eb)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:18.001355 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f286d-5f38-41cb-aa8e-acae28c988ee admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:18.051456 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-c65f286d-5f38-41cb-aa8e-acae28c988ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84e5577e32e545c0a060cce6238208eb'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:18.052058 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-c65f286d-5f38-41cb-aa8e-acae28c988ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84e5577e32e545c0a060cce6238208eb'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:18.064623 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-c65f286d-5f38-41cb-aa8e-acae28c988ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84e5577e32e545c0a060cce6238208eb'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:18.073445 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-c65f286d-5f38-41cb-aa8e-acae28c988ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84e5577e32e545c0a060cce6238208eb'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:18.081783 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-c65f286d-5f38-41cb-aa8e-acae28c988ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84e5577e32e545c0a060cce6238208eb'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:18.088177 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1360/2735] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:37:17 2022] DELETE /identity/v3/users/84e5577e32e545c0a060cce6238208eb => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:37:18.271040 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b16ded-fd19-49f9-8462-58a3911f5b4a service placement] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:18.286108 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b16ded-fd19-49f9-8462-58a3911f5b4a service placement] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:18.348153 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e604b27-eca0-4d5b-8a5e-dcd0cd236942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:18.348929 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e604b27-eca0-4d5b-8a5e-dcd0cd236942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:18.349237 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e604b27-eca0-4d5b-8a5e-dcd0cd236942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:18.349543 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e604b27-eca0-4d5b-8a5e-dcd0cd236942 admin admin] PATH_INFO: `/v3/projects/db352bbd23484a068a7badc327d9f6fa` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:18.350791 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e604b27-eca0-4d5b-8a5e-dcd0cd236942 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db352bbd23484a068a7badc327d9f6fa)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:18.352699 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e604b27-eca0-4d5b-8a5e-dcd0cd236942 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:18.401205 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3e604b27-eca0-4d5b-8a5e-dcd0cd236942 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db352bbd23484a068a7badc327d9f6fa', 'request_id': 'req-3e604b27-eca0-4d5b-8a5e-dcd0cd236942'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:18.406878 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3e604b27-eca0-4d5b-8a5e-dcd0cd236942 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db352bbd23484a068a7badc327d9f6fa', 'request_id': 'req-3e604b27-eca0-4d5b-8a5e-dcd0cd236942'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:18.414955 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3e604b27-eca0-4d5b-8a5e-dcd0cd236942 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db352bbd23484a068a7badc327d9f6fa', 'request_id': 'req-3e604b27-eca0-4d5b-8a5e-dcd0cd236942'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:18.426998 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3e604b27-eca0-4d5b-8a5e-dcd0cd236942 admin admin] The token cache is being invalidate because project db352bbd23484a068a7badc327d9f6fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:37:18.427296 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3e604b27-eca0-4d5b-8a5e-dcd0cd236942 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:18.427857 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3e604b27-eca0-4d5b-8a5e-dcd0cd236942 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:18.429427 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1376/2736] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:37:18 2022] DELETE /identity/v3/projects/db352bbd23484a068a7badc327d9f6fa => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:37:18.434414 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787d280-7166-46d6-8618-6646c99a1c87 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:18.434712 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787d280-7166-46d6-8618-6646c99a1c87 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:18.434998 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787d280-7166-46d6-8618-6646c99a1c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:18.453751 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-1787d280-7166-46d6-8618-6646c99a1c87 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:37:18.455016 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-1787d280-7166-46d6-8618-6646c99a1c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:18.517166 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1361/2737] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:37:18.524696 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da795d-206c-4ff1-9310-277527a023c6 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:18.525488 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da795d-206c-4ff1-9310-277527a023c6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:18.525819 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da795d-206c-4ff1-9310-277527a023c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:18.545843 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-38da795d-206c-4ff1-9310-277527a023c6 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:37:18.547074 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-38da795d-206c-4ff1-9310-277527a023c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:18.555088 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1377/2738] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:37:18.559430 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787d280-7166-46d6-8618-6646c99a1c87 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:18.569607 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787d280-7166-46d6-8618-6646c99a1c87 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:18.574861 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f56f45e-84d3-4007-b951-2d066da6ad8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:18.575773 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56f45e-84d3-4007-b951-2d066da6ad8c admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:18.576061 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56f45e-84d3-4007-b951-2d066da6ad8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:18.576344 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56f45e-84d3-4007-b951-2d066da6ad8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:18.577070 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f56f45e-84d3-4007-b951-2d066da6ad8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:37:18.577381 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f56f45e-84d3-4007-b951-2d066da6ad8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:18.579009 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f56f45e-84d3-4007-b951-2d066da6ad8c admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:18.591835 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1362/2739] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:37:18.596090 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da795d-206c-4ff1-9310-277527a023c6 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:18.605883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da795d-206c-4ff1-9310-277527a023c6 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:18.610478 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa87c0-7ab1-4b95-839e-51ff88f2250f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:18.611130 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa87c0-7ab1-4b95-839e-51ff88f2250f admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:18.611413 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa87c0-7ab1-4b95-839e-51ff88f2250f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:18.611687 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa87c0-7ab1-4b95-839e-51ff88f2250f admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:18.612376 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa87c0-7ab1-4b95-839e-51ff88f2250f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:18.614282 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa87c0-7ab1-4b95-839e-51ff88f2250f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:18.641626 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1378/2740] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:37:18 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:37:18.646816 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f56f45e-84d3-4007-b951-2d066da6ad8c admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:18.661192 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f56f45e-84d3-4007-b951-2d066da6ad8c admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:18.665541 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:37:18.723041 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99daf63-e993-4640-b203-7881083f8860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:18.723710 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99daf63-e993-4640-b203-7881083f8860 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:18.723989 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99daf63-e993-4640-b203-7881083f8860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:18.724262 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99daf63-e993-4640-b203-7881083f8860 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:18.724948 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99daf63-e993-4640-b203-7881083f8860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:18.726934 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99daf63-e993-4640-b203-7881083f8860 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:18.748326 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1363/2741] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:37:18 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:37:18.752552 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa87c0-7ab1-4b95-839e-51ff88f2250f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:18.763653 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa87c0-7ab1-4b95-839e-51ff88f2250f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:18.768350 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93f227-c1e5-4722-b179-0a70009bf500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:18.769016 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93f227-c1e5-4722-b179-0a70009bf500 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:18.769292 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93f227-c1e5-4722-b179-0a70009bf500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:18.769570 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93f227-c1e5-4722-b179-0a70009bf500 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:18.770320 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93f227-c1e5-4722-b179-0a70009bf500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:18.771904 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93f227-c1e5-4722-b179-0a70009bf500 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:18.783270 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1379/2742] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:37:18.787496 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99daf63-e993-4640-b203-7881083f8860 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:18.797685 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99daf63-e993-4640-b203-7881083f8860 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:18.802346 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e230bc-e1ce-4dea-929f-89b1d32a844f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:18.803061 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e230bc-e1ce-4dea-929f-89b1d32a844f admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:18.803343 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e230bc-e1ce-4dea-929f-89b1d32a844f admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:18.803620 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e230bc-e1ce-4dea-929f-89b1d32a844f admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:18.804339 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e230bc-e1ce-4dea-929f-89b1d32a844f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:18.805923 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e230bc-e1ce-4dea-929f-89b1d32a844f admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:18.816463 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1364/2743] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:37:18.820744 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93f227-c1e5-4722-b179-0a70009bf500 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:18.831983 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93f227-c1e5-4722-b179-0a70009bf500 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:18.836821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1263e7-a9fa-4dac-a69d-8ae3b3d9403f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:18.838355 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1263e7-a9fa-4dac-a69d-8ae3b3d9403f admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:18.838634 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1263e7-a9fa-4dac-a69d-8ae3b3d9403f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:18.838919 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1263e7-a9fa-4dac-a69d-8ae3b3d9403f admin admin] PATH_INFO: `/v3/projects/c9ffa90d1ca6493980ae7f05ef968122/users/aecf4e2787e2490bae6800cbe59d2dae/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:18.854732 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1263e7-a9fa-4dac-a69d-8ae3b3d9403f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9ffa90d1ca6493980ae7f05ef968122, user_id=aecf4e2787e2490bae6800cbe59d2dae, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:18.857552 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1263e7-a9fa-4dac-a69d-8ae3b3d9403f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:18.871610 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1380/2744] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:37:18 2022] PUT /identity/v3/projects/c9ffa90d1ca6493980ae7f05ef968122/users/aecf4e2787e2490bae6800cbe59d2dae/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:37:18.881653 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ed05f-cc73-4736-a634-c003bf7b8174 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:18.881943 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ed05f-cc73-4736-a634-c003bf7b8174 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:18.882255 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ed05f-cc73-4736-a634-c003bf7b8174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:18.911468 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-9e5ed05f-cc73-4736-a634-c003bf7b8174 None None] MFA Rules not processed for user `aecf4e2787e2490bae6800cbe59d2dae`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:37:18.912683 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-9e5ed05f-cc73-4736-a634-c003bf7b8174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:18.984829 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1365/2745] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:37:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:37:18.989577 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1263e7-a9fa-4dac-a69d-8ae3b3d9403f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:19.024521 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:37:19.059216 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1263e7-a9fa-4dac-a69d-8ae3b3d9403f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:19.064002 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c44d69-2c35-410b-a6a6-e2e33909a48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:19.064668 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c44d69-2c35-410b-a6a6-e2e33909a48e admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:19.064954 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c44d69-2c35-410b-a6a6-e2e33909a48e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:19.065259 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c44d69-2c35-410b-a6a6-e2e33909a48e admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:19.065950 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c44d69-2c35-410b-a6a6-e2e33909a48e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:19.067920 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c44d69-2c35-410b-a6a6-e2e33909a48e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:19.095887 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1381/2746] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:37:18 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:37:19.100163 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ed05f-cc73-4736-a634-c003bf7b8174 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:19.117766 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ed05f-cc73-4736-a634-c003bf7b8174 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:19.182637 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7e318-b8cd-4a46-9b1a-ef3adb226a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:19.183321 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7e318-b8cd-4a46-9b1a-ef3adb226a8b admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:19.183606 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7e318-b8cd-4a46-9b1a-ef3adb226a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:19.183888 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7e318-b8cd-4a46-9b1a-ef3adb226a8b admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:19.184595 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7e318-b8cd-4a46-9b1a-ef3adb226a8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:19.186556 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7e318-b8cd-4a46-9b1a-ef3adb226a8b admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:19.207338 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1366/2747] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:37:19 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:37:19.211445 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c44d69-2c35-410b-a6a6-e2e33909a48e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:19.221961 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c44d69-2c35-410b-a6a6-e2e33909a48e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:19.226775 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ab8c7-4d9e-454b-a23b-ca2a3309c70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:19.227451 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ab8c7-4d9e-454b-a23b-ca2a3309c70f admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:19.227739 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ab8c7-4d9e-454b-a23b-ca2a3309c70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:19.228052 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ab8c7-4d9e-454b-a23b-ca2a3309c70f admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:19.228792 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ab8c7-4d9e-454b-a23b-ca2a3309c70f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:19.230439 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ab8c7-4d9e-454b-a23b-ca2a3309c70f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:19.241527 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1382/2748] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:37:19.246302 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7e318-b8cd-4a46-9b1a-ef3adb226a8b admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:19.252963 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:37:19.257157 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7e318-b8cd-4a46-9b1a-ef3adb226a8b admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:19.263541 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8a166-905e-4881-a1cf-0851e7694d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:19.264431 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8a166-905e-4881-a1cf-0851e7694d42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:19.264714 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8a166-905e-4881-a1cf-0851e7694d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:19.264996 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8a166-905e-4881-a1cf-0851e7694d42 admin admin] PATH_INFO: `/v3/projects/d1d22d348a284001a2275f89658c2b04/users/4a3145b528a64f25a8303e45a4538b0a/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:19.280333 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f8a166-905e-4881-a1cf-0851e7694d42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1d22d348a284001a2275f89658c2b04, user_id=4a3145b528a64f25a8303e45a4538b0a, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:19.283065 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f8a166-905e-4881-a1cf-0851e7694d42 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:19.297561 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1367/2749] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:37:19 2022] PUT /identity/v3/projects/d1d22d348a284001a2275f89658c2b04/users/4a3145b528a64f25a8303e45a4538b0a/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:37:19.301715 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ab8c7-4d9e-454b-a23b-ca2a3309c70f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:19.312621 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ab8c7-4d9e-454b-a23b-ca2a3309c70f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:19.371565 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9f514-1c2c-4301-940f-13b66d229667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:19.372817 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9f514-1c2c-4301-940f-13b66d229667 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:19.373104 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9f514-1c2c-4301-940f-13b66d229667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:19.373386 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9f514-1c2c-4301-940f-13b66d229667 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:19.374163 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9f514-1c2c-4301-940f-13b66d229667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:19.375769 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9f514-1c2c-4301-940f-13b66d229667 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:19.386089 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1383/2750] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:37:19.390694 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8a166-905e-4881-a1cf-0851e7694d42 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:19.402869 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8a166-905e-4881-a1cf-0851e7694d42 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:19.407755 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d8de28-26f8-44e9-901d-63756d7e17fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:19.408716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8de28-26f8-44e9-901d-63756d7e17fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:19.408959 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8de28-26f8-44e9-901d-63756d7e17fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:19.409234 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8de28-26f8-44e9-901d-63756d7e17fd admin admin] PATH_INFO: `/v3/projects/d1d22d348a284001a2275f89658c2b04/users/4a3145b528a64f25a8303e45a4538b0a/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:19.411421 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d8de28-26f8-44e9-901d-63756d7e17fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1d22d348a284001a2275f89658c2b04, user_id=4a3145b528a64f25a8303e45a4538b0a, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:19.414110 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d8de28-26f8-44e9-901d-63756d7e17fd admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:19.425771 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1368/2751] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:37:19 2022] PUT /identity/v3/projects/d1d22d348a284001a2275f89658c2b04/users/4a3145b528a64f25a8303e45a4538b0a/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:37:19.438261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682764dc-d04c-48e9-980e-9031743ad041 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:19.438578 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682764dc-d04c-48e9-980e-9031743ad041 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:19.438869 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682764dc-d04c-48e9-980e-9031743ad041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:19.468544 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-682764dc-d04c-48e9-980e-9031743ad041 None None] MFA Rules not processed for user `4a3145b528a64f25a8303e45a4538b0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:37:19.469788 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-682764dc-d04c-48e9-980e-9031743ad041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:19.546251 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1384/2752] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:37:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:37:19.557744 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d8de28-26f8-44e9-901d-63756d7e17fd admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:19.559500 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-45d8de28-26f8-44e9-901d-63756d7e17fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:19.620336 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d8de28-26f8-44e9-901d-63756d7e17fd admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:19.624064 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d864a-bca4-4dbe-9696-a69113fbaacf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:19.624656 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d864a-bca4-4dbe-9696-a69113fbaacf service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:19.624936 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d864a-bca4-4dbe-9696-a69113fbaacf service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:19.625215 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d864a-bca4-4dbe-9696-a69113fbaacf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:19.686441 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d864a-bca4-4dbe-9696-a69113fbaacf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:19.687857 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d864a-bca4-4dbe-9696-a69113fbaacf service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:19.696961 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1369/2753] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:37:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:37:22.287272 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682764dc-d04c-48e9-980e-9031743ad041 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:22.306737 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682764dc-d04c-48e9-980e-9031743ad041 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:22.313154 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f110286-f294-4feb-9877-49eb6af328cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:22.314365 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f110286-f294-4feb-9877-49eb6af328cf service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:22.314894 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f110286-f294-4feb-9877-49eb6af328cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:22.316382 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f110286-f294-4feb-9877-49eb6af328cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:22.331917 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f110286-f294-4feb-9877-49eb6af328cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:22.335006 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f110286-f294-4feb-9877-49eb6af328cf service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:22.356034 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1385/2754] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:37:22 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:37:29.692828 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=61,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:37:32.344702 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=95,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:37:34.982415 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d864a-bca4-4dbe-9696-a69113fbaacf service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:35.049962 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d864a-bca4-4dbe-9696-a69113fbaacf service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:35.055260 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87170df-ca8e-42f2-beea-96ed039aba08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:35.056199 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87170df-ca8e-42f2-beea-96ed039aba08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:35.056493 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87170df-ca8e-42f2-beea-96ed039aba08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:35.056766 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87170df-ca8e-42f2-beea-96ed039aba08 admin admin] PATH_INFO: `/v3/users/aecf4e2787e2490bae6800cbe59d2dae` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:35.058166 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87170df-ca8e-42f2-beea-96ed039aba08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aecf4e2787e2490bae6800cbe59d2dae)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:35.060149 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87170df-ca8e-42f2-beea-96ed039aba08 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:35.123034 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f87170df-ca8e-42f2-beea-96ed039aba08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aecf4e2787e2490bae6800cbe59d2dae'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:35.123758 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f87170df-ca8e-42f2-beea-96ed039aba08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aecf4e2787e2490bae6800cbe59d2dae'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:35.138512 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f87170df-ca8e-42f2-beea-96ed039aba08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aecf4e2787e2490bae6800cbe59d2dae'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:35.149280 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f87170df-ca8e-42f2-beea-96ed039aba08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aecf4e2787e2490bae6800cbe59d2dae'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:35.161476 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f87170df-ca8e-42f2-beea-96ed039aba08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aecf4e2787e2490bae6800cbe59d2dae'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:35.167945 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1370/2755] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:37:34 2022] DELETE /identity/v3/users/aecf4e2787e2490bae6800cbe59d2dae => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:37:35.172740 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe3e9a-d771-4dae-bc3f-aa8717e330b7 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:35.173524 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe3e9a-d771-4dae-bc3f-aa8717e330b7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:35.173524 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe3e9a-d771-4dae-bc3f-aa8717e330b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:35.191563 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-0cbe3e9a-d771-4dae-bc3f-aa8717e330b7 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:37:35.192798 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0cbe3e9a-d771-4dae-bc3f-aa8717e330b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:35.268811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1386/2756] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:37:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:37:35.279646 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87170df-ca8e-42f2-beea-96ed039aba08 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:35.282827 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f87170df-ca8e-42f2-beea-96ed039aba08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:35.354117 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87170df-ca8e-42f2-beea-96ed039aba08 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:35.358118 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e55081-da0c-474f-bcad-8e396581baa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:35.358782 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e55081-da0c-474f-bcad-8e396581baa3 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:35.359069 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e55081-da0c-474f-bcad-8e396581baa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:35.359350 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e55081-da0c-474f-bcad-8e396581baa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:35.369429 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e55081-da0c-474f-bcad-8e396581baa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:35.370906 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e55081-da0c-474f-bcad-8e396581baa3 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:35.381234 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1371/2757] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:37:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:37:35.663239 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe3e9a-d771-4dae-bc3f-aa8717e330b7 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:35.664991 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0cbe3e9a-d771-4dae-bc3f-aa8717e330b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:35.684730 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe3e9a-d771-4dae-bc3f-aa8717e330b7 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:35.690869 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be6ac8-db28-4bca-b61d-a402fe91a414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:35.691752 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be6ac8-db28-4bca-b61d-a402fe91a414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:35.692040 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be6ac8-db28-4bca-b61d-a402fe91a414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:35.692320 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be6ac8-db28-4bca-b61d-a402fe91a414 admin admin] PATH_INFO: `/v3/projects/c9ffa90d1ca6493980ae7f05ef968122` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:35.693627 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be6ac8-db28-4bca-b61d-a402fe91a414 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9ffa90d1ca6493980ae7f05ef968122)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:35.695603 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be6ac8-db28-4bca-b61d-a402fe91a414 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:35.750238 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-11be6ac8-db28-4bca-b61d-a402fe91a414 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9ffa90d1ca6493980ae7f05ef968122', 'request_id': 'req-11be6ac8-db28-4bca-b61d-a402fe91a414'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:35.756694 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-11be6ac8-db28-4bca-b61d-a402fe91a414 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9ffa90d1ca6493980ae7f05ef968122', 'request_id': 'req-11be6ac8-db28-4bca-b61d-a402fe91a414'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:35.766120 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-11be6ac8-db28-4bca-b61d-a402fe91a414 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9ffa90d1ca6493980ae7f05ef968122', 'request_id': 'req-11be6ac8-db28-4bca-b61d-a402fe91a414'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:35.780046 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-11be6ac8-db28-4bca-b61d-a402fe91a414 admin admin] The token cache is being invalidate because project c9ffa90d1ca6493980ae7f05ef968122 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:37:35.780472 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-11be6ac8-db28-4bca-b61d-a402fe91a414 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:35.781233 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-11be6ac8-db28-4bca-b61d-a402fe91a414 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:35.783046 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1387/2758] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:37:35 2022] DELETE /identity/v3/projects/c9ffa90d1ca6493980ae7f05ef968122 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:37:35.787300 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e55081-da0c-474f-bcad-8e396581baa3 service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:35.797913 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e55081-da0c-474f-bcad-8e396581baa3 service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:35.817373 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:37:35.859206 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78452dc-222c-43fc-867f-e623d5d6e233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:35.860084 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78452dc-222c-43fc-867f-e623d5d6e233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:35.860365 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78452dc-222c-43fc-867f-e623d5d6e233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:35.860642 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78452dc-222c-43fc-867f-e623d5d6e233 admin admin] PATH_INFO: `/v3/users/4a3145b528a64f25a8303e45a4538b0a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:35.861834 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78452dc-222c-43fc-867f-e623d5d6e233 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a3145b528a64f25a8303e45a4538b0a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:35.863784 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78452dc-222c-43fc-867f-e623d5d6e233 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:35.913842 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f78452dc-222c-43fc-867f-e623d5d6e233 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a3145b528a64f25a8303e45a4538b0a'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:35.914539 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f78452dc-222c-43fc-867f-e623d5d6e233 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a3145b528a64f25a8303e45a4538b0a'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:35.927786 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f78452dc-222c-43fc-867f-e623d5d6e233 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a3145b528a64f25a8303e45a4538b0a'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:35.936220 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f78452dc-222c-43fc-867f-e623d5d6e233 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a3145b528a64f25a8303e45a4538b0a'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:35.944097 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f78452dc-222c-43fc-867f-e623d5d6e233 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a3145b528a64f25a8303e45a4538b0a'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:35.950721 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1372/2759] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:37:35 2022] DELETE /identity/v3/users/4a3145b528a64f25a8303e45a4538b0a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:37:36.243224 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be6ac8-db28-4bca-b61d-a402fe91a414 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:36.244798 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-11be6ac8-db28-4bca-b61d-a402fe91a414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:36.258424 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be6ac8-db28-4bca-b61d-a402fe91a414 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:36.327151 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7273e24-1923-4b8a-acdc-6e6fd628e981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:36.327981 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7273e24-1923-4b8a-acdc-6e6fd628e981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:36.328266 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7273e24-1923-4b8a-acdc-6e6fd628e981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:36.328546 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7273e24-1923-4b8a-acdc-6e6fd628e981 admin admin] PATH_INFO: `/v3/projects/d1d22d348a284001a2275f89658c2b04` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:36.329836 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7273e24-1923-4b8a-acdc-6e6fd628e981 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1d22d348a284001a2275f89658c2b04)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:36.331960 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7273e24-1923-4b8a-acdc-6e6fd628e981 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:36.368005 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:37:36.392958 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c7273e24-1923-4b8a-acdc-6e6fd628e981 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1d22d348a284001a2275f89658c2b04', 'request_id': 'req-c7273e24-1923-4b8a-acdc-6e6fd628e981'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:36.403124 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c7273e24-1923-4b8a-acdc-6e6fd628e981 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1d22d348a284001a2275f89658c2b04', 'request_id': 'req-c7273e24-1923-4b8a-acdc-6e6fd628e981'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:36.414100 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c7273e24-1923-4b8a-acdc-6e6fd628e981 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1d22d348a284001a2275f89658c2b04', 'request_id': 'req-c7273e24-1923-4b8a-acdc-6e6fd628e981'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:36.427763 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c7273e24-1923-4b8a-acdc-6e6fd628e981 admin admin] The token cache is being invalidate because project d1d22d348a284001a2275f89658c2b04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:37:36.428206 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c7273e24-1923-4b8a-acdc-6e6fd628e981 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:36.428985 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c7273e24-1923-4b8a-acdc-6e6fd628e981 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:36.430619 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1388/2760] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:37:36 2022] DELETE /identity/v3/projects/d1d22d348a284001a2275f89658c2b04 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:37:36.435695 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b43a8-b54f-4319-b60a-50b544fd0f17 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:36.436218 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b43a8-b54f-4319-b60a-50b544fd0f17 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:36.436336 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b43a8-b54f-4319-b60a-50b544fd0f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:36.456042 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-4f1b43a8-b54f-4319-b60a-50b544fd0f17 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:37:36.456288 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-4f1b43a8-b54f-4319-b60a-50b544fd0f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:36.523547 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1373/2761] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:37:36.532909 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd30836-264b-4ae2-a2b6-27e3fff833a1 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:36.533238 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd30836-264b-4ae2-a2b6-27e3fff833a1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:36.533556 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd30836-264b-4ae2-a2b6-27e3fff833a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:36.553207 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-cbd30836-264b-4ae2-a2b6-27e3fff833a1 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:37:36.554482 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cbd30836-264b-4ae2-a2b6-27e3fff833a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:36.562687 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1389/2762] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:37:36.567226 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b43a8-b54f-4319-b60a-50b544fd0f17 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:36.578909 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b43a8-b54f-4319-b60a-50b544fd0f17 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:36.583830 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f42ef6-6f6a-4b8c-9eed-b01fdc236cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:36.584495 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f42ef6-6f6a-4b8c-9eed-b01fdc236cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:36.584777 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f42ef6-6f6a-4b8c-9eed-b01fdc236cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:36.585077 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f42ef6-6f6a-4b8c-9eed-b01fdc236cb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:36.585895 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f42ef6-6f6a-4b8c-9eed-b01fdc236cb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:37:36.586301 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f42ef6-6f6a-4b8c-9eed-b01fdc236cb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:36.588509 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f42ef6-6f6a-4b8c-9eed-b01fdc236cb6 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:36.601289 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1374/2763] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:37:36.606159 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd30836-264b-4ae2-a2b6-27e3fff833a1 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:36.615881 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd30836-264b-4ae2-a2b6-27e3fff833a1 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:36.620700 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6058b0-35ac-4241-9d7c-fbe011966781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:36.621368 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6058b0-35ac-4241-9d7c-fbe011966781 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:36.621649 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6058b0-35ac-4241-9d7c-fbe011966781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:36.621929 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6058b0-35ac-4241-9d7c-fbe011966781 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:36.622654 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6058b0-35ac-4241-9d7c-fbe011966781 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:36.624797 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6058b0-35ac-4241-9d7c-fbe011966781 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:36.654923 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1390/2764] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:37:36 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:37:36.659276 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f42ef6-6f6a-4b8c-9eed-b01fdc236cb6 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:36.670391 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f42ef6-6f6a-4b8c-9eed-b01fdc236cb6 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:36.699670 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:37:36.735658 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f178fda-5a3c-475d-aaaf-dd6d5827c434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:36.736340 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f178fda-5a3c-475d-aaaf-dd6d5827c434 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:36.736624 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f178fda-5a3c-475d-aaaf-dd6d5827c434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:36.736904 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f178fda-5a3c-475d-aaaf-dd6d5827c434 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:36.737614 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f178fda-5a3c-475d-aaaf-dd6d5827c434 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:36.739585 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f178fda-5a3c-475d-aaaf-dd6d5827c434 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:36.766287 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1375/2765] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:37:36 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:37:36.770724 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6058b0-35ac-4241-9d7c-fbe011966781 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:36.782812 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6058b0-35ac-4241-9d7c-fbe011966781 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:36.787748 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535a461-d9c6-4b9c-a9f2-e7117817aff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:36.788264 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535a461-d9c6-4b9c-a9f2-e7117817aff5 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:36.788550 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535a461-d9c6-4b9c-a9f2-e7117817aff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:36.788836 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535a461-d9c6-4b9c-a9f2-e7117817aff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:36.789567 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9535a461-d9c6-4b9c-a9f2-e7117817aff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:36.791402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9535a461-d9c6-4b9c-a9f2-e7117817aff5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:36.802496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1391/2766] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:37:36.807458 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f178fda-5a3c-475d-aaaf-dd6d5827c434 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:36.818813 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f178fda-5a3c-475d-aaaf-dd6d5827c434 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:36.824753 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef600fc9-5d27-4ce6-80bd-8fedaad85d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:36.825459 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef600fc9-5d27-4ce6-80bd-8fedaad85d35 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:36.825740 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef600fc9-5d27-4ce6-80bd-8fedaad85d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:36.826334 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef600fc9-5d27-4ce6-80bd-8fedaad85d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:36.827069 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef600fc9-5d27-4ce6-80bd-8fedaad85d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:36.828690 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef600fc9-5d27-4ce6-80bd-8fedaad85d35 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:36.840593 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1376/2767] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:37:36.845286 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535a461-d9c6-4b9c-a9f2-e7117817aff5 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:36.858180 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535a461-d9c6-4b9c-a9f2-e7117817aff5 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:36.863192 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68b2bd-2da5-4012-9309-f648acaeaa6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:36.864109 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68b2bd-2da5-4012-9309-f648acaeaa6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:36.864390 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68b2bd-2da5-4012-9309-f648acaeaa6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:36.864666 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68b2bd-2da5-4012-9309-f648acaeaa6b admin admin] PATH_INFO: `/v3/projects/a91e6e8eb9a14ca392587cf4e3a16c08/users/3cde88e8425047d1b5c2bc26911db0ae/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:36.889257 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68b2bd-2da5-4012-9309-f648acaeaa6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a91e6e8eb9a14ca392587cf4e3a16c08, user_id=3cde88e8425047d1b5c2bc26911db0ae, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:36.891994 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68b2bd-2da5-4012-9309-f648acaeaa6b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:36.907970 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1392/2768] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:37:36 2022] PUT /identity/v3/projects/a91e6e8eb9a14ca392587cf4e3a16c08/users/3cde88e8425047d1b5c2bc26911db0ae/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:37:36.919958 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f501454-f472-42e7-b03d-99fa0ae22d50 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:36.920234 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f501454-f472-42e7-b03d-99fa0ae22d50 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:36.920541 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f501454-f472-42e7-b03d-99fa0ae22d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:36.950716 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-5f501454-f472-42e7-b03d-99fa0ae22d50 None None] MFA Rules not processed for user `3cde88e8425047d1b5c2bc26911db0ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:37:36.952198 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-5f501454-f472-42e7-b03d-99fa0ae22d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:37.033615 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1377/2769] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:37:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:37:37.038103 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68b2bd-2da5-4012-9309-f648acaeaa6b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:37.110480 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68b2bd-2da5-4012-9309-f648acaeaa6b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:37.115088 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870c9f1-d85d-4717-a314-5889c1c2330c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:37.115752 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870c9f1-d85d-4717-a314-5889c1c2330c admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:37.116039 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870c9f1-d85d-4717-a314-5889c1c2330c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:37.116317 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870c9f1-d85d-4717-a314-5889c1c2330c admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:37.117009 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870c9f1-d85d-4717-a314-5889c1c2330c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:37.119492 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870c9f1-d85d-4717-a314-5889c1c2330c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:37.149256 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1393/2770] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:37:37 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:37:37.154690 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f501454-f472-42e7-b03d-99fa0ae22d50 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:37.166404 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f501454-f472-42e7-b03d-99fa0ae22d50 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:37.229925 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee54f4-9f97-476e-9f3c-f31cee1b4b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:37.230717 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee54f4-9f97-476e-9f3c-f31cee1b4b8c admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:37.231002 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee54f4-9f97-476e-9f3c-f31cee1b4b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:37.231444 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee54f4-9f97-476e-9f3c-f31cee1b4b8c admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:37.232185 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cee54f4-9f97-476e-9f3c-f31cee1b4b8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:37.234246 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cee54f4-9f97-476e-9f3c-f31cee1b4b8c admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:37.256042 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1378/2771] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:37:37 2022] POST /identity/v3/users => generated 297 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:37:37.260736 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870c9f1-d85d-4717-a314-5889c1c2330c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:37.271636 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870c9f1-d85d-4717-a314-5889c1c2330c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:37.276547 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508adf2-f492-4ae0-9690-f58ea22608ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:37.277221 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508adf2-f492-4ae0-9690-f58ea22608ec admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:37.277511 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508adf2-f492-4ae0-9690-f58ea22608ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:37.277789 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508adf2-f492-4ae0-9690-f58ea22608ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:37.278557 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508adf2-f492-4ae0-9690-f58ea22608ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:37.280200 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508adf2-f492-4ae0-9690-f58ea22608ec admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:37.294350 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1394/2772] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:37:37.298603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee54f4-9f97-476e-9f3c-f31cee1b4b8c admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:37.309899 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee54f4-9f97-476e-9f3c-f31cee1b4b8c admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:37.315140 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518262f-16be-49c3-9b4e-de712b6eca42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:37.316081 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518262f-16be-49c3-9b4e-de712b6eca42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:37.316369 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518262f-16be-49c3-9b4e-de712b6eca42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:37.316898 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518262f-16be-49c3-9b4e-de712b6eca42 admin admin] PATH_INFO: `/v3/projects/0460477e065a41a19830aaf1df442f38/users/44c2cef5f82f42a4863daa8d712595de/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:37.334898 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518262f-16be-49c3-9b4e-de712b6eca42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0460477e065a41a19830aaf1df442f38, user_id=44c2cef5f82f42a4863daa8d712595de, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:37.337836 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518262f-16be-49c3-9b4e-de712b6eca42 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:37.352575 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1379/2773] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:37:37 2022] PUT /identity/v3/projects/0460477e065a41a19830aaf1df442f38/users/44c2cef5f82f42a4863daa8d712595de/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:37:37.357179 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508adf2-f492-4ae0-9690-f58ea22608ec admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:37.367543 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508adf2-f492-4ae0-9690-f58ea22608ec admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:37.390948 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:37:37.433502 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc2338-8634-45d2-b3ee-ccb64970c574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:37.434189 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc2338-8634-45d2-b3ee-ccb64970c574 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:37.434472 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc2338-8634-45d2-b3ee-ccb64970c574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:37.434747 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc2338-8634-45d2-b3ee-ccb64970c574 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:37.435481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc2338-8634-45d2-b3ee-ccb64970c574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:37.437099 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc2338-8634-45d2-b3ee-ccb64970c574 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:37.448946 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1395/2774] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:37:37.453403 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518262f-16be-49c3-9b4e-de712b6eca42 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:37.462261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:37:37.469571 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518262f-16be-49c3-9b4e-de712b6eca42 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:37.475834 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a957be01-5535-4010-af3e-b19a36952933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:37.476740 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957be01-5535-4010-af3e-b19a36952933 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:37.477029 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957be01-5535-4010-af3e-b19a36952933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:37.477312 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957be01-5535-4010-af3e-b19a36952933 admin admin] PATH_INFO: `/v3/projects/0460477e065a41a19830aaf1df442f38/users/44c2cef5f82f42a4863daa8d712595de/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:37.480969 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a957be01-5535-4010-af3e-b19a36952933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0460477e065a41a19830aaf1df442f38, user_id=44c2cef5f82f42a4863daa8d712595de, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:37.484128 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a957be01-5535-4010-af3e-b19a36952933 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:37.496559 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1380/2775] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:37:37 2022] PUT /identity/v3/projects/0460477e065a41a19830aaf1df442f38/users/44c2cef5f82f42a4863daa8d712595de/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:37:37.508973 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf0ca3-60ee-4dea-bc5e-77b773aacd0f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:37.509267 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf0ca3-60ee-4dea-bc5e-77b773aacd0f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:37.509563 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf0ca3-60ee-4dea-bc5e-77b773aacd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:37.542131 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-1caf0ca3-60ee-4dea-bc5e-77b773aacd0f None None] MFA Rules not processed for user `44c2cef5f82f42a4863daa8d712595de`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:37:37.543473 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1caf0ca3-60ee-4dea-bc5e-77b773aacd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:37.631160 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1396/2776] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:37:37 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:37:37.644633 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a957be01-5535-4010-af3e-b19a36952933 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:37.646438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a957be01-5535-4010-af3e-b19a36952933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:37.718356 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a957be01-5535-4010-af3e-b19a36952933 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:37.722241 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2128590d-8bc8-4460-aa06-c2aa138b9ff5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:37.723031 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128590d-8bc8-4460-aa06-c2aa138b9ff5 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:37.723320 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128590d-8bc8-4460-aa06-c2aa138b9ff5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:37.723600 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128590d-8bc8-4460-aa06-c2aa138b9ff5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:37.735459 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2128590d-8bc8-4460-aa06-c2aa138b9ff5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:37.737532 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2128590d-8bc8-4460-aa06-c2aa138b9ff5 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:37.749528 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1381/2777] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:37:37 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:37:38.139861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf0ca3-60ee-4dea-bc5e-77b773aacd0f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:38.149487 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf0ca3-60ee-4dea-bc5e-77b773aacd0f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:38.155390 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9aab46-93b8-4a7d-96e3-c8c22d998022 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44c2cef5f82f42a4863daa8d712595de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0460477e065a41a19830aaf1df442f38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:38.156172 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9aab46-93b8-4a7d-96e3-c8c22d998022 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:38.156467 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9aab46-93b8-4a7d-96e3-c8c22d998022 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:38.156753 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9aab46-93b8-4a7d-96e3-c8c22d998022 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:38.157505 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9aab46-93b8-4a7d-96e3-c8c22d998022 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:37:38.158327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9aab46-93b8-4a7d-96e3-c8c22d998022 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:38.159499 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9aab46-93b8-4a7d-96e3-c8c22d998022 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:38.173669 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1397/2778] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:37:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:37:38.178075 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2128590d-8bc8-4460-aa06-c2aa138b9ff5 service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:38.187328 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2128590d-8bc8-4460-aa06-c2aa138b9ff5 service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:38.191963 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a30338-0aff-40d3-a346-433fa9b30027 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44c2cef5f82f42a4863daa8d712595de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0460477e065a41a19830aaf1df442f38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:38.192613 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a30338-0aff-40d3-a346-433fa9b30027 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:38.192896 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a30338-0aff-40d3-a346-433fa9b30027 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:38.193177 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a30338-0aff-40d3-a346-433fa9b30027 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:38.193866 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a30338-0aff-40d3-a346-433fa9b30027 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:38.195787 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a30338-0aff-40d3-a346-433fa9b30027 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:38.223957 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1382/2779] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:37:38 2022] POST /identity/v3/projects => generated 354 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:37:38.228612 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9aab46-93b8-4a7d-96e3-c8c22d998022 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:38.239834 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9aab46-93b8-4a7d-96e3-c8c22d998022 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:38.309736 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f3e0d-6a75-4748-95a4-9dd2cc61adc7 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44c2cef5f82f42a4863daa8d712595de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0460477e065a41a19830aaf1df442f38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:38.310509 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f3e0d-6a75-4748-95a4-9dd2cc61adc7 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:38.310733 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f3e0d-6a75-4748-95a4-9dd2cc61adc7 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:38.311054 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f3e0d-6a75-4748-95a4-9dd2cc61adc7 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:38.311799 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f3e0d-6a75-4748-95a4-9dd2cc61adc7 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:37:38.312117 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f3e0d-6a75-4748-95a4-9dd2cc61adc7 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:38.313809 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f3e0d-6a75-4748-95a4-9dd2cc61adc7 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:38.327012 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1398/2780] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:37:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:37:38.364320 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a30338-0aff-40d3-a346-433fa9b30027 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:38.375570 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a30338-0aff-40d3-a346-433fa9b30027 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:38.380287 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002faeb-a03e-4d65-9928-311d1ff699d8 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44c2cef5f82f42a4863daa8d712595de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0460477e065a41a19830aaf1df442f38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:38.381159 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002faeb-a03e-4d65-9928-311d1ff699d8 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:38.381446 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002faeb-a03e-4d65-9928-311d1ff699d8 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:38.381743 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002faeb-a03e-4d65-9928-311d1ff699d8 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] PATH_INFO: `/v3/projects/ec3a0107bb7047ca816fc0bb26e0578a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:38.382975 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7002faeb-a03e-4d65-9928-311d1ff699d8 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ec3a0107bb7047ca816fc0bb26e0578a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:38.385546 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7002faeb-a03e-4d65-9928-311d1ff699d8 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:38.437001 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7002faeb-a03e-4d65-9928-311d1ff699d8 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec3a0107bb7047ca816fc0bb26e0578a', 'request_id': 'req-7002faeb-a03e-4d65-9928-311d1ff699d8'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:38.444909 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7002faeb-a03e-4d65-9928-311d1ff699d8 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec3a0107bb7047ca816fc0bb26e0578a', 'request_id': 'req-7002faeb-a03e-4d65-9928-311d1ff699d8'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:38.452072 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7002faeb-a03e-4d65-9928-311d1ff699d8 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec3a0107bb7047ca816fc0bb26e0578a', 'request_id': 'req-7002faeb-a03e-4d65-9928-311d1ff699d8'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:38.463766 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7002faeb-a03e-4d65-9928-311d1ff699d8 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] The token cache is being invalidate because project ec3a0107bb7047ca816fc0bb26e0578a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:37:38.464389 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7002faeb-a03e-4d65-9928-311d1ff699d8 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:38.464778 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7002faeb-a03e-4d65-9928-311d1ff699d8 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:38.466486 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1383/2781] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:37:38 2022] DELETE /identity/v3/projects/ec3a0107bb7047ca816fc0bb26e0578a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:37:38.663941 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f3e0d-6a75-4748-95a4-9dd2cc61adc7 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:38.665726 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-732f3e0d-6a75-4748-95a4-9dd2cc61adc7 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:38.699607 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:37:38.735667 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f3e0d-6a75-4748-95a4-9dd2cc61adc7 tempest-VolumeQuotaClassesTest-1168828258 tempest-VolumeQuotaClassesTest-1168828258-project-admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:38.796434 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9070d59-0bfe-48a1-81b3-ef8f40e4e9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:38.797315 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9070d59-0bfe-48a1-81b3-ef8f40e4e9c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:38.797596 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9070d59-0bfe-48a1-81b3-ef8f40e4e9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:38.797869 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9070d59-0bfe-48a1-81b3-ef8f40e4e9c1 admin admin] PATH_INFO: `/v3/users/3cde88e8425047d1b5c2bc26911db0ae` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:38.799216 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9070d59-0bfe-48a1-81b3-ef8f40e4e9c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cde88e8425047d1b5c2bc26911db0ae)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:38.801156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9070d59-0bfe-48a1-81b3-ef8f40e4e9c1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:38.849587 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b9070d59-0bfe-48a1-81b3-ef8f40e4e9c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cde88e8425047d1b5c2bc26911db0ae'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:38.850280 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b9070d59-0bfe-48a1-81b3-ef8f40e4e9c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cde88e8425047d1b5c2bc26911db0ae'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:38.863123 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b9070d59-0bfe-48a1-81b3-ef8f40e4e9c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cde88e8425047d1b5c2bc26911db0ae'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:38.871390 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b9070d59-0bfe-48a1-81b3-ef8f40e4e9c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cde88e8425047d1b5c2bc26911db0ae'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:38.872140 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b9070d59-0bfe-48a1-81b3-ef8f40e4e9c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cde88e8425047d1b5c2bc26911db0ae'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:38.885196 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1399/2782] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:37:38 2022] DELETE /identity/v3/users/3cde88e8425047d1b5c2bc26911db0ae => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:37:38.889943 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec064af-50f9-4b1f-acfe-018b7300f9d1 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:38.890243 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec064af-50f9-4b1f-acfe-018b7300f9d1 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:38.890521 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec064af-50f9-4b1f-acfe-018b7300f9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:38.907755 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-3ec064af-50f9-4b1f-acfe-018b7300f9d1 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:37:38.908970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3ec064af-50f9-4b1f-acfe-018b7300f9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:38.957963 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:37:38.971761 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1384/2783] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:37:38.981875 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9070d59-0bfe-48a1-81b3-ef8f40e4e9c1 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:38.983304 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b9070d59-0bfe-48a1-81b3-ef8f40e4e9c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:39.046419 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9070d59-0bfe-48a1-81b3-ef8f40e4e9c1 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:39.050353 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617b080-cf2e-47c3-8e20-0cd2a49a1c5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:39.051012 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617b080-cf2e-47c3-8e20-0cd2a49a1c5f service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:39.051290 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617b080-cf2e-47c3-8e20-0cd2a49a1c5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:39.051566 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617b080-cf2e-47c3-8e20-0cd2a49a1c5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:39.059469 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:37:39.062425 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617b080-cf2e-47c3-8e20-0cd2a49a1c5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:39.064366 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617b080-cf2e-47c3-8e20-0cd2a49a1c5f service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:39.076439 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1400/2784] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:37:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:37:39.400183 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec064af-50f9-4b1f-acfe-018b7300f9d1 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:39.401742 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3ec064af-50f9-4b1f-acfe-018b7300f9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:39.414198 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec064af-50f9-4b1f-acfe-018b7300f9d1 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:39.424575 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648949b-798c-4f4d-ba08-291926c808dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:39.424862 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648949b-798c-4f4d-ba08-291926c808dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:39.425213 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648949b-798c-4f4d-ba08-291926c808dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:39.425556 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648949b-798c-4f4d-ba08-291926c808dd admin admin] PATH_INFO: `/v3/projects/a91e6e8eb9a14ca392587cf4e3a16c08` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:39.426894 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648949b-798c-4f4d-ba08-291926c808dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a91e6e8eb9a14ca392587cf4e3a16c08)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:39.428793 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648949b-798c-4f4d-ba08-291926c808dd admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:39.482690 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-6648949b-798c-4f4d-ba08-291926c808dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a91e6e8eb9a14ca392587cf4e3a16c08', 'request_id': 'req-6648949b-798c-4f4d-ba08-291926c808dd'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:39.491864 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-6648949b-798c-4f4d-ba08-291926c808dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a91e6e8eb9a14ca392587cf4e3a16c08', 'request_id': 'req-6648949b-798c-4f4d-ba08-291926c808dd'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:39.497903 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-6648949b-798c-4f4d-ba08-291926c808dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a91e6e8eb9a14ca392587cf4e3a16c08', 'request_id': 'req-6648949b-798c-4f4d-ba08-291926c808dd'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:39.509759 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-6648949b-798c-4f4d-ba08-291926c808dd admin admin] The token cache is being invalidate because project a91e6e8eb9a14ca392587cf4e3a16c08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:37:39.510067 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-6648949b-798c-4f4d-ba08-291926c808dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:39.510747 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-6648949b-798c-4f4d-ba08-291926c808dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:39.512318 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1385/2785] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:37:39 2022] DELETE /identity/v3/projects/a91e6e8eb9a14ca392587cf4e3a16c08 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:37:39.516781 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617b080-cf2e-47c3-8e20-0cd2a49a1c5f service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:39.527521 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617b080-cf2e-47c3-8e20-0cd2a49a1c5f service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:39.585368 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16bde5-06c4-443b-a1eb-1990b6094307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:39.586277 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16bde5-06c4-443b-a1eb-1990b6094307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:39.586563 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16bde5-06c4-443b-a1eb-1990b6094307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:39.586842 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16bde5-06c4-443b-a1eb-1990b6094307 admin admin] PATH_INFO: `/v3/users/44c2cef5f82f42a4863daa8d712595de` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:39.588646 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16bde5-06c4-443b-a1eb-1990b6094307 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44c2cef5f82f42a4863daa8d712595de)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:39.590633 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16bde5-06c4-443b-a1eb-1990b6094307 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:39.638362 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1a16bde5-06c4-443b-a1eb-1990b6094307 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44c2cef5f82f42a4863daa8d712595de'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:39.639050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1a16bde5-06c4-443b-a1eb-1990b6094307 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44c2cef5f82f42a4863daa8d712595de'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:39.653692 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1a16bde5-06c4-443b-a1eb-1990b6094307 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44c2cef5f82f42a4863daa8d712595de'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:39.661493 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1a16bde5-06c4-443b-a1eb-1990b6094307 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44c2cef5f82f42a4863daa8d712595de'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:39.662334 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1a16bde5-06c4-443b-a1eb-1990b6094307 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44c2cef5f82f42a4863daa8d712595de'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:39.676520 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1401/2786] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:37:39 2022] DELETE /identity/v3/users/44c2cef5f82f42a4863daa8d712595de => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:37:39.975962 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648949b-798c-4f4d-ba08-291926c808dd admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:39.977545 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6648949b-798c-4f4d-ba08-291926c808dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:39.994739 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648949b-798c-4f4d-ba08-291926c808dd admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:40.062253 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0b4f7-7447-49dc-9307-8e5392d82b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:40.063034 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0b4f7-7447-49dc-9307-8e5392d82b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:40.063318 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0b4f7-7447-49dc-9307-8e5392d82b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:40.064258 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0b4f7-7447-49dc-9307-8e5392d82b4e admin admin] PATH_INFO: `/v3/projects/0460477e065a41a19830aaf1df442f38` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:40.065882 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea0b4f7-7447-49dc-9307-8e5392d82b4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0460477e065a41a19830aaf1df442f38)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:40.067866 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea0b4f7-7447-49dc-9307-8e5392d82b4e admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:40.115533 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-eea0b4f7-7447-49dc-9307-8e5392d82b4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0460477e065a41a19830aaf1df442f38', 'request_id': 'req-eea0b4f7-7447-49dc-9307-8e5392d82b4e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:40.123044 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-eea0b4f7-7447-49dc-9307-8e5392d82b4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0460477e065a41a19830aaf1df442f38', 'request_id': 'req-eea0b4f7-7447-49dc-9307-8e5392d82b4e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:40.128713 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-eea0b4f7-7447-49dc-9307-8e5392d82b4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0460477e065a41a19830aaf1df442f38', 'request_id': 'req-eea0b4f7-7447-49dc-9307-8e5392d82b4e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:40.142022 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-eea0b4f7-7447-49dc-9307-8e5392d82b4e admin admin] The token cache is being invalidate because project 0460477e065a41a19830aaf1df442f38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:37:40.142307 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-eea0b4f7-7447-49dc-9307-8e5392d82b4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:40.142972 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-eea0b4f7-7447-49dc-9307-8e5392d82b4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:40.144511 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1386/2787] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:37:39 2022] DELETE /identity/v3/projects/0460477e065a41a19830aaf1df442f38 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:37:40.154994 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef57043-349e-4a72-b597-69448123ba8d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:40.155284 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef57043-349e-4a72-b597-69448123ba8d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:40.155568 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef57043-349e-4a72-b597-69448123ba8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:40.184140 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-eef57043-349e-4a72-b597-69448123ba8d None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:37:40.186295 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-eef57043-349e-4a72-b597-69448123ba8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:40.257731 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1402/2788] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:37:40.266507 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebdfab-83e9-458f-97d2-57918f54fc1f None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:40.266804 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebdfab-83e9-458f-97d2-57918f54fc1f None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:40.267093 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebdfab-83e9-458f-97d2-57918f54fc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:40.279939 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:37:40.286981 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-12ebdfab-83e9-458f-97d2-57918f54fc1f None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:37:40.289321 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-12ebdfab-83e9-458f-97d2-57918f54fc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:40.298267 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1387/2789] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:37:40.302747 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef57043-349e-4a72-b597-69448123ba8d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:40.314011 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef57043-349e-4a72-b597-69448123ba8d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:40.319251 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd4f55-f67a-41c3-bf73-755abcbf4504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:40.319894 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd4f55-f67a-41c3-bf73-755abcbf4504 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:40.320171 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd4f55-f67a-41c3-bf73-755abcbf4504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:40.320474 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd4f55-f67a-41c3-bf73-755abcbf4504 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:40.321188 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd4f55-f67a-41c3-bf73-755abcbf4504 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:37:40.321493 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd4f55-f67a-41c3-bf73-755abcbf4504 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:40.323159 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd4f55-f67a-41c3-bf73-755abcbf4504 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:40.335926 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1403/2790] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:37:40.341204 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ebdfab-83e9-458f-97d2-57918f54fc1f None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:40.350731 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ebdfab-83e9-458f-97d2-57918f54fc1f None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:40.355832 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32a65c-c221-40b0-8c33-2b6efcccbcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:40.356486 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32a65c-c221-40b0-8c33-2b6efcccbcc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:40.356762 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32a65c-c221-40b0-8c33-2b6efcccbcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:40.357037 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32a65c-c221-40b0-8c33-2b6efcccbcc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:40.357738 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32a65c-c221-40b0-8c33-2b6efcccbcc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:40.359677 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32a65c-c221-40b0-8c33-2b6efcccbcc6 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:40.387955 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1388/2791] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:37:40 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:37:40.392120 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd4f55-f67a-41c3-bf73-755abcbf4504 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:40.397258 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:37:40.404071 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd4f55-f67a-41c3-bf73-755abcbf4504 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:40.464983 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2922a-a6a3-4158-9fa2-7746e6fceb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:40.465663 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2922a-a6a3-4158-9fa2-7746e6fceb8e admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:40.466051 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2922a-a6a3-4158-9fa2-7746e6fceb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:40.466341 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2922a-a6a3-4158-9fa2-7746e6fceb8e admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:40.467133 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2922a-a6a3-4158-9fa2-7746e6fceb8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:40.469080 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2922a-a6a3-4158-9fa2-7746e6fceb8e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:40.492644 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1404/2792] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:37:40 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:37:40.499129 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32a65c-c221-40b0-8c33-2b6efcccbcc6 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:40.510373 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32a65c-c221-40b0-8c33-2b6efcccbcc6 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:40.515387 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f979c80b-67d9-41f4-a965-0bf8ea09ff67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:40.516084 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979c80b-67d9-41f4-a965-0bf8ea09ff67 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:40.516370 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979c80b-67d9-41f4-a965-0bf8ea09ff67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:40.516649 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979c80b-67d9-41f4-a965-0bf8ea09ff67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:40.517409 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f979c80b-67d9-41f4-a965-0bf8ea09ff67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:40.519113 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f979c80b-67d9-41f4-a965-0bf8ea09ff67 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:40.531000 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1389/2793] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:37:40.535845 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2922a-a6a3-4158-9fa2-7746e6fceb8e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:40.550126 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2922a-a6a3-4158-9fa2-7746e6fceb8e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:40.554913 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491a48e-ef7d-43eb-9917-09e3ca4384d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:40.555593 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491a48e-ef7d-43eb-9917-09e3ca4384d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:40.556520 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491a48e-ef7d-43eb-9917-09e3ca4384d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:40.556799 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491a48e-ef7d-43eb-9917-09e3ca4384d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:40.557545 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491a48e-ef7d-43eb-9917-09e3ca4384d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:40.559341 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491a48e-ef7d-43eb-9917-09e3ca4384d9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:40.570290 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1405/2794] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:37:40.574736 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f979c80b-67d9-41f4-a965-0bf8ea09ff67 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:40.585293 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f979c80b-67d9-41f4-a965-0bf8ea09ff67 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:40.590187 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668691d-e150-45ba-bebc-298b21a1338e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:40.591077 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668691d-e150-45ba-bebc-298b21a1338e admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:40.591394 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668691d-e150-45ba-bebc-298b21a1338e admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:40.591675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668691d-e150-45ba-bebc-298b21a1338e admin admin] PATH_INFO: `/v3/projects/a86e4de0f4fd4974bd9e541f4bdc7746/users/40608106f3754cf682ee8f7404c8e0ab/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:40.608429 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e668691d-e150-45ba-bebc-298b21a1338e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a86e4de0f4fd4974bd9e541f4bdc7746, user_id=40608106f3754cf682ee8f7404c8e0ab, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:40.611124 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e668691d-e150-45ba-bebc-298b21a1338e admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:40.625816 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1390/2795] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:37:40 2022] PUT /identity/v3/projects/a86e4de0f4fd4974bd9e541f4bdc7746/users/40608106f3754cf682ee8f7404c8e0ab/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:37:40.690426 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d0679-0577-4372-be5a-c01ed813e86c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:40.690795 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d0679-0577-4372-be5a-c01ed813e86c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:40.691087 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d0679-0577-4372-be5a-c01ed813e86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:40.719022 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-bd9d0679-0577-4372-be5a-c01ed813e86c None None] MFA Rules not processed for user `40608106f3754cf682ee8f7404c8e0ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:37:40.720250 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-bd9d0679-0577-4372-be5a-c01ed813e86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:40.786851 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1406/2796] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:37:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:37:40.791932 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668691d-e150-45ba-bebc-298b21a1338e admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:40.856726 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668691d-e150-45ba-bebc-298b21a1338e admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:40.861676 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2e3d1-7e80-4b5a-be14-c912e6d6531a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:40.862389 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2e3d1-7e80-4b5a-be14-c912e6d6531a admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:40.862681 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2e3d1-7e80-4b5a-be14-c912e6d6531a admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:40.862961 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2e3d1-7e80-4b5a-be14-c912e6d6531a admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:40.863681 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2e3d1-7e80-4b5a-be14-c912e6d6531a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:40.865887 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2e3d1-7e80-4b5a-be14-c912e6d6531a admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:40.894600 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1391/2797] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:37:40 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:37:40.898947 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d0679-0577-4372-be5a-c01ed813e86c None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:40.916490 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d0679-0577-4372-be5a-c01ed813e86c None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:40.982591 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f99b6-1dc9-4c01-8b51-24dfc8dd5901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:40.983430 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f99b6-1dc9-4c01-8b51-24dfc8dd5901 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:40.983837 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f99b6-1dc9-4c01-8b51-24dfc8dd5901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:40.984292 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f99b6-1dc9-4c01-8b51-24dfc8dd5901 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:40.985198 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f99b6-1dc9-4c01-8b51-24dfc8dd5901 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:40.987330 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f99b6-1dc9-4c01-8b51-24dfc8dd5901 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:41.015779 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:37:41.022701 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1407/2798] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:37:40 2022] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:37:41.026431 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2e3d1-7e80-4b5a-be14-c912e6d6531a admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:41.036999 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2e3d1-7e80-4b5a-be14-c912e6d6531a admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:41.042485 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7df067-0b71-4020-bce1-dd4db2c93f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:41.043156 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7df067-0b71-4020-bce1-dd4db2c93f4f admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:41.043436 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7df067-0b71-4020-bce1-dd4db2c93f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:41.043712 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7df067-0b71-4020-bce1-dd4db2c93f4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:41.044445 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7df067-0b71-4020-bce1-dd4db2c93f4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:41.046081 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7df067-0b71-4020-bce1-dd4db2c93f4f admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:41.059186 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1392/2799] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:37:41.063639 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f99b6-1dc9-4c01-8b51-24dfc8dd5901 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:41.074005 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f99b6-1dc9-4c01-8b51-24dfc8dd5901 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:41.079091 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d4c0c-a078-4caf-983d-7883e6908254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:41.079773 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d4c0c-a078-4caf-983d-7883e6908254 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:41.080075 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d4c0c-a078-4caf-983d-7883e6908254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:41.080347 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d4c0c-a078-4caf-983d-7883e6908254 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:41.081084 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d4c0c-a078-4caf-983d-7883e6908254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:41.082739 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d4c0c-a078-4caf-983d-7883e6908254 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:41.093472 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1408/2800] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:37:41.099784 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7df067-0b71-4020-bce1-dd4db2c93f4f admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:41.117907 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7df067-0b71-4020-bce1-dd4db2c93f4f admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:41.126608 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a0bb4-09c4-4d92-97de-d4837f31f7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:41.127817 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a0bb4-09c4-4d92-97de-d4837f31f7c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:41.128548 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a0bb4-09c4-4d92-97de-d4837f31f7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:41.128862 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a0bb4-09c4-4d92-97de-d4837f31f7c1 admin admin] PATH_INFO: `/v3/projects/d0252943fb2d467ab46ca3773bb53fe5/users/ff0fea8569da4aa28c4662242824ff6e/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:41.154881 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a0bb4-09c4-4d92-97de-d4837f31f7c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0252943fb2d467ab46ca3773bb53fe5, user_id=ff0fea8569da4aa28c4662242824ff6e, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:41.158484 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a0bb4-09c4-4d92-97de-d4837f31f7c1 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:41.177160 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1393/2801] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:37:41 2022] PUT /identity/v3/projects/d0252943fb2d467ab46ca3773bb53fe5/users/ff0fea8569da4aa28c4662242824ff6e/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:37:41.188868 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97c3e6-1dba-45e7-8872-86797dd90faf None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:41.189166 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97c3e6-1dba-45e7-8872-86797dd90faf None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:41.189452 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97c3e6-1dba-45e7-8872-86797dd90faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:41.216651 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-ac97c3e6-1dba-45e7-8872-86797dd90faf None None] MFA Rules not processed for user `ff0fea8569da4aa28c4662242824ff6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:37:41.217864 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ac97c3e6-1dba-45e7-8872-86797dd90faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:41.286337 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1409/2802] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:37:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:37:41.291331 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a0bb4-09c4-4d92-97de-d4837f31f7c1 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:41.343362 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:37:41.357537 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a0bb4-09c4-4d92-97de-d4837f31f7c1 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:41.362548 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc230031-4d94-47f8-8a50-8d35526559bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:41.363221 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc230031-4d94-47f8-8a50-8d35526559bd admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:41.363508 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc230031-4d94-47f8-8a50-8d35526559bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:41.363790 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc230031-4d94-47f8-8a50-8d35526559bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:41.364492 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc230031-4d94-47f8-8a50-8d35526559bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:41.366437 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc230031-4d94-47f8-8a50-8d35526559bd admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:41.398641 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1394/2803] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:37:41 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:37:41.403630 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97c3e6-1dba-45e7-8872-86797dd90faf None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:41.415163 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97c3e6-1dba-45e7-8872-86797dd90faf None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:41.490344 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae45cf-7476-48c9-b3ff-fbfcf9302e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:41.491052 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae45cf-7476-48c9-b3ff-fbfcf9302e73 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:41.491340 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae45cf-7476-48c9-b3ff-fbfcf9302e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:41.491616 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae45cf-7476-48c9-b3ff-fbfcf9302e73 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:41.492321 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae45cf-7476-48c9-b3ff-fbfcf9302e73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:41.494308 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae45cf-7476-48c9-b3ff-fbfcf9302e73 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:41.514771 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1410/2804] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:37:41 2022] POST /identity/v3/users => generated 296 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:37:41.519201 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc230031-4d94-47f8-8a50-8d35526559bd admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:41.531608 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc230031-4d94-47f8-8a50-8d35526559bd admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:41.536421 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafda82-52dc-44be-b0dc-c147cfe527ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:41.537109 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafda82-52dc-44be-b0dc-c147cfe527ee admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:41.537396 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafda82-52dc-44be-b0dc-c147cfe527ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:41.537682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafda82-52dc-44be-b0dc-c147cfe527ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:41.538463 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafda82-52dc-44be-b0dc-c147cfe527ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:41.540080 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafda82-52dc-44be-b0dc-c147cfe527ee admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:41.553728 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1395/2805] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:37:41.558184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae45cf-7476-48c9-b3ff-fbfcf9302e73 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:41.568988 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae45cf-7476-48c9-b3ff-fbfcf9302e73 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:41.574147 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667670d-839a-4a8d-8753-db847aeb9ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:41.575046 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667670d-839a-4a8d-8753-db847aeb9ca6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:41.575330 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667670d-839a-4a8d-8753-db847aeb9ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:41.575607 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667670d-839a-4a8d-8753-db847aeb9ca6 admin admin] PATH_INFO: `/v3/projects/5f264cb3ac6c44f8bbd0392b02244b35/users/2934b6af0276446095d028e74e2ff070/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:41.593703 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6667670d-839a-4a8d-8753-db847aeb9ca6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f264cb3ac6c44f8bbd0392b02244b35, user_id=2934b6af0276446095d028e74e2ff070, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:41.596470 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6667670d-839a-4a8d-8753-db847aeb9ca6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:41.611051 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1411/2806] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:37:41 2022] PUT /identity/v3/projects/5f264cb3ac6c44f8bbd0392b02244b35/users/2934b6af0276446095d028e74e2ff070/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:37:41.615104 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafda82-52dc-44be-b0dc-c147cfe527ee admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:41.625139 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafda82-52dc-44be-b0dc-c147cfe527ee admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:41.685084 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea22ee-87da-49af-9239-fe57c29d67ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:41.685698 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea22ee-87da-49af-9239-fe57c29d67ab admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:41.685999 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea22ee-87da-49af-9239-fe57c29d67ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:41.686284 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea22ee-87da-49af-9239-fe57c29d67ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:41.687014 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea22ee-87da-49af-9239-fe57c29d67ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:41.688646 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea22ee-87da-49af-9239-fe57c29d67ab admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:41.700682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1396/2807] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:37:41.705072 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667670d-839a-4a8d-8753-db847aeb9ca6 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:41.716258 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667670d-839a-4a8d-8753-db847aeb9ca6 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:41.720976 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6570745-94c3-44b9-a902-5d20845a1d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:41.721862 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6570745-94c3-44b9-a902-5d20845a1d04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:41.722190 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6570745-94c3-44b9-a902-5d20845a1d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:41.722474 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6570745-94c3-44b9-a902-5d20845a1d04 admin admin] PATH_INFO: `/v3/projects/5f264cb3ac6c44f8bbd0392b02244b35/users/2934b6af0276446095d028e74e2ff070/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:41.724486 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6570745-94c3-44b9-a902-5d20845a1d04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f264cb3ac6c44f8bbd0392b02244b35, user_id=2934b6af0276446095d028e74e2ff070, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:41.727168 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6570745-94c3-44b9-a902-5d20845a1d04 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:41.738496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1412/2808] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:37:41 2022] PUT /identity/v3/projects/5f264cb3ac6c44f8bbd0392b02244b35/users/2934b6af0276446095d028e74e2ff070/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:37:41.749453 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523e277-21e9-4d1c-ab12-31097f517702 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:41.750187 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523e277-21e9-4d1c-ab12-31097f517702 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:41.750623 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523e277-21e9-4d1c-ab12-31097f517702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:41.779411 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-c523e277-21e9-4d1c-ab12-31097f517702 None None] MFA Rules not processed for user `2934b6af0276446095d028e74e2ff070`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:37:41.780618 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c523e277-21e9-4d1c-ab12-31097f517702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:41.850920 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1397/2809] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:37:41 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:37:41.863484 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6570745-94c3-44b9-a902-5d20845a1d04 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:41.865163 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c6570745-94c3-44b9-a902-5d20845a1d04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:41.900860 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:37:41.926240 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6570745-94c3-44b9-a902-5d20845a1d04 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:41.930276 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48f4cd-6b46-4057-bfad-6ed572df9dae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:41.930996 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48f4cd-6b46-4057-bfad-6ed572df9dae service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:41.931282 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48f4cd-6b46-4057-bfad-6ed572df9dae service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:41.931568 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48f4cd-6b46-4057-bfad-6ed572df9dae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:41.941108 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48f4cd-6b46-4057-bfad-6ed572df9dae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:41.942519 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48f4cd-6b46-4057-bfad-6ed572df9dae service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:41.953664 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1413/2810] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:37:41 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:37:41.996110 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523e277-21e9-4d1c-ab12-31097f517702 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:41.997484 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c523e277-21e9-4d1c-ab12-31097f517702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:42.010187 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523e277-21e9-4d1c-ab12-31097f517702 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:42.013790 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58633f5-099e-4ad9-a340-6244b996ae3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:42.014463 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58633f5-099e-4ad9-a340-6244b996ae3f service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:42.014748 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58633f5-099e-4ad9-a340-6244b996ae3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:42.015030 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58633f5-099e-4ad9-a340-6244b996ae3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:42.062495 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:37:42.077363 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58633f5-099e-4ad9-a340-6244b996ae3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:42.078851 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58633f5-099e-4ad9-a340-6244b996ae3f service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:42.088792 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1398/2811] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:37:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:37:45.000771 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48f4cd-6b46-4057-bfad-6ed572df9dae service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:45.082923 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48f4cd-6b46-4057-bfad-6ed572df9dae service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:45.087858 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75ca99-6e44-4a41-9c9f-6bef0952e698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:45.088753 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75ca99-6e44-4a41-9c9f-6bef0952e698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:45.089035 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75ca99-6e44-4a41-9c9f-6bef0952e698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:45.089310 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75ca99-6e44-4a41-9c9f-6bef0952e698 admin admin] PATH_INFO: `/v3/users/40608106f3754cf682ee8f7404c8e0ab` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:45.090645 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75ca99-6e44-4a41-9c9f-6bef0952e698 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40608106f3754cf682ee8f7404c8e0ab)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:45.092627 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75ca99-6e44-4a41-9c9f-6bef0952e698 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:45.157327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8c75ca99-6e44-4a41-9c9f-6bef0952e698 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40608106f3754cf682ee8f7404c8e0ab'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:45.158847 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8c75ca99-6e44-4a41-9c9f-6bef0952e698 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40608106f3754cf682ee8f7404c8e0ab'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:45.180476 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8c75ca99-6e44-4a41-9c9f-6bef0952e698 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40608106f3754cf682ee8f7404c8e0ab'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:45.189814 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8c75ca99-6e44-4a41-9c9f-6bef0952e698 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40608106f3754cf682ee8f7404c8e0ab'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:45.190471 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8c75ca99-6e44-4a41-9c9f-6bef0952e698 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40608106f3754cf682ee8f7404c8e0ab'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:45.204335 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1414/2812] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:37:44 2022] DELETE /identity/v3/users/40608106f3754cf682ee8f7404c8e0ab => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:37:45.209160 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc6c45-cfca-4288-adac-646f99d2ec4c None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:45.210045 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc6c45-cfca-4288-adac-646f99d2ec4c None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:45.210045 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc6c45-cfca-4288-adac-646f99d2ec4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:45.239054 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-8adc6c45-cfca-4288-adac-646f99d2ec4c None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:37:45.241169 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-8adc6c45-cfca-4288-adac-646f99d2ec4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:45.331081 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1399/2813] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:37:45.341430 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75ca99-6e44-4a41-9c9f-6bef0952e698 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:45.342901 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8c75ca99-6e44-4a41-9c9f-6bef0952e698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:45.406511 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75ca99-6e44-4a41-9c9f-6bef0952e698 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:45.412173 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2945b0-1b48-45f7-9725-e1256b656b62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:45.413193 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2945b0-1b48-45f7-9725-e1256b656b62 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:45.413674 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2945b0-1b48-45f7-9725-e1256b656b62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:45.414197 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2945b0-1b48-45f7-9725-e1256b656b62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:45.424302 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:37:45.427050 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2945b0-1b48-45f7-9725-e1256b656b62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:45.428930 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2945b0-1b48-45f7-9725-e1256b656b62 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:45.443877 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1415/2814] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:37:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:37:45.768469 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc6c45-cfca-4288-adac-646f99d2ec4c None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:45.770157 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-8adc6c45-cfca-4288-adac-646f99d2ec4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:45.782540 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc6c45-cfca-4288-adac-646f99d2ec4c None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:45.787394 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628ecd9-6858-40d8-bd91-efe014700f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:45.788294 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628ecd9-6858-40d8-bd91-efe014700f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:45.788572 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628ecd9-6858-40d8-bd91-efe014700f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:45.788845 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628ecd9-6858-40d8-bd91-efe014700f81 admin admin] PATH_INFO: `/v3/projects/a86e4de0f4fd4974bd9e541f4bdc7746` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:45.790085 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7628ecd9-6858-40d8-bd91-efe014700f81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a86e4de0f4fd4974bd9e541f4bdc7746)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:45.792522 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7628ecd9-6858-40d8-bd91-efe014700f81 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:45.838785 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7628ecd9-6858-40d8-bd91-efe014700f81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a86e4de0f4fd4974bd9e541f4bdc7746', 'request_id': 'req-7628ecd9-6858-40d8-bd91-efe014700f81'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:45.846297 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7628ecd9-6858-40d8-bd91-efe014700f81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a86e4de0f4fd4974bd9e541f4bdc7746', 'request_id': 'req-7628ecd9-6858-40d8-bd91-efe014700f81'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:45.851937 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7628ecd9-6858-40d8-bd91-efe014700f81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a86e4de0f4fd4974bd9e541f4bdc7746', 'request_id': 'req-7628ecd9-6858-40d8-bd91-efe014700f81'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:45.864006 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7628ecd9-6858-40d8-bd91-efe014700f81 admin admin] The token cache is being invalidate because project a86e4de0f4fd4974bd9e541f4bdc7746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:37:45.864288 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7628ecd9-6858-40d8-bd91-efe014700f81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:45.864916 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7628ecd9-6858-40d8-bd91-efe014700f81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:45.866473 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1400/2815] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:37:45 2022] DELETE /identity/v3/projects/a86e4de0f4fd4974bd9e541f4bdc7746 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:37:45.871082 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2945b0-1b48-45f7-9725-e1256b656b62 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:45.880963 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2945b0-1b48-45f7-9725-e1256b656b62 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:45.948640 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16921df7-134f-437c-99a3-62fe1fb34aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:45.949428 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16921df7-134f-437c-99a3-62fe1fb34aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:45.949714 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16921df7-134f-437c-99a3-62fe1fb34aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:45.950019 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16921df7-134f-437c-99a3-62fe1fb34aa7 admin admin] PATH_INFO: `/v3/users/ff0fea8569da4aa28c4662242824ff6e` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:45.951547 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16921df7-134f-437c-99a3-62fe1fb34aa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff0fea8569da4aa28c4662242824ff6e)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:45.953488 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16921df7-134f-437c-99a3-62fe1fb34aa7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:46.008639 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-16921df7-134f-437c-99a3-62fe1fb34aa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff0fea8569da4aa28c4662242824ff6e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:46.009805 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-16921df7-134f-437c-99a3-62fe1fb34aa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff0fea8569da4aa28c4662242824ff6e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:46.023207 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-16921df7-134f-437c-99a3-62fe1fb34aa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff0fea8569da4aa28c4662242824ff6e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:46.031525 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-16921df7-134f-437c-99a3-62fe1fb34aa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff0fea8569da4aa28c4662242824ff6e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:46.032484 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-16921df7-134f-437c-99a3-62fe1fb34aa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff0fea8569da4aa28c4662242824ff6e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:46.046258 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1416/2816] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:37:45 2022] DELETE /identity/v3/users/ff0fea8569da4aa28c4662242824ff6e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:37:46.350284 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628ecd9-6858-40d8-bd91-efe014700f81 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:46.351801 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7628ecd9-6858-40d8-bd91-efe014700f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:46.365306 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628ecd9-6858-40d8-bd91-efe014700f81 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:46.432437 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab2bb3-10b1-4556-a6a6-fe006049c4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:46.433325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab2bb3-10b1-4556-a6a6-fe006049c4af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:46.433613 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab2bb3-10b1-4556-a6a6-fe006049c4af admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:46.433899 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab2bb3-10b1-4556-a6a6-fe006049c4af admin admin] PATH_INFO: `/v3/projects/d0252943fb2d467ab46ca3773bb53fe5` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:46.435185 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab2bb3-10b1-4556-a6a6-fe006049c4af admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0252943fb2d467ab46ca3773bb53fe5)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:46.437115 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab2bb3-10b1-4556-a6a6-fe006049c4af admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:46.451023 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:37:46.492064 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-30ab2bb3-10b1-4556-a6a6-fe006049c4af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0252943fb2d467ab46ca3773bb53fe5', 'request_id': 'req-30ab2bb3-10b1-4556-a6a6-fe006049c4af'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:46.500786 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-30ab2bb3-10b1-4556-a6a6-fe006049c4af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0252943fb2d467ab46ca3773bb53fe5', 'request_id': 'req-30ab2bb3-10b1-4556-a6a6-fe006049c4af'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:46.506953 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-30ab2bb3-10b1-4556-a6a6-fe006049c4af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0252943fb2d467ab46ca3773bb53fe5', 'request_id': 'req-30ab2bb3-10b1-4556-a6a6-fe006049c4af'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:46.519223 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-30ab2bb3-10b1-4556-a6a6-fe006049c4af admin admin] The token cache is being invalidate because project d0252943fb2d467ab46ca3773bb53fe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:37:46.519518 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-30ab2bb3-10b1-4556-a6a6-fe006049c4af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:46.520188 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-30ab2bb3-10b1-4556-a6a6-fe006049c4af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:46.521755 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1401/2817] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:37:46 2022] DELETE /identity/v3/projects/d0252943fb2d467ab46ca3773bb53fe5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:37:46.525840 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16921df7-134f-437c-99a3-62fe1fb34aa7 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:46.527460 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-16921df7-134f-437c-99a3-62fe1fb34aa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:46.540952 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16921df7-134f-437c-99a3-62fe1fb34aa7 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:46.598777 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173ebf0-c5b6-42dc-805d-a799300719e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:46.599666 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173ebf0-c5b6-42dc-805d-a799300719e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:46.599949 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173ebf0-c5b6-42dc-805d-a799300719e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:46.600222 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173ebf0-c5b6-42dc-805d-a799300719e8 admin admin] PATH_INFO: `/v3/users/2934b6af0276446095d028e74e2ff070` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:46.601424 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173ebf0-c5b6-42dc-805d-a799300719e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2934b6af0276446095d028e74e2ff070)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:46.604057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173ebf0-c5b6-42dc-805d-a799300719e8 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:46.621123 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:37:46.655403 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c173ebf0-c5b6-42dc-805d-a799300719e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2934b6af0276446095d028e74e2ff070'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:46.656071 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c173ebf0-c5b6-42dc-805d-a799300719e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2934b6af0276446095d028e74e2ff070'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:46.669419 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c173ebf0-c5b6-42dc-805d-a799300719e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2934b6af0276446095d028e74e2ff070'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:46.678302 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c173ebf0-c5b6-42dc-805d-a799300719e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2934b6af0276446095d028e74e2ff070'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:46.678907 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c173ebf0-c5b6-42dc-805d-a799300719e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2934b6af0276446095d028e74e2ff070'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:46.692139 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1417/2818] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:37:46 2022] DELETE /identity/v3/users/2934b6af0276446095d028e74e2ff070 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:37:46.987939 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab2bb3-10b1-4556-a6a6-fe006049c4af admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:46.989399 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-30ab2bb3-10b1-4556-a6a6-fe006049c4af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:47.002659 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab2bb3-10b1-4556-a6a6-fe006049c4af admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:47.063861 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b2662-07ae-4b11-83ac-dd5c341bd3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:47.064627 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b2662-07ae-4b11-83ac-dd5c341bd3d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:47.064914 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b2662-07ae-4b11-83ac-dd5c341bd3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:47.065192 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b2662-07ae-4b11-83ac-dd5c341bd3d2 admin admin] PATH_INFO: `/v3/projects/5f264cb3ac6c44f8bbd0392b02244b35` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:47.066418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b2662-07ae-4b11-83ac-dd5c341bd3d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f264cb3ac6c44f8bbd0392b02244b35)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:47.068365 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b2662-07ae-4b11-83ac-dd5c341bd3d2 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:47.124460 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-660b2662-07ae-4b11-83ac-dd5c341bd3d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f264cb3ac6c44f8bbd0392b02244b35', 'request_id': 'req-660b2662-07ae-4b11-83ac-dd5c341bd3d2'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:47.133419 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-660b2662-07ae-4b11-83ac-dd5c341bd3d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f264cb3ac6c44f8bbd0392b02244b35', 'request_id': 'req-660b2662-07ae-4b11-83ac-dd5c341bd3d2'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:47.141347 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-660b2662-07ae-4b11-83ac-dd5c341bd3d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f264cb3ac6c44f8bbd0392b02244b35', 'request_id': 'req-660b2662-07ae-4b11-83ac-dd5c341bd3d2'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:47.160063 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-660b2662-07ae-4b11-83ac-dd5c341bd3d2 admin admin] The token cache is being invalidate because project 5f264cb3ac6c44f8bbd0392b02244b35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:37:47.160568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-660b2662-07ae-4b11-83ac-dd5c341bd3d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:47.161729 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-660b2662-07ae-4b11-83ac-dd5c341bd3d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:37:47.164198 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1402/2819] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:37:46 2022] DELETE /identity/v3/projects/5f264cb3ac6c44f8bbd0392b02244b35 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:37:47.170600 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadd75b-dc26-41d1-95ae-e0bd41802940 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:47.171025 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadd75b-dc26-41d1-95ae-e0bd41802940 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:47.171241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadd75b-dc26-41d1-95ae-e0bd41802940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:47.207716 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-9cadd75b-dc26-41d1-95ae-e0bd41802940 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:37:47.209853 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9cadd75b-dc26-41d1-95ae-e0bd41802940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:47.304158 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1418/2820] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:37:47.314301 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1647da3-226e-4a0a-8fd8-cf5d42d11ad6 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:47.314512 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1647da3-226e-4a0a-8fd8-cf5d42d11ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:47.314775 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1647da3-226e-4a0a-8fd8-cf5d42d11ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:47.335212 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-e1647da3-226e-4a0a-8fd8-cf5d42d11ad6 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:37:47.336438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e1647da3-226e-4a0a-8fd8-cf5d42d11ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:47.345200 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1403/2821] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:37:47.349699 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cadd75b-dc26-41d1-95ae-e0bd41802940 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:47.359508 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cadd75b-dc26-41d1-95ae-e0bd41802940 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:47.364096 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c128d54-c46d-4788-8962-67d699f3d6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:47.364893 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c128d54-c46d-4788-8962-67d699f3d6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:47.365178 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c128d54-c46d-4788-8962-67d699f3d6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:47.365457 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c128d54-c46d-4788-8962-67d699f3d6e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:47.366217 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c128d54-c46d-4788-8962-67d699f3d6e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:37:47.366553 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c128d54-c46d-4788-8962-67d699f3d6e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:47.368341 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c128d54-c46d-4788-8962-67d699f3d6e1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:47.380670 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1419/2822] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:37:47.388500 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1647da3-226e-4a0a-8fd8-cf5d42d11ad6 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:47.405866 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1647da3-226e-4a0a-8fd8-cf5d42d11ad6 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:47.413960 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e593e82-1014-4d59-92ba-3a38aeaa4dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:47.415167 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e593e82-1014-4d59-92ba-3a38aeaa4dee admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:47.415672 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e593e82-1014-4d59-92ba-3a38aeaa4dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:47.416184 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e593e82-1014-4d59-92ba-3a38aeaa4dee admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:47.417520 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e593e82-1014-4d59-92ba-3a38aeaa4dee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:47.421317 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e593e82-1014-4d59-92ba-3a38aeaa4dee admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:47.466693 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1404/2823] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:37:47 2022] POST /identity/v3/projects => generated 371 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:37:47.471858 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c128d54-c46d-4788-8962-67d699f3d6e1 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:47.482811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c128d54-c46d-4788-8962-67d699f3d6e1 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:47.551514 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556cbf23-f026-43c9-9447-04ff79869482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:47.552227 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cbf23-f026-43c9-9447-04ff79869482 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:47.552516 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cbf23-f026-43c9-9447-04ff79869482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:47.552795 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cbf23-f026-43c9-9447-04ff79869482 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:47.553497 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556cbf23-f026-43c9-9447-04ff79869482 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:47.555492 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556cbf23-f026-43c9-9447-04ff79869482 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:47.578703 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1420/2824] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:37:47 2022] POST /identity/v3/users => generated 286 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:37:47.583254 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e593e82-1014-4d59-92ba-3a38aeaa4dee admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:47.589010 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:37:47.596605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e593e82-1014-4d59-92ba-3a38aeaa4dee admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:47.603389 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2c206-f4e5-4a8d-bfc6-9c0992ee1187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:47.604212 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2c206-f4e5-4a8d-bfc6-9c0992ee1187 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:47.604622 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2c206-f4e5-4a8d-bfc6-9c0992ee1187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:47.605003 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2c206-f4e5-4a8d-bfc6-9c0992ee1187 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:47.605862 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd2c206-f4e5-4a8d-bfc6-9c0992ee1187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:47.607798 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd2c206-f4e5-4a8d-bfc6-9c0992ee1187 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:47.620158 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1405/2825] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 04:37:47.625966 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556cbf23-f026-43c9-9447-04ff79869482 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:47.637355 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556cbf23-f026-43c9-9447-04ff79869482 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:47.642394 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438001c-5a55-4784-ad93-3a61bdc7b9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:47.643081 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438001c-5a55-4784-ad93-3a61bdc7b9a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:47.643395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438001c-5a55-4784-ad93-3a61bdc7b9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:47.643676 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438001c-5a55-4784-ad93-3a61bdc7b9a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:47.644416 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438001c-5a55-4784-ad93-3a61bdc7b9a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:47.646078 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438001c-5a55-4784-ad93-3a61bdc7b9a9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:47.652075 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:37:47.660354 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1421/2826] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:37:47.665696 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2c206-f4e5-4a8d-bfc6-9c0992ee1187 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:47.676212 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2c206-f4e5-4a8d-bfc6-9c0992ee1187 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:47.681929 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8a644-a723-42a3-8174-e9f0f9f4b215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:47.682870 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8a644-a723-42a3-8174-e9f0f9f4b215 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:47.683157 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8a644-a723-42a3-8174-e9f0f9f4b215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:47.683438 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8a644-a723-42a3-8174-e9f0f9f4b215 admin admin] PATH_INFO: `/v3/projects/2b8b24d331b14476832219c978bd169e/users/cf00bbb28a1d401192e86f497667704e/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:47.700298 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8a644-a723-42a3-8174-e9f0f9f4b215 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b8b24d331b14476832219c978bd169e, user_id=cf00bbb28a1d401192e86f497667704e, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:47.703418 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8a644-a723-42a3-8174-e9f0f9f4b215 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:47.717966 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1406/2827] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:37:47 2022] PUT /identity/v3/projects/2b8b24d331b14476832219c978bd169e/users/cf00bbb28a1d401192e86f497667704e/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:37:47.723722 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998443f7-119c-44a7-a74e-a04b78ad389b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:47.724016 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998443f7-119c-44a7-a74e-a04b78ad389b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:47.724303 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998443f7-119c-44a7-a74e-a04b78ad389b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:47.742302 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-998443f7-119c-44a7-a74e-a04b78ad389b None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:37:47.744049 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-998443f7-119c-44a7-a74e-a04b78ad389b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:47.807664 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1422/2828] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:37:47.817562 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8a644-a723-42a3-8174-e9f0f9f4b215 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:47.819486 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-98d8a644-a723-42a3-8174-e9f0f9f4b215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:47.880976 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8a644-a723-42a3-8174-e9f0f9f4b215 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:47.885020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af8c9f-bccb-4481-a301-958a7e23b90f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:47.885671 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af8c9f-bccb-4481-a301-958a7e23b90f service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:47.885951 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af8c9f-bccb-4481-a301-958a7e23b90f service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:47.886261 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af8c9f-bccb-4481-a301-958a7e23b90f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:47.895857 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af8c9f-bccb-4481-a301-958a7e23b90f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:47.897284 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af8c9f-bccb-4481-a301-958a7e23b90f service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:47.907153 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1407/2829] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:37:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:37:48.629179 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691fda1-eb52-4182-978f-f9f5d88912f8 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:48.630056 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691fda1-eb52-4182-978f-f9f5d88912f8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:48.630056 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691fda1-eb52-4182-978f-f9f5d88912f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:48.665946 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-9691fda1-eb52-4182-978f-f9f5d88912f8 None None] MFA Rules not processed for user `cf00bbb28a1d401192e86f497667704e`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:37:48.668247 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9691fda1-eb52-4182-978f-f9f5d88912f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:48.755327 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1423/2830] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:37:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:37:48.761770 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af8c9f-bccb-4481-a301-958a7e23b90f service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:48.772940 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af8c9f-bccb-4481-a301-958a7e23b90f service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:48.778630 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024f71d-bdfe-4197-82ce-d9b183da2d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:48.779321 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024f71d-bdfe-4197-82ce-d9b183da2d37 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:48.779610 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024f71d-bdfe-4197-82ce-d9b183da2d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:48.779894 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024f71d-bdfe-4197-82ce-d9b183da2d37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:48.780703 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7024f71d-bdfe-4197-82ce-d9b183da2d37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:48.782772 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7024f71d-bdfe-4197-82ce-d9b183da2d37 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:48.815315 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1408/2831] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:37:48 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:37:48.819698 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691fda1-eb52-4182-978f-f9f5d88912f8 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:48.833749 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691fda1-eb52-4182-978f-f9f5d88912f8 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:48.907017 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c9682-aa52-43c9-9011-ae6d41a01d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:48.907706 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c9682-aa52-43c9-9011-ae6d41a01d59 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:48.907996 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c9682-aa52-43c9-9011-ae6d41a01d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:48.908297 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c9682-aa52-43c9-9011-ae6d41a01d59 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:48.908992 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c9682-aa52-43c9-9011-ae6d41a01d59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:48.911007 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c9682-aa52-43c9-9011-ae6d41a01d59 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:48.936190 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1424/2832] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:37:48 2022] POST /identity/v3/users => generated 291 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:37:48.940222 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024f71d-bdfe-4197-82ce-d9b183da2d37 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:48.951828 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024f71d-bdfe-4197-82ce-d9b183da2d37 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:48.956567 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7fc76-6901-41d1-828f-871b6dd5473f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:48.957241 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7fc76-6901-41d1-828f-871b6dd5473f admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:48.957527 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7fc76-6901-41d1-828f-871b6dd5473f admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:48.957839 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7fc76-6901-41d1-828f-871b6dd5473f admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:48.958721 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d7fc76-6901-41d1-828f-871b6dd5473f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:48.960343 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d7fc76-6901-41d1-828f-871b6dd5473f admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:48.971811 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1409/2833] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:37:48.976538 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c9682-aa52-43c9-9011-ae6d41a01d59 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:48.987029 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c9682-aa52-43c9-9011-ae6d41a01d59 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:48.991829 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302a5ee-7460-4815-b511-6af822643ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:48.992759 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302a5ee-7460-4815-b511-6af822643ed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:48.993031 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302a5ee-7460-4815-b511-6af822643ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:48.993865 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302a5ee-7460-4815-b511-6af822643ed5 admin admin] PATH_INFO: `/v3/projects/bc901a885c014faa9c6e5d34205f0db4/users/9dc522cf4afa440bbeeac1aa425fad36/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:49.010844 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302a5ee-7460-4815-b511-6af822643ed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc901a885c014faa9c6e5d34205f0db4, user_id=9dc522cf4afa440bbeeac1aa425fad36, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:49.013445 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302a5ee-7460-4815-b511-6af822643ed5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:49.017287 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:37:49.030052 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1425/2834] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:37:48 2022] PUT /identity/v3/projects/bc901a885c014faa9c6e5d34205f0db4/users/9dc522cf4afa440bbeeac1aa425fad36/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:37:49.034882 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7fc76-6901-41d1-828f-871b6dd5473f admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:49.046940 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7fc76-6901-41d1-828f-871b6dd5473f admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:49.113030 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e29d56-a58d-45e0-a059-c0bd6e3f5d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:49.113708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e29d56-a58d-45e0-a059-c0bd6e3f5d0d admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:49.114015 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e29d56-a58d-45e0-a059-c0bd6e3f5d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:49.114309 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e29d56-a58d-45e0-a059-c0bd6e3f5d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:49.115060 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e29d56-a58d-45e0-a059-c0bd6e3f5d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:49.116674 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e29d56-a58d-45e0-a059-c0bd6e3f5d0d admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:49.128291 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1410/2835] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:37:49.132905 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302a5ee-7460-4815-b511-6af822643ed5 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:49.144886 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302a5ee-7460-4815-b511-6af822643ed5 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:49.150609 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae10178-f75a-445f-b06f-32ae4379cec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:49.151818 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae10178-f75a-445f-b06f-32ae4379cec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:49.152130 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae10178-f75a-445f-b06f-32ae4379cec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:49.152405 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae10178-f75a-445f-b06f-32ae4379cec8 admin admin] PATH_INFO: `/v3/projects/bc901a885c014faa9c6e5d34205f0db4/users/9dc522cf4afa440bbeeac1aa425fad36/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:49.154826 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae10178-f75a-445f-b06f-32ae4379cec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc901a885c014faa9c6e5d34205f0db4, user_id=9dc522cf4afa440bbeeac1aa425fad36, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:49.157390 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae10178-f75a-445f-b06f-32ae4379cec8 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:49.169681 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1426/2836] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:37:49 2022] PUT /identity/v3/projects/bc901a885c014faa9c6e5d34205f0db4/users/9dc522cf4afa440bbeeac1aa425fad36/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 04:37:49.943249 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e0ea6-146c-43de-99b9-76608dc0210a None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:49.944042 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e0ea6-146c-43de-99b9-76608dc0210a None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:49.944356 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e0ea6-146c-43de-99b9-76608dc0210a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:49.992033 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-143e0ea6-146c-43de-99b9-76608dc0210a None None] MFA Rules not processed for user `9dc522cf4afa440bbeeac1aa425fad36`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:37:49.994595 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-143e0ea6-146c-43de-99b9-76608dc0210a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:50.028432 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:37:50.107319 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1411/2837] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:37:49 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:37:50.118369 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625e61b-87e9-41a0-b233-d8cb14edc659 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:50.119729 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625e61b-87e9-41a0-b233-d8cb14edc659 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:50.119729 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625e61b-87e9-41a0-b233-d8cb14edc659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:50.138242 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e625e61b-87e9-41a0-b233-d8cb14edc659 None None] MFA Rules not processed for user `cf00bbb28a1d401192e86f497667704e`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:37:50.139474 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e625e61b-87e9-41a0-b233-d8cb14edc659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:50.234810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1427/2838] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:37:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:37:50.249545 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e0ea6-146c-43de-99b9-76608dc0210a None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:50.251463 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-143e0ea6-146c-43de-99b9-76608dc0210a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:50.332329 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e0ea6-146c-43de-99b9-76608dc0210a None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:50.338195 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a5194-cd7d-42ea-bed1-b34c58671c04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:50.338854 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a5194-cd7d-42ea-bed1-b34c58671c04 service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:50.339139 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a5194-cd7d-42ea-bed1-b34c58671c04 service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:50.339416 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a5194-cd7d-42ea-bed1-b34c58671c04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:50.348200 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a5194-cd7d-42ea-bed1-b34c58671c04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:50.349803 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a5194-cd7d-42ea-bed1-b34c58671c04 service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:50.360265 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1412/2839] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:37:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:37:50.396816 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625e61b-87e9-41a0-b233-d8cb14edc659 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:50.398261 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e625e61b-87e9-41a0-b233-d8cb14edc659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:50.460616 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625e61b-87e9-41a0-b233-d8cb14edc659 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:50.464710 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93a1da-7248-4f1f-a482-80f97f97d5ce service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac83171b9284163a71cc729cef076f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:50.465359 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93a1da-7248-4f1f-a482-80f97f97d5ce service glance] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:50.465642 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93a1da-7248-4f1f-a482-80f97f97d5ce service glance] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:50.465918 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93a1da-7248-4f1f-a482-80f97f97d5ce service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:50.467731 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ef93a1da-7248-4f1f-a482-80f97f97d5ce service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:50.482333 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef93a1da-7248-4f1f-a482-80f97f97d5ce service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:50.483778 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef93a1da-7248-4f1f-a482-80f97f97d5ce service glance] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:50.495916 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1428/2840] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:37:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:37:51.088160 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a5194-cd7d-42ea-bed1-b34c58671c04 service nova] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:51.163042 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a5194-cd7d-42ea-bed1-b34c58671c04 service nova] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:51.167810 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d1f0c-b01a-4338-855c-9af4a41980d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:51.168515 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d1f0c-b01a-4338-855c-9af4a41980d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:51.168807 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d1f0c-b01a-4338-855c-9af4a41980d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:51.169094 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d1f0c-b01a-4338-855c-9af4a41980d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:51.171195 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-178d1f0c-b01a-4338-855c-9af4a41980d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:51.187805 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d1f0c-b01a-4338-855c-9af4a41980d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:51.190606 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d1f0c-b01a-4338-855c-9af4a41980d9 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:51.207575 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1413/2841] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:37:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:37:55.131295 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93a1da-7248-4f1f-a482-80f97f97d5ce service glance] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:37:55.132785 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ef93a1da-7248-4f1f-a482-80f97f97d5ce service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:55.144947 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93a1da-7248-4f1f-a482-80f97f97d5ce service glance] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:37:55.149773 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a23893-7181-4ada-9043-80ca1490e8c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:37:55.150490 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a23893-7181-4ada-9043-80ca1490e8c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:37:55.150779 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a23893-7181-4ada-9043-80ca1490e8c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:37:55.151048 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a23893-7181-4ada-9043-80ca1490e8c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:37:55.152861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-43a23893-7181-4ada-9043-80ca1490e8c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:37:55.163410 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a23893-7181-4ada-9043-80ca1490e8c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:37:55.164861 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a23893-7181-4ada-9043-80ca1490e8c7 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:37:55.173827 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1429/2842] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:37:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:38:01.201760 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=79 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:38:03.350260 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d1f0c-b01a-4338-855c-9af4a41980d9 service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:38:03.351768 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-178d1f0c-b01a-4338-855c-9af4a41980d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:38:03.409291 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d1f0c-b01a-4338-855c-9af4a41980d9 service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:38:03.412910 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671177e-c7cf-4549-aa9a-2dff9cdf44ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:38:03.413541 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671177e-c7cf-4549-aa9a-2dff9cdf44ca service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:03.413823 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671177e-c7cf-4549-aa9a-2dff9cdf44ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:03.414130 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671177e-c7cf-4549-aa9a-2dff9cdf44ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:03.423545 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3671177e-c7cf-4549-aa9a-2dff9cdf44ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:38:03.424962 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3671177e-c7cf-4549-aa9a-2dff9cdf44ca service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:38:03.434653 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1414/2843] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:38:03 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:38:05.169567 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=64,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:38:13.430465 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=26 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:38:22.454405 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a23893-7181-4ada-9043-80ca1490e8c7 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:38:22.455899 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-43a23893-7181-4ada-9043-80ca1490e8c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:38:22.535946 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a23893-7181-4ada-9043-80ca1490e8c7 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:38:22.541823 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf4510-e3db-4275-a0d8-e13a513c9390 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0433f6219478476286ea27c5c82d41a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:38:22.543078 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf4510-e3db-4275-a0d8-e13a513c9390 service placement] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:22.543368 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf4510-e3db-4275-a0d8-e13a513c9390 service placement] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:22.543649 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf4510-e3db-4275-a0d8-e13a513c9390 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:22.545879 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ccbf4510-e3db-4275-a0d8-e13a513c9390 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:38:22.559794 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbf4510-e3db-4275-a0d8-e13a513c9390 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:38:22.561393 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbf4510-e3db-4275-a0d8-e13a513c9390 service placement] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:38:22.575079 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1430/2844] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:38:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:38:23.320319 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671177e-c7cf-4549-aa9a-2dff9cdf44ca service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:38:23.383568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671177e-c7cf-4549-aa9a-2dff9cdf44ca service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:38:23.388656 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee58db-65ca-4df1-a89a-5c9c91b50a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:38:23.389445 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee58db-65ca-4df1-a89a-5c9c91b50a0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:23.389747 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee58db-65ca-4df1-a89a-5c9c91b50a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:23.390036 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee58db-65ca-4df1-a89a-5c9c91b50a0b admin admin] PATH_INFO: `/v3/users/cf00bbb28a1d401192e86f497667704e` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:23.391251 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee58db-65ca-4df1-a89a-5c9c91b50a0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf00bbb28a1d401192e86f497667704e)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:38:23.393177 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee58db-65ca-4df1-a89a-5c9c91b50a0b admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:38:23.437908 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-eeee58db-65ca-4df1-a89a-5c9c91b50a0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf00bbb28a1d401192e86f497667704e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:23.438581 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-eeee58db-65ca-4df1-a89a-5c9c91b50a0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf00bbb28a1d401192e86f497667704e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:23.450724 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-eeee58db-65ca-4df1-a89a-5c9c91b50a0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf00bbb28a1d401192e86f497667704e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:23.457624 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-eeee58db-65ca-4df1-a89a-5c9c91b50a0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf00bbb28a1d401192e86f497667704e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:23.464922 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-eeee58db-65ca-4df1-a89a-5c9c91b50a0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf00bbb28a1d401192e86f497667704e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:23.470942 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1415/2845] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:38:23 2022] DELETE /identity/v3/users/cf00bbb28a1d401192e86f497667704e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:38:23.648521 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf4510-e3db-4275-a0d8-e13a513c9390 service placement] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:38:23.661368 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf4510-e3db-4275-a0d8-e13a513c9390 service placement] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:38:23.722018 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4fd62-f4f4-4d34-8d6b-b1e40d67bebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:38:23.722892 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4fd62-f4f4-4d34-8d6b-b1e40d67bebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:23.723177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4fd62-f4f4-4d34-8d6b-b1e40d67bebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:23.723456 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4fd62-f4f4-4d34-8d6b-b1e40d67bebe admin admin] PATH_INFO: `/v3/projects/2b8b24d331b14476832219c978bd169e` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:23.724623 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba4fd62-f4f4-4d34-8d6b-b1e40d67bebe admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b8b24d331b14476832219c978bd169e)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:38:23.726618 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba4fd62-f4f4-4d34-8d6b-b1e40d67bebe admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:38:23.773237 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2ba4fd62-f4f4-4d34-8d6b-b1e40d67bebe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b8b24d331b14476832219c978bd169e', 'request_id': 'req-2ba4fd62-f4f4-4d34-8d6b-b1e40d67bebe'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:23.778748 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2ba4fd62-f4f4-4d34-8d6b-b1e40d67bebe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b8b24d331b14476832219c978bd169e', 'request_id': 'req-2ba4fd62-f4f4-4d34-8d6b-b1e40d67bebe'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:23.785928 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2ba4fd62-f4f4-4d34-8d6b-b1e40d67bebe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b8b24d331b14476832219c978bd169e', 'request_id': 'req-2ba4fd62-f4f4-4d34-8d6b-b1e40d67bebe'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:23.797805 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2ba4fd62-f4f4-4d34-8d6b-b1e40d67bebe admin admin] The token cache is being invalidate because project 2b8b24d331b14476832219c978bd169e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:38:23.798115 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2ba4fd62-f4f4-4d34-8d6b-b1e40d67bebe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:23.798756 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2ba4fd62-f4f4-4d34-8d6b-b1e40d67bebe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:23.800293 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1431/2846] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:38:23 2022] DELETE /identity/v3/projects/2b8b24d331b14476832219c978bd169e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:38:23.804519 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee58db-65ca-4df1-a89a-5c9c91b50a0b admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:38:23.805963 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-eeee58db-65ca-4df1-a89a-5c9c91b50a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:38:23.819700 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee58db-65ca-4df1-a89a-5c9c91b50a0b admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:38:23.876952 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5c9af-73f3-4fbc-a1c2-4107a1665a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:38:23.877817 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5c9af-73f3-4fbc-a1c2-4107a1665a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:23.878143 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5c9af-73f3-4fbc-a1c2-4107a1665a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:23.878425 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5c9af-73f3-4fbc-a1c2-4107a1665a68 admin admin] PATH_INFO: `/v3/users/9dc522cf4afa440bbeeac1aa425fad36` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:23.879694 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c5c9af-73f3-4fbc-a1c2-4107a1665a68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dc522cf4afa440bbeeac1aa425fad36)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:38:23.881608 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c5c9af-73f3-4fbc-a1c2-4107a1665a68 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:38:23.902750 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:38:23.928552 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-75c5c9af-73f3-4fbc-a1c2-4107a1665a68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dc522cf4afa440bbeeac1aa425fad36'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:23.929257 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-75c5c9af-73f3-4fbc-a1c2-4107a1665a68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dc522cf4afa440bbeeac1aa425fad36'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:23.941950 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-75c5c9af-73f3-4fbc-a1c2-4107a1665a68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dc522cf4afa440bbeeac1aa425fad36'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:23.948662 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-75c5c9af-73f3-4fbc-a1c2-4107a1665a68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dc522cf4afa440bbeeac1aa425fad36'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:23.956174 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-75c5c9af-73f3-4fbc-a1c2-4107a1665a68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dc522cf4afa440bbeeac1aa425fad36'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:23.962217 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1416/2847] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:38:23 2022] DELETE /identity/v3/users/9dc522cf4afa440bbeeac1aa425fad36 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:38:24.137469 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4fd62-f4f4-4d34-8d6b-b1e40d67bebe admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:38:24.138974 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2ba4fd62-f4f4-4d34-8d6b-b1e40d67bebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:38:24.158482 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4fd62-f4f4-4d34-8d6b-b1e40d67bebe admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:38:24.177751 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:38:24.220607 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc113aa5-fdee-4959-bf75-19490a0f2858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:38:24.221470 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc113aa5-fdee-4959-bf75-19490a0f2858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:24.221755 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc113aa5-fdee-4959-bf75-19490a0f2858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:24.222068 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc113aa5-fdee-4959-bf75-19490a0f2858 admin admin] PATH_INFO: `/v3/projects/bc901a885c014faa9c6e5d34205f0db4` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:24.223252 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc113aa5-fdee-4959-bf75-19490a0f2858 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc901a885c014faa9c6e5d34205f0db4)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:38:24.225156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc113aa5-fdee-4959-bf75-19490a0f2858 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:38:24.270836 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bc113aa5-fdee-4959-bf75-19490a0f2858 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc901a885c014faa9c6e5d34205f0db4', 'request_id': 'req-bc113aa5-fdee-4959-bf75-19490a0f2858'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:24.276415 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bc113aa5-fdee-4959-bf75-19490a0f2858 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc901a885c014faa9c6e5d34205f0db4', 'request_id': 'req-bc113aa5-fdee-4959-bf75-19490a0f2858'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:24.284306 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bc113aa5-fdee-4959-bf75-19490a0f2858 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc901a885c014faa9c6e5d34205f0db4', 'request_id': 'req-bc113aa5-fdee-4959-bf75-19490a0f2858'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:24.295953 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bc113aa5-fdee-4959-bf75-19490a0f2858 admin admin] The token cache is being invalidate because project bc901a885c014faa9c6e5d34205f0db4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:38:24.296242 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bc113aa5-fdee-4959-bf75-19490a0f2858 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:24.296902 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bc113aa5-fdee-4959-bf75-19490a0f2858 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:24.298479 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1432/2848] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:38:24 2022] DELETE /identity/v3/projects/bc901a885c014faa9c6e5d34205f0db4 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:38:24.303450 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608da510-7bcd-4ead-9e5b-175e4197c83d None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:24.303737 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608da510-7bcd-4ead-9e5b-175e4197c83d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:24.304064 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608da510-7bcd-4ead-9e5b-175e4197c83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:24.321314 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-608da510-7bcd-4ead-9e5b-175e4197c83d None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:38:24.322546 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-608da510-7bcd-4ead-9e5b-175e4197c83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:38:24.382490 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1417/2849] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:38:24.390249 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31731f7-86f0-49d8-95a0-7487d177a4a7 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:24.390544 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31731f7-86f0-49d8-95a0-7487d177a4a7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:24.390825 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31731f7-86f0-49d8-95a0-7487d177a4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:24.409866 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e31731f7-86f0-49d8-95a0-7487d177a4a7 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:38:24.411028 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e31731f7-86f0-49d8-95a0-7487d177a4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:38:24.419578 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1433/2850] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:38:24.423846 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608da510-7bcd-4ead-9e5b-175e4197c83d None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:38:24.433513 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608da510-7bcd-4ead-9e5b-175e4197c83d None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:38:24.438034 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e275ae-3be5-47e2-b160-0d70b6400f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:38:24.438687 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e275ae-3be5-47e2-b160-0d70b6400f3f admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:24.438971 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e275ae-3be5-47e2-b160-0d70b6400f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:24.439251 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e275ae-3be5-47e2-b160-0d70b6400f3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:24.439970 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e275ae-3be5-47e2-b160-0d70b6400f3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:38:24.440280 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e275ae-3be5-47e2-b160-0d70b6400f3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:38:24.441862 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e275ae-3be5-47e2-b160-0d70b6400f3f admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:38:24.453793 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1418/2851] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 04:38:24.457943 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31731f7-86f0-49d8-95a0-7487d177a4a7 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:38:24.467612 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31731f7-86f0-49d8-95a0-7487d177a4a7 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:38:24.472216 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c93737-138a-478b-9b01-d1fd42aece9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:38:24.472853 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c93737-138a-478b-9b01-d1fd42aece9e admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:24.473133 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c93737-138a-478b-9b01-d1fd42aece9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:24.473406 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c93737-138a-478b-9b01-d1fd42aece9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:24.474136 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c93737-138a-478b-9b01-d1fd42aece9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:38:24.476013 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c93737-138a-478b-9b01-d1fd42aece9e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:38:24.503005 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1434/2852] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:38:24 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:38:24.507124 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e275ae-3be5-47e2-b160-0d70b6400f3f admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:38:24.517502 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e275ae-3be5-47e2-b160-0d70b6400f3f admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:38:24.571671 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10300af-be5e-40eb-8667-8e709c4c393a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:38:24.572424 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10300af-be5e-40eb-8667-8e709c4c393a admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:24.572620 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10300af-be5e-40eb-8667-8e709c4c393a admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:24.572897 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10300af-be5e-40eb-8667-8e709c4c393a admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:24.574171 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10300af-be5e-40eb-8667-8e709c4c393a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:38:24.576088 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10300af-be5e-40eb-8667-8e709c4c393a admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:38:24.596940 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1419/2853] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:38:24 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:38:24.601215 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c93737-138a-478b-9b01-d1fd42aece9e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:38:24.612343 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c93737-138a-478b-9b01-d1fd42aece9e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:38:24.616888 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f4110-80dc-4692-8477-02be6dd72602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:38:24.617565 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f4110-80dc-4692-8477-02be6dd72602 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:24.617847 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f4110-80dc-4692-8477-02be6dd72602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:24.618166 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f4110-80dc-4692-8477-02be6dd72602 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:24.618888 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f4110-80dc-4692-8477-02be6dd72602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:38:24.620471 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f4110-80dc-4692-8477-02be6dd72602 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:38:24.630935 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1435/2854] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:38:24.634845 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10300af-be5e-40eb-8667-8e709c4c393a admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:38:24.646274 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10300af-be5e-40eb-8667-8e709c4c393a admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:38:24.651144 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ec23c-0656-40d5-8d4b-1c08c6b09d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:38:24.652502 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ec23c-0656-40d5-8d4b-1c08c6b09d1a admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:24.652787 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ec23c-0656-40d5-8d4b-1c08c6b09d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:24.653063 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ec23c-0656-40d5-8d4b-1c08c6b09d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:24.653797 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ec23c-0656-40d5-8d4b-1c08c6b09d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:38:24.655442 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ec23c-0656-40d5-8d4b-1c08c6b09d1a admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:38:24.666109 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1420/2855] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:38:24.670304 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f4110-80dc-4692-8477-02be6dd72602 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:38:24.680441 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f4110-80dc-4692-8477-02be6dd72602 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:38:24.685072 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba4c39-7e40-4e74-a08c-ca123d76251b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:38:24.685946 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba4c39-7e40-4e74-a08c-ca123d76251b admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:24.686264 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba4c39-7e40-4e74-a08c-ca123d76251b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:24.686542 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba4c39-7e40-4e74-a08c-ca123d76251b admin admin] PATH_INFO: `/v3/projects/f8c28b81f1fa4d378c915ff0e23fd09b/users/a5f240808ac74fa5a63d3d75b4b50b93/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:24.701512 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba4c39-7e40-4e74-a08c-ca123d76251b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8c28b81f1fa4d378c915ff0e23fd09b, user_id=a5f240808ac74fa5a63d3d75b4b50b93, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:38:24.704469 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba4c39-7e40-4e74-a08c-ca123d76251b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:38:24.717880 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1436/2856] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:38:24 2022] PUT /identity/v3/projects/f8c28b81f1fa4d378c915ff0e23fd09b/users/a5f240808ac74fa5a63d3d75b4b50b93/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:38:24.728545 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717009e-0423-4d04-8ae6-cb52b5af02ac None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:24.728888 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717009e-0423-4d04-8ae6-cb52b5af02ac None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:24.729180 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717009e-0423-4d04-8ae6-cb52b5af02ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:24.736357 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:38:24.757222 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-d717009e-0423-4d04-8ae6-cb52b5af02ac None None] MFA Rules not processed for user `a5f240808ac74fa5a63d3d75b4b50b93`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:38:24.758505 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d717009e-0423-4d04-8ae6-cb52b5af02ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:38:24.822449 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1421/2857] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:38:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:38:24.834529 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba4c39-7e40-4e74-a08c-ca123d76251b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:38:24.836179 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-48ba4c39-7e40-4e74-a08c-ca123d76251b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:38:24.888556 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:38:24.894555 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba4c39-7e40-4e74-a08c-ca123d76251b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:38:24.899205 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe740b81-5d9a-4136-93fe-0ad4debc5fc9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac83171b9284163a71cc729cef076f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:38:24.899845 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe740b81-5d9a-4136-93fe-0ad4debc5fc9 service glance] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:24.900129 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe740b81-5d9a-4136-93fe-0ad4debc5fc9 service glance] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:24.900405 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe740b81-5d9a-4136-93fe-0ad4debc5fc9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:24.909087 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe740b81-5d9a-4136-93fe-0ad4debc5fc9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:38:24.910580 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe740b81-5d9a-4136-93fe-0ad4debc5fc9 service glance] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:38:24.919610 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1437/2858] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:38:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:38:34.819522 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=30 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:38:34.915511 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:38:47.571567 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717009e-0423-4d04-8ae6-cb52b5af02ac None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:38:47.641702 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717009e-0423-4d04-8ae6-cb52b5af02ac None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:38:47.646603 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72274497-9756-4d64-8346-82f0c7214697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:38:47.647515 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72274497-9756-4d64-8346-82f0c7214697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:47.647802 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72274497-9756-4d64-8346-82f0c7214697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:47.648087 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72274497-9756-4d64-8346-82f0c7214697 admin admin] PATH_INFO: `/v3/users/a5f240808ac74fa5a63d3d75b4b50b93` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:47.649394 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72274497-9756-4d64-8346-82f0c7214697 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5f240808ac74fa5a63d3d75b4b50b93)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:38:47.651482 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72274497-9756-4d64-8346-82f0c7214697 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:38:47.705629 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-72274497-9756-4d64-8346-82f0c7214697 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5f240808ac74fa5a63d3d75b4b50b93'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:47.706327 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-72274497-9756-4d64-8346-82f0c7214697 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5f240808ac74fa5a63d3d75b4b50b93'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:47.719155 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-72274497-9756-4d64-8346-82f0c7214697 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5f240808ac74fa5a63d3d75b4b50b93'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:47.728069 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-72274497-9756-4d64-8346-82f0c7214697 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5f240808ac74fa5a63d3d75b4b50b93'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:47.737271 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-72274497-9756-4d64-8346-82f0c7214697 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5f240808ac74fa5a63d3d75b4b50b93'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:47.744062 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1422/2859] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:38:47 2022] DELETE /identity/v3/users/a5f240808ac74fa5a63d3d75b4b50b93 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:38:47.749419 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff878d3-5d63-411a-a28d-d724fbfb2738 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:47.750107 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff878d3-5d63-411a-a28d-d724fbfb2738 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:47.750107 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff878d3-5d63-411a-a28d-d724fbfb2738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:47.769476 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-bff878d3-5d63-411a-a28d-d724fbfb2738 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:38:47.770736 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-bff878d3-5d63-411a-a28d-d724fbfb2738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:38:47.840487 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1438/2860] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:38:47.850952 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72274497-9756-4d64-8346-82f0c7214697 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:38:47.852467 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-72274497-9756-4d64-8346-82f0c7214697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:38:47.915325 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72274497-9756-4d64-8346-82f0c7214697 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:38:47.919360 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ffb1d6-2ec9-4658-a3f7-3d8b97756142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:38:47.920835 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffb1d6-2ec9-4658-a3f7-3d8b97756142 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:47.921177 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffb1d6-2ec9-4658-a3f7-3d8b97756142 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:47.921547 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffb1d6-2ec9-4658-a3f7-3d8b97756142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:47.931797 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ffb1d6-2ec9-4658-a3f7-3d8b97756142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:38:47.933242 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ffb1d6-2ec9-4658-a3f7-3d8b97756142 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:38:47.943923 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1423/2861] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:38:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:38:48.258355 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff878d3-5d63-411a-a28d-d724fbfb2738 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:38:48.259988 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-bff878d3-5d63-411a-a28d-d724fbfb2738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:38:48.278036 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff878d3-5d63-411a-a28d-d724fbfb2738 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:38:48.284727 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34908317-80f7-465f-8a9e-a2b5c18ffbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:38:48.285833 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34908317-80f7-465f-8a9e-a2b5c18ffbc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:48.286216 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34908317-80f7-465f-8a9e-a2b5c18ffbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:48.286555 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34908317-80f7-465f-8a9e-a2b5c18ffbc4 admin admin] PATH_INFO: `/v3/projects/f8c28b81f1fa4d378c915ff0e23fd09b` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:48.288156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34908317-80f7-465f-8a9e-a2b5c18ffbc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8c28b81f1fa4d378c915ff0e23fd09b)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:38:48.291927 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34908317-80f7-465f-8a9e-a2b5c18ffbc4 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:38:48.364947 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-34908317-80f7-465f-8a9e-a2b5c18ffbc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8c28b81f1fa4d378c915ff0e23fd09b', 'request_id': 'req-34908317-80f7-465f-8a9e-a2b5c18ffbc4'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:48.375238 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-34908317-80f7-465f-8a9e-a2b5c18ffbc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8c28b81f1fa4d378c915ff0e23fd09b', 'request_id': 'req-34908317-80f7-465f-8a9e-a2b5c18ffbc4'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:48.386079 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-34908317-80f7-465f-8a9e-a2b5c18ffbc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8c28b81f1fa4d378c915ff0e23fd09b', 'request_id': 'req-34908317-80f7-465f-8a9e-a2b5c18ffbc4'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:48.399988 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-34908317-80f7-465f-8a9e-a2b5c18ffbc4 admin admin] The token cache is being invalidate because project f8c28b81f1fa4d378c915ff0e23fd09b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:38:48.400290 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-34908317-80f7-465f-8a9e-a2b5c18ffbc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:48.400941 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-34908317-80f7-465f-8a9e-a2b5c18ffbc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:48.402542 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1439/2862] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:38:48 2022] DELETE /identity/v3/projects/f8c28b81f1fa4d378c915ff0e23fd09b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:38:48.408804 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb75e5-ffa7-454d-b614-1955db7501be None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:48.409168 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb75e5-ffa7-454d-b614-1955db7501be None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:48.409494 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb75e5-ffa7-454d-b614-1955db7501be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:48.429237 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-8beb75e5-ffa7-454d-b614-1955db7501be None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:38:48.430502 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-8beb75e5-ffa7-454d-b614-1955db7501be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:38:48.452376 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:38:48.504299 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1424/2863] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:38:48.512354 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67679223-0ab4-4fe4-aa0f-4c152cd3403e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:48.512641 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67679223-0ab4-4fe4-aa0f-4c152cd3403e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:48.512923 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67679223-0ab4-4fe4-aa0f-4c152cd3403e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:48.532395 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-67679223-0ab4-4fe4-aa0f-4c152cd3403e None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:38:48.533617 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-67679223-0ab4-4fe4-aa0f-4c152cd3403e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:38:48.541647 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1440/2864] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:38:48.546027 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb75e5-ffa7-454d-b614-1955db7501be None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:38:48.556345 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb75e5-ffa7-454d-b614-1955db7501be None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:38:48.561157 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4224e-1ef7-401d-8a5c-2796806cd8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:38:48.561854 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4224e-1ef7-401d-8a5c-2796806cd8b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:48.562170 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4224e-1ef7-401d-8a5c-2796806cd8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:48.562455 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4224e-1ef7-401d-8a5c-2796806cd8b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:48.563200 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e4224e-1ef7-401d-8a5c-2796806cd8b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:38:48.563510 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e4224e-1ef7-401d-8a5c-2796806cd8b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:38:48.565196 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e4224e-1ef7-401d-8a5c-2796806cd8b7 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:38:48.582202 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1425/2865] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:38:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:38:48.586938 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67679223-0ab4-4fe4-aa0f-4c152cd3403e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:38:48.597768 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67679223-0ab4-4fe4-aa0f-4c152cd3403e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:38:48.602936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1ddea-4f22-43e2-a6e9-1bfba0dab924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:38:48.603623 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1ddea-4f22-43e2-a6e9-1bfba0dab924 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:48.603907 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1ddea-4f22-43e2-a6e9-1bfba0dab924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:48.604184 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1ddea-4f22-43e2-a6e9-1bfba0dab924 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:48.604895 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1ddea-4f22-43e2-a6e9-1bfba0dab924 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:38:48.606961 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1ddea-4f22-43e2-a6e9-1bfba0dab924 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:38:48.637139 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1441/2866] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:38:48 2022] POST /identity/v3/projects => generated 399 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:38:48.641770 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4224e-1ef7-401d-8a5c-2796806cd8b7 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:38:48.657010 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4224e-1ef7-401d-8a5c-2796806cd8b7 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:38:48.720607 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea04ebd-89e0-4f7b-9022-9b6aba2de04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:38:48.721270 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea04ebd-89e0-4f7b-9022-9b6aba2de04f admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:48.721552 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea04ebd-89e0-4f7b-9022-9b6aba2de04f admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:48.722470 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea04ebd-89e0-4f7b-9022-9b6aba2de04f admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:48.722615 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea04ebd-89e0-4f7b-9022-9b6aba2de04f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:38:48.724450 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea04ebd-89e0-4f7b-9022-9b6aba2de04f admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:38:48.749447 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1426/2867] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:38:48 2022] POST /identity/v3/users => generated 300 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 04:38:48.750796 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1ddea-4f22-43e2-a6e9-1bfba0dab924 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:38:48.761779 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1ddea-4f22-43e2-a6e9-1bfba0dab924 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:38:48.767131 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ae3bd-32fd-4928-a231-11171b2a865e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:38:48.767833 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ae3bd-32fd-4928-a231-11171b2a865e admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:48.768112 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ae3bd-32fd-4928-a231-11171b2a865e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:48.768384 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ae3bd-32fd-4928-a231-11171b2a865e admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:48.769117 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ae3bd-32fd-4928-a231-11171b2a865e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:38:48.770762 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ae3bd-32fd-4928-a231-11171b2a865e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:38:48.783370 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1442/2868] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:38:48.787546 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea04ebd-89e0-4f7b-9022-9b6aba2de04f admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:38:48.798001 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea04ebd-89e0-4f7b-9022-9b6aba2de04f admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:38:48.802815 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726adca9-fb4d-487b-9ea5-cb53fea9b3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:38:48.803479 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726adca9-fb4d-487b-9ea5-cb53fea9b3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:48.803759 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726adca9-fb4d-487b-9ea5-cb53fea9b3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:48.804033 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726adca9-fb4d-487b-9ea5-cb53fea9b3f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:48.804761 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726adca9-fb4d-487b-9ea5-cb53fea9b3f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:38:48.806389 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726adca9-fb4d-487b-9ea5-cb53fea9b3f8 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:38:48.817917 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1427/2869] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:38:48.822836 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ae3bd-32fd-4928-a231-11171b2a865e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:38:48.833797 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ae3bd-32fd-4928-a231-11171b2a865e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:38:48.838724 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd13099-b573-4c30-a6fd-7514eb9999db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:38:48.839621 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd13099-b573-4c30-a6fd-7514eb9999db admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:48.839926 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd13099-b573-4c30-a6fd-7514eb9999db admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:48.840277 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd13099-b573-4c30-a6fd-7514eb9999db admin admin] PATH_INFO: `/v3/projects/dec9d5688db34d0794bcaab3c498b5b7/users/e7c0e08b724a4558974603ff39f51ecb/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:48.856881 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd13099-b573-4c30-a6fd-7514eb9999db admin admin] RBAC: Authorizing `identity:create_grant(project_id=dec9d5688db34d0794bcaab3c498b5b7, user_id=e7c0e08b724a4558974603ff39f51ecb, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:38:48.859600 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd13099-b573-4c30-a6fd-7514eb9999db admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:38:48.874443 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1443/2870] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:38:48 2022] PUT /identity/v3/projects/dec9d5688db34d0794bcaab3c498b5b7/users/e7c0e08b724a4558974603ff39f51ecb/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:38:48.886189 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda4015-be4b-477e-bbdc-a7ecaa2c623b None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:48.886482 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda4015-be4b-477e-bbdc-a7ecaa2c623b None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:48.886857 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda4015-be4b-477e-bbdc-a7ecaa2c623b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:48.916380 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-8cda4015-be4b-477e-bbdc-a7ecaa2c623b None None] MFA Rules not processed for user `e7c0e08b724a4558974603ff39f51ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:38:48.917535 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-8cda4015-be4b-477e-bbdc-a7ecaa2c623b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:38:48.989819 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1428/2871] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:38:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 04:38:49.001919 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd13099-b573-4c30-a6fd-7514eb9999db admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:38:49.003810 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0dd13099-b573-4c30-a6fd-7514eb9999db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:38:49.027881 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:38:49.067860 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd13099-b573-4c30-a6fd-7514eb9999db admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:38:49.072950 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71a9bd-ab34-4adb-965c-725159fe52d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1fbe41fbc1e4ac4964e3a5a417b6253', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:38:49.073638 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71a9bd-ab34-4adb-965c-725159fe52d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:49.073920 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71a9bd-ab34-4adb-965c-725159fe52d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:49.074225 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71a9bd-ab34-4adb-965c-725159fe52d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:49.087363 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71a9bd-ab34-4adb-965c-725159fe52d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:38:49.089097 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71a9bd-ab34-4adb-965c-725159fe52d0 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:38:49.099689 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1444/2872] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:38:49 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:38:54.105584 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda4015-be4b-477e-bbdc-a7ecaa2c623b None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:38:54.124574 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:38:54.171931 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda4015-be4b-477e-bbdc-a7ecaa2c623b None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:38:54.176405 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca519d2a-7164-4739-afa1-8a686b50297b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:38:54.177267 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca519d2a-7164-4739-afa1-8a686b50297b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:54.177552 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca519d2a-7164-4739-afa1-8a686b50297b admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:54.177831 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca519d2a-7164-4739-afa1-8a686b50297b admin admin] PATH_INFO: `/v3/users/e7c0e08b724a4558974603ff39f51ecb` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:54.179064 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca519d2a-7164-4739-afa1-8a686b50297b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7c0e08b724a4558974603ff39f51ecb)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:38:54.180987 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca519d2a-7164-4739-afa1-8a686b50297b admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:38:54.229319 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ca519d2a-7164-4739-afa1-8a686b50297b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7c0e08b724a4558974603ff39f51ecb'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:54.230006 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ca519d2a-7164-4739-afa1-8a686b50297b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7c0e08b724a4558974603ff39f51ecb'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:54.242456 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ca519d2a-7164-4739-afa1-8a686b50297b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7c0e08b724a4558974603ff39f51ecb'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:54.250068 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ca519d2a-7164-4739-afa1-8a686b50297b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7c0e08b724a4558974603ff39f51ecb'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:54.257865 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ca519d2a-7164-4739-afa1-8a686b50297b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7c0e08b724a4558974603ff39f51ecb'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:54.265206 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1429/2873] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:38:54 2022] DELETE /identity/v3/users/e7c0e08b724a4558974603ff39f51ecb => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:38:54.269755 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8bc75-bd88-484b-ad53-f3891d7bb1e5 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:54.270313 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8bc75-bd88-484b-ad53-f3891d7bb1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:54.270423 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8bc75-bd88-484b-ad53-f3891d7bb1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:54.288017 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-8fe8bc75-bd88-484b-ad53-f3891d7bb1e5 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:38:54.289248 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8fe8bc75-bd88-484b-ad53-f3891d7bb1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:38:54.351419 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1445/2874] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:38:54.361083 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca519d2a-7164-4739-afa1-8a686b50297b admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:38:54.362540 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-ca519d2a-7164-4739-afa1-8a686b50297b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:38:54.427225 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca519d2a-7164-4739-afa1-8a686b50297b admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:38:54.430943 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843e8a2-81d8-4229-bc16-d9c7f78a4a84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:38:54.431620 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843e8a2-81d8-4229-bc16-d9c7f78a4a84 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:54.431900 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843e8a2-81d8-4229-bc16-d9c7f78a4a84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:54.432218 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843e8a2-81d8-4229-bc16-d9c7f78a4a84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:54.442262 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843e8a2-81d8-4229-bc16-d9c7f78a4a84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:38:54.443690 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843e8a2-81d8-4229-bc16-d9c7f78a4a84 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:38:54.453831 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1430/2875] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:38:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 04:38:54.727051 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8bc75-bd88-484b-ad53-f3891d7bb1e5 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:38:54.728483 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8fe8bc75-bd88-484b-ad53-f3891d7bb1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:38:54.741952 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8bc75-bd88-484b-ad53-f3891d7bb1e5 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:38:54.746785 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822935e-5017-4a86-a340-9b6fc59773e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:38:54.747644 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822935e-5017-4a86-a340-9b6fc59773e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:54.747926 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822935e-5017-4a86-a340-9b6fc59773e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:54.748198 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822935e-5017-4a86-a340-9b6fc59773e1 admin admin] PATH_INFO: `/v3/projects/dec9d5688db34d0794bcaab3c498b5b7` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:54.749996 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822935e-5017-4a86-a340-9b6fc59773e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dec9d5688db34d0794bcaab3c498b5b7)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:38:54.752008 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822935e-5017-4a86-a340-9b6fc59773e1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:38:54.935313 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7822935e-5017-4a86-a340-9b6fc59773e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dec9d5688db34d0794bcaab3c498b5b7', 'request_id': 'req-7822935e-5017-4a86-a340-9b6fc59773e1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:54.942828 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7822935e-5017-4a86-a340-9b6fc59773e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dec9d5688db34d0794bcaab3c498b5b7', 'request_id': 'req-7822935e-5017-4a86-a340-9b6fc59773e1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:54.951796 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7822935e-5017-4a86-a340-9b6fc59773e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dec9d5688db34d0794bcaab3c498b5b7', 'request_id': 'req-7822935e-5017-4a86-a340-9b6fc59773e1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:54.965821 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7822935e-5017-4a86-a340-9b6fc59773e1 admin admin] The token cache is being invalidate because project dec9d5688db34d0794bcaab3c498b5b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:38:54.966141 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7822935e-5017-4a86-a340-9b6fc59773e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:54.966795 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7822935e-5017-4a86-a340-9b6fc59773e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:38:54.968389 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1446/2876] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:38:54 2022] DELETE /identity/v3/projects/dec9d5688db34d0794bcaab3c498b5b7 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:38:54.973836 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc42aec-e5f1-4a1f-85e1-dd0374c8e5c7 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:54.974192 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc42aec-e5f1-4a1f-85e1-dd0374c8e5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:54.974502 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc42aec-e5f1-4a1f-85e1-dd0374c8e5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:54.992991 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-4bc42aec-e5f1-4a1f-85e1-dd0374c8e5c7 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:38:54.994247 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-4bc42aec-e5f1-4a1f-85e1-dd0374c8e5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:38:55.032456 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:38:55.062500 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1431/2877] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:38:55.070607 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af1ab0-28ad-464e-9d2b-e15a67b00aee None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:55.071155 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af1ab0-28ad-464e-9d2b-e15a67b00aee None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:55.071441 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af1ab0-28ad-464e-9d2b-e15a67b00aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:55.091838 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b8af1ab0-28ad-464e-9d2b-e15a67b00aee None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:38:55.093057 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b8af1ab0-28ad-464e-9d2b-e15a67b00aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:38:55.101113 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1447/2878] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:38:55.106570 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc42aec-e5f1-4a1f-85e1-dd0374c8e5c7 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:38:55.116398 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc42aec-e5f1-4a1f-85e1-dd0374c8e5c7 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:38:55.121317 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7aef49-1bf5-4587-8e80-b514ab0b4769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:38:55.122003 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7aef49-1bf5-4587-8e80-b514ab0b4769 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:55.122291 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7aef49-1bf5-4587-8e80-b514ab0b4769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:55.122568 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7aef49-1bf5-4587-8e80-b514ab0b4769 admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:55.123289 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7aef49-1bf5-4587-8e80-b514ab0b4769 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 04:38:55.124102 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7aef49-1bf5-4587-8e80-b514ab0b4769 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:38:55.125711 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7aef49-1bf5-4587-8e80-b514ab0b4769 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:38:55.138137 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1432/2879] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Jun 1 04:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 04:38:55.143208 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af1ab0-28ad-464e-9d2b-e15a67b00aee None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:38:55.152910 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af1ab0-28ad-464e-9d2b-e15a67b00aee None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:38:55.157547 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54893b94-57b5-438b-9904-80d363fa150e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:38:55.158241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54893b94-57b5-438b-9904-80d363fa150e admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:55.158524 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54893b94-57b5-438b-9904-80d363fa150e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:55.159291 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54893b94-57b5-438b-9904-80d363fa150e admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:55.159493 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54893b94-57b5-438b-9904-80d363fa150e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:38:55.161411 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54893b94-57b5-438b-9904-80d363fa150e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:38:55.188216 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1448/2880] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:38:55 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:38:55.194156 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7aef49-1bf5-4587-8e80-b514ab0b4769 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:38:55.204527 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7aef49-1bf5-4587-8e80-b514ab0b4769 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:38:55.261535 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b7345-f317-4882-8591-10cdb1ab332b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:38:55.262270 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b7345-f317-4882-8591-10cdb1ab332b admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:55.262555 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b7345-f317-4882-8591-10cdb1ab332b admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:55.262843 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b7345-f317-4882-8591-10cdb1ab332b admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:55.263535 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b7345-f317-4882-8591-10cdb1ab332b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:38:55.265993 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b7345-f317-4882-8591-10cdb1ab332b admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:38:55.286077 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1433/2881] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:38:55 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:38:55.290631 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54893b94-57b5-438b-9904-80d363fa150e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:38:55.301429 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54893b94-57b5-438b-9904-80d363fa150e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:38:55.306089 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af8d1d-00d1-4dc6-aead-35dfa4a80dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:38:55.306748 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af8d1d-00d1-4dc6-aead-35dfa4a80dcb admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:55.307027 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af8d1d-00d1-4dc6-aead-35dfa4a80dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:55.307299 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af8d1d-00d1-4dc6-aead-35dfa4a80dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:55.308016 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af8d1d-00d1-4dc6-aead-35dfa4a80dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:38:55.309583 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af8d1d-00d1-4dc6-aead-35dfa4a80dcb admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:38:55.320375 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1449/2882] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:38:55.324635 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b7345-f317-4882-8591-10cdb1ab332b admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:38:55.335644 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b7345-f317-4882-8591-10cdb1ab332b admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:38:55.340456 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e2835-cd3e-47da-a8c7-d9e9738d6b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:38:55.341123 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e2835-cd3e-47da-a8c7-d9e9738d6b2e admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:55.341412 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e2835-cd3e-47da-a8c7-d9e9738d6b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:55.341695 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e2835-cd3e-47da-a8c7-d9e9738d6b2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:55.342546 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e2835-cd3e-47da-a8c7-d9e9738d6b2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:38:55.344703 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e2835-cd3e-47da-a8c7-d9e9738d6b2e admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:38:55.357370 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1434/2883] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:38:55.361993 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af8d1d-00d1-4dc6-aead-35dfa4a80dcb admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:38:55.371790 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af8d1d-00d1-4dc6-aead-35dfa4a80dcb admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:38:55.376389 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661520b1-c30f-4c6d-ba91-326a092f4cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:38:55.377270 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661520b1-c30f-4c6d-ba91-326a092f4cb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:55.377547 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661520b1-c30f-4c6d-ba91-326a092f4cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:55.377816 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661520b1-c30f-4c6d-ba91-326a092f4cb8 admin admin] PATH_INFO: `/v3/projects/2c8853f28e054be9b704f36c811b8d9c/users/9ccaae7ef80a4e9683f13b99f02c6ccd/roles/3f08ec4046094d04a533ba522f71ba9a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:55.380315 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:38:55.396904 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661520b1-c30f-4c6d-ba91-326a092f4cb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c8853f28e054be9b704f36c811b8d9c, user_id=9ccaae7ef80a4e9683f13b99f02c6ccd, role_id=3f08ec4046094d04a533ba522f71ba9a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:38:55.399640 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661520b1-c30f-4c6d-ba91-326a092f4cb8 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:38:55.413299 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1450/2884] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:38:55 2022] PUT /identity/v3/projects/2c8853f28e054be9b704f36c811b8d9c/users/9ccaae7ef80a4e9683f13b99f02c6ccd/roles/3f08ec4046094d04a533ba522f71ba9a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:38:55.419222 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29858191-c300-4e97-aad9-41acb904e470 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:55.419516 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29858191-c300-4e97-aad9-41acb904e470 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:55.419801 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29858191-c300-4e97-aad9-41acb904e470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:55.439008 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-29858191-c300-4e97-aad9-41acb904e470 None None] MFA Rules not processed for user `9d7c60c25057425ca69e91e85691a580`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:38:55.440127 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-29858191-c300-4e97-aad9-41acb904e470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:38:55.500615 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1435/2885] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:38:55.510381 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661520b1-c30f-4c6d-ba91-326a092f4cb8 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:38:55.512170 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-661520b1-c30f-4c6d-ba91-326a092f4cb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:38:55.570601 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661520b1-c30f-4c6d-ba91-326a092f4cb8 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:38:55.574625 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab5608-2595-4dde-a6f2-961f39544770 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:38:55.575302 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab5608-2595-4dde-a6f2-961f39544770 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:55.575581 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab5608-2595-4dde-a6f2-961f39544770 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:55.575853 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab5608-2595-4dde-a6f2-961f39544770 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:55.587683 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab5608-2595-4dde-a6f2-961f39544770 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:38:55.589156 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab5608-2595-4dde-a6f2-961f39544770 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:38:55.599457 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1451/2886] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:38:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:38:59.845046 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1ae0c-c0c6-471b-aff8-0e6fb26a0aed None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:59.845560 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1ae0c-c0c6-471b-aff8-0e6fb26a0aed None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:59.845838 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1ae0c-c0c6-471b-aff8-0e6fb26a0aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:59.873770 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-73e1ae0c-c0c6-471b-aff8-0e6fb26a0aed None None] MFA Rules not processed for user `9ccaae7ef80a4e9683f13b99f02c6ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:38:59.874950 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-73e1ae0c-c0c6-471b-aff8-0e6fb26a0aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:38:59.918460 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:38:59.957606 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1436/2887] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:38:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:38:59.962241 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab5608-2595-4dde-a6f2-961f39544770 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:38:59.972797 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab5608-2595-4dde-a6f2-961f39544770 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:38:59.977618 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5a02b-30b2-492c-b01b-5796ac9679d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:38:59.978314 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5a02b-30b2-492c-b01b-5796ac9679d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:38:59.978604 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5a02b-30b2-492c-b01b-5796ac9679d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:38:59.978883 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5a02b-30b2-492c-b01b-5796ac9679d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:38:59.979578 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5a02b-30b2-492c-b01b-5796ac9679d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:38:59.981496 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5a02b-30b2-492c-b01b-5796ac9679d7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:39:00.015760 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1452/2888] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Jun 1 04:38:59 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:39:00.019753 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1ae0c-c0c6-471b-aff8-0e6fb26a0aed None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:39:00.030960 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1ae0c-c0c6-471b-aff8-0e6fb26a0aed None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:39:00.095788 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0406a2-87cf-43cd-8b8f-740fdf9e393e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:39:00.096468 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0406a2-87cf-43cd-8b8f-740fdf9e393e admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:39:00.096751 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0406a2-87cf-43cd-8b8f-740fdf9e393e admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:39:00.098327 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0406a2-87cf-43cd-8b8f-740fdf9e393e admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:39:00.099058 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0406a2-87cf-43cd-8b8f-740fdf9e393e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:39:00.101004 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0406a2-87cf-43cd-8b8f-740fdf9e393e admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:39:00.125238 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1437/2889] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Jun 1 04:39:00 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 04:39:00.126393 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5a02b-30b2-492c-b01b-5796ac9679d7 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:39:00.142924 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5a02b-30b2-492c-b01b-5796ac9679d7 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:39:00.149890 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf65b92-e8f8-49f6-a4d2-b76732158357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:39:00.150634 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf65b92-e8f8-49f6-a4d2-b76732158357 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:39:00.150918 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf65b92-e8f8-49f6-a4d2-b76732158357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:39:00.151199 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf65b92-e8f8-49f6-a4d2-b76732158357 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:39:00.151949 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf65b92-e8f8-49f6-a4d2-b76732158357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:39:00.153660 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf65b92-e8f8-49f6-a4d2-b76732158357 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:39:00.165595 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1453/2890] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:39:00.170086 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0406a2-87cf-43cd-8b8f-740fdf9e393e admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:39:00.181646 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0406a2-87cf-43cd-8b8f-740fdf9e393e admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:39:00.187535 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c478d-8991-441b-ad73-b5e78bdb80ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:39:00.188594 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c478d-8991-441b-ad73-b5e78bdb80ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:39:00.189001 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c478d-8991-441b-ad73-b5e78bdb80ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:39:00.189306 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c478d-8991-441b-ad73-b5e78bdb80ab admin admin] PATH_INFO: `/v3/projects/883da8cd1e94493eb4b97a6dd80a057f/users/97382973092f447fbe0aaa4beeb764c9/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:39:00.206433 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c478d-8991-441b-ad73-b5e78bdb80ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=883da8cd1e94493eb4b97a6dd80a057f, user_id=97382973092f447fbe0aaa4beeb764c9, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:39:00.209082 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c478d-8991-441b-ad73-b5e78bdb80ab admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:39:00.223184 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1438/2891] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:39:00 2022] PUT /identity/v3/projects/883da8cd1e94493eb4b97a6dd80a057f/users/97382973092f447fbe0aaa4beeb764c9/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:39:00.227287 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf65b92-e8f8-49f6-a4d2-b76732158357 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:39:00.237429 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf65b92-e8f8-49f6-a4d2-b76732158357 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:39:00.298115 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22719175-9f37-489c-ac6e-03ee8a52fac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:39:00.298940 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22719175-9f37-489c-ac6e-03ee8a52fac7 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:39:00.299284 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22719175-9f37-489c-ac6e-03ee8a52fac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:39:00.299824 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22719175-9f37-489c-ac6e-03ee8a52fac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:39:00.300567 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22719175-9f37-489c-ac6e-03ee8a52fac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:39:00.302380 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22719175-9f37-489c-ac6e-03ee8a52fac7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:39:00.313930 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1454/2892] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Jun 1 04:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 04:39:00.317822 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c478d-8991-441b-ad73-b5e78bdb80ab admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:39:00.329185 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c478d-8991-441b-ad73-b5e78bdb80ab admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:39:00.333935 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781805ce-8d7f-4623-90a3-314ee0bd96d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:39:00.334861 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781805ce-8d7f-4623-90a3-314ee0bd96d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:39:00.335142 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781805ce-8d7f-4623-90a3-314ee0bd96d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:39:00.335419 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781805ce-8d7f-4623-90a3-314ee0bd96d4 admin admin] PATH_INFO: `/v3/projects/883da8cd1e94493eb4b97a6dd80a057f/users/97382973092f447fbe0aaa4beeb764c9/roles/76fc054ad9544460a7be1e2010c23642` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:39:00.337351 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781805ce-8d7f-4623-90a3-314ee0bd96d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=883da8cd1e94493eb4b97a6dd80a057f, user_id=97382973092f447fbe0aaa4beeb764c9, role_id=76fc054ad9544460a7be1e2010c23642)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:39:00.340012 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781805ce-8d7f-4623-90a3-314ee0bd96d4 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:39:00.350540 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1439/2893] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Jun 1 04:39:00 2022] PUT /identity/v3/projects/883da8cd1e94493eb4b97a6dd80a057f/users/97382973092f447fbe0aaa4beeb764c9/roles/76fc054ad9544460a7be1e2010c23642 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:39:04.914244 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539732c4-3fa5-40b0-8229-28c2e77e6095 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:39:04.914869 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539732c4-3fa5-40b0-8229-28c2e77e6095 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:39:04.914869 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539732c4-3fa5-40b0-8229-28c2e77e6095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:39:04.943733 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-539732c4-3fa5-40b0-8229-28c2e77e6095 None None] MFA Rules not processed for user `97382973092f447fbe0aaa4beeb764c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:39:04.944961 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-539732c4-3fa5-40b0-8229-28c2e77e6095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:39:04.995811 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:39:05.036540 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1455/2894] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:39:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:39:05.053341 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781805ce-8d7f-4623-90a3-314ee0bd96d4 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:39:05.055284 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-781805ce-8d7f-4623-90a3-314ee0bd96d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:39:05.136298 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781805ce-8d7f-4623-90a3-314ee0bd96d4 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:39:05.142073 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942fbc1-4ed5-4f1e-87a6-1d3e93838ac4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:39:05.142730 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942fbc1-4ed5-4f1e-87a6-1d3e93838ac4 service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:39:05.143168 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942fbc1-4ed5-4f1e-87a6-1d3e93838ac4 service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:39:05.143453 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942fbc1-4ed5-4f1e-87a6-1d3e93838ac4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:39:05.170797 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:39:05.224909 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942fbc1-4ed5-4f1e-87a6-1d3e93838ac4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:39:05.226550 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942fbc1-4ed5-4f1e-87a6-1d3e93838ac4 service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:39:05.238077 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1440/2895] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:39:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:39:06.259478 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7eff8b-8d4d-4ae9-9dda-3cb7acab30eb None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:39:06.260386 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7eff8b-8d4d-4ae9-9dda-3cb7acab30eb None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:39:06.260566 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7eff8b-8d4d-4ae9-9dda-3cb7acab30eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:39:06.279229 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-6e7eff8b-8d4d-4ae9-9dda-3cb7acab30eb None None] MFA Rules not processed for user `9ccaae7ef80a4e9683f13b99f02c6ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:39:06.280570 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6e7eff8b-8d4d-4ae9-9dda-3cb7acab30eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:39:06.287982 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1456/2896] 10.222.0.32 () {58 vars in 957 bytes} [Wed Jun 1 04:39:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:39:15.231378 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=16 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:39:16.273390 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=15 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:39:20.690044 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942fbc1-4ed5-4f1e-87a6-1d3e93838ac4 service nova] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:39:20.763029 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942fbc1-4ed5-4f1e-87a6-1d3e93838ac4 service nova] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:39:20.767206 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba8bec-8622-44bb-b87e-c78d14872084 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:39:20.767843 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba8bec-8622-44bb-b87e-c78d14872084 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:39:20.768130 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba8bec-8622-44bb-b87e-c78d14872084 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:39:20.768410 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba8bec-8622-44bb-b87e-c78d14872084 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:39:20.770235 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-44ba8bec-8622-44bb-b87e-c78d14872084 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:39:20.790084 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba8bec-8622-44bb-b87e-c78d14872084 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:39:20.791510 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba8bec-8622-44bb-b87e-c78d14872084 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:39:20.799470 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1441/2897] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:39:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:39:22.242758 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7eff8b-8d4d-4ae9-9dda-3cb7acab30eb None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:39:22.244130 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6e7eff8b-8d4d-4ae9-9dda-3cb7acab30eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:39:22.345940 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7eff8b-8d4d-4ae9-9dda-3cb7acab30eb None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:39:22.351365 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c0f72-67db-4908-b270-4c07bc2e6a28 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0433f6219478476286ea27c5c82d41a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:39:22.352016 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c0f72-67db-4908-b270-4c07bc2e6a28 service placement] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:39:22.352301 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c0f72-67db-4908-b270-4c07bc2e6a28 service placement] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:39:22.352578 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c0f72-67db-4908-b270-4c07bc2e6a28 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:39:22.354962 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e92c0f72-67db-4908-b270-4c07bc2e6a28 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:39:22.367481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c0f72-67db-4908-b270-4c07bc2e6a28 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:39:22.369037 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c0f72-67db-4908-b270-4c07bc2e6a28 service placement] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:39:22.379461 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1457/2898] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:39:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:39:28.109556 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba8bec-8622-44bb-b87e-c78d14872084 service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:39:28.125283 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-44ba8bec-8622-44bb-b87e-c78d14872084 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:39:28.155919 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba8bec-8622-44bb-b87e-c78d14872084 service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:39:28.162151 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d47ac8-4866-4ef4-bbb9-e310104827ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:39:28.162983 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d47ac8-4866-4ef4-bbb9-e310104827ef service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:39:28.163374 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d47ac8-4866-4ef4-bbb9-e310104827ef service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:39:28.163757 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d47ac8-4866-4ef4-bbb9-e310104827ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:39:28.166027 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-11d47ac8-4866-4ef4-bbb9-e310104827ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:39:28.181235 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d47ac8-4866-4ef4-bbb9-e310104827ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:39:28.183020 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d47ac8-4866-4ef4-bbb9-e310104827ef service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:39:28.196185 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1442/2899] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:39:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:39:32.375232 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=47 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:39:33.529598 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c0f72-67db-4908-b270-4c07bc2e6a28 service placement] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:39:33.544101 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c0f72-67db-4908-b270-4c07bc2e6a28 service placement] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:39:33.550486 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea7127-b389-4fee-8a5f-4961ae04f790 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:39:33.551323 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea7127-b389-4fee-8a5f-4961ae04f790 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:39:33.551481 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea7127-b389-4fee-8a5f-4961ae04f790 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:39:33.551694 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea7127-b389-4fee-8a5f-4961ae04f790 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:39:33.554093 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6dea7127-b389-4fee-8a5f-4961ae04f790 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:39:33.573827 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea7127-b389-4fee-8a5f-4961ae04f790 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:39:33.583767 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea7127-b389-4fee-8a5f-4961ae04f790 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:39:33.609470 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1458/2900] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:39:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:39:36.417241 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d47ac8-4866-4ef4-bbb9-e310104827ef service nova] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:39:36.446322 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d47ac8-4866-4ef4-bbb9-e310104827ef service nova] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:39:36.450201 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae182c72-1789-47d7-a3a5-8229c43a40a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:39:36.450854 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae182c72-1789-47d7-a3a5-8229c43a40a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:39:36.451136 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae182c72-1789-47d7-a3a5-8229c43a40a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:39:36.451605 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae182c72-1789-47d7-a3a5-8229c43a40a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:39:36.462675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae182c72-1789-47d7-a3a5-8229c43a40a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:39:36.464159 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae182c72-1789-47d7-a3a5-8229c43a40a2 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:39:36.475994 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1443/2901] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:39:36 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:39:38.427787 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea7127-b389-4fee-8a5f-4961ae04f790 service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:39:38.441381 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea7127-b389-4fee-8a5f-4961ae04f790 service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:39:38.448516 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdd595-ebaa-4645-8a15-3327d02b8dec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d614f85f5541d3babbb41468cbf55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:39:38.449423 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdd595-ebaa-4645-8a15-3327d02b8dec service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:39:38.450125 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdd595-ebaa-4645-8a15-3327d02b8dec service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:39:38.450517 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdd595-ebaa-4645-8a15-3327d02b8dec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:39:38.452936 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b1fdd595-ebaa-4645-8a15-3327d02b8dec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:39:38.469244 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fdd595-ebaa-4645-8a15-3327d02b8dec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:39:38.470962 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fdd595-ebaa-4645-8a15-3327d02b8dec service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:39:38.484233 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1459/2902] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:39:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:39:46.470990 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=55 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:39:48.478284 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=12 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:41:40.049500 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae182c72-1789-47d7-a3a5-8229c43a40a2 service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:41:40.074335 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae182c72-1789-47d7-a3a5-8229c43a40a2 service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:41:40.079379 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0643814-149a-4484-ac3c-02400779f405 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0433f6219478476286ea27c5c82d41a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:41:40.080025 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0643814-149a-4484-ac3c-02400779f405 service placement] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:41:40.080304 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0643814-149a-4484-ac3c-02400779f405 service placement] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:41:40.080578 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0643814-149a-4484-ac3c-02400779f405 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:41:40.082656 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c0643814-149a-4484-ac3c-02400779f405 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:41:40.108788 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0643814-149a-4484-ac3c-02400779f405 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:41:40.110481 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0643814-149a-4484-ac3c-02400779f405 service placement] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:41:40.121478 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1444/2903] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:41:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:41:48.542571 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd051904-459a-4963-b342-ddad302b05b6 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:41:48.543190 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd051904-459a-4963-b342-ddad302b05b6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:41:48.543190 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd051904-459a-4963-b342-ddad302b05b6 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:41:48.544792 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1460/2904] 10.222.0.32 () {54 vars in 921 bytes} [Wed Jun 1 04:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:41:48.551684 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39d49d-cf0e-4501-9a02-7254330011c1 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:41:48.552941 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39d49d-cf0e-4501-9a02-7254330011c1 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:41:48.552941 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39d49d-cf0e-4501-9a02-7254330011c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:41:48.637443 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-db39d49d-cf0e-4501-9a02-7254330011c1 None None] MFA Rules not processed for user `dca5f9455ef349738adf4569fe5ed165`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:41:48.638793 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-db39d49d-cf0e-4501-9a02-7254330011c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:41:48.646417 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1445/2905] 10.222.0.32 () {58 vars in 1018 bytes} [Wed Jun 1 04:41:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:41:48.658379 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd051904-459a-4963-b342-ddad302b05b6 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:41:48.660167 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-bd051904-459a-4963-b342-ddad302b05b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:41:48.674224 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd051904-459a-4963-b342-ddad302b05b6 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:41:48.678536 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf80e69-79d8-4367-9b82-8bb02835daa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:41:48.679296 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf80e69-79d8-4367-9b82-8bb02835daa9 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:41:48.679561 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf80e69-79d8-4367-9b82-8bb02835daa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:41:48.679841 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf80e69-79d8-4367-9b82-8bb02835daa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:41:48.687736 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf80e69-79d8-4367-9b82-8bb02835daa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:41:48.689171 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf80e69-79d8-4367-9b82-8bb02835daa9 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:41:48.697547 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1461/2906] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:41:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:41:48.784599 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b77e8-5fa3-4c61-b526-3278ffe30371 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:41:48.784895 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b77e8-5fa3-4c61-b526-3278ffe30371 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:41:48.785207 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b77e8-5fa3-4c61-b526-3278ffe30371 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:41:48.787163 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1446/2907] 10.222.0.32 () {54 vars in 921 bytes} [Wed Jun 1 04:41:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 04:41:48.792795 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025f355-4a56-4ff1-afcc-fda5f105e73e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:41:48.793084 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025f355-4a56-4ff1-afcc-fda5f105e73e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:41:48.793361 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025f355-4a56-4ff1-afcc-fda5f105e73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:41:48.844040 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-6025f355-4a56-4ff1-afcc-fda5f105e73e None None] MFA Rules not processed for user `79d614f85f5541d3babbb41468cbf55c`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 04:41:48.845253 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6025f355-4a56-4ff1-afcc-fda5f105e73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:41:48.872382 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1462/2908] 10.222.0.32 () {58 vars in 1018 bytes} [Wed Jun 1 04:41:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 04:41:48.883264 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b77e8-5fa3-4c61-b526-3278ffe30371 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:41:48.894169 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b77e8-5fa3-4c61-b526-3278ffe30371 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:41:48.898495 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74833f-48c5-48b5-9f4f-b05cf5930c1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:41:48.899138 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74833f-48c5-48b5-9f4f-b05cf5930c1b service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:41:48.899422 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74833f-48c5-48b5-9f4f-b05cf5930c1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:41:48.899699 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74833f-48c5-48b5-9f4f-b05cf5930c1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:41:48.910579 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74833f-48c5-48b5-9f4f-b05cf5930c1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:41:48.912609 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74833f-48c5-48b5-9f4f-b05cf5930c1b service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:41:48.924780 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1447/2909] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:41:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:41:58.869323 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=27 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:41:58.919507 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=43 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:43:13.942239 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025f355-4a56-4ff1-afcc-fda5f105e73e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:43:13.954744 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025f355-4a56-4ff1-afcc-fda5f105e73e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:43:13.959538 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31d16e-d478-4ea7-a85c-b0f4f4ae715a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:43:13.960147 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31d16e-d478-4ea7-a85c-b0f4f4ae715a service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:43:13.960431 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31d16e-d478-4ea7-a85c-b0f4f4ae715a service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:43:13.960706 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31d16e-d478-4ea7-a85c-b0f4f4ae715a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:43:13.962867 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1f31d16e-d478-4ea7-a85c-b0f4f4ae715a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:43:13.976189 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f31d16e-d478-4ea7-a85c-b0f4f4ae715a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:43:13.978222 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f31d16e-d478-4ea7-a85c-b0f4f4ae715a service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:43:13.988304 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1463/2910] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:43:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:43:14.024562 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74833f-48c5-48b5-9f4f-b05cf5930c1b service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:43:14.034993 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74833f-48c5-48b5-9f4f-b05cf5930c1b service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:43:14.038708 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945b6e1-40b6-4d79-9fcb-b6c726c7049b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:43:14.039356 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945b6e1-40b6-4d79-9fcb-b6c726c7049b service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:43:14.039637 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945b6e1-40b6-4d79-9fcb-b6c726c7049b service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:43:14.039921 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945b6e1-40b6-4d79-9fcb-b6c726c7049b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:43:14.041772 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f945b6e1-40b6-4d79-9fcb-b6c726c7049b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:43:14.055881 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945b6e1-40b6-4d79-9fcb-b6c726c7049b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:43:14.057334 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945b6e1-40b6-4d79-9fcb-b6c726c7049b service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:43:14.069455 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1448/2911] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:43:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:43:15.264470 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31d16e-d478-4ea7-a85c-b0f4f4ae715a service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:43:15.279731 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31d16e-d478-4ea7-a85c-b0f4f4ae715a service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:43:15.285943 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd252c-195a-4b35-a092-e8c369c4321e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca5f9455ef349738adf4569fe5ed165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:43:15.287098 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd252c-195a-4b35-a092-e8c369c4321e service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:43:15.287402 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd252c-195a-4b35-a092-e8c369c4321e service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:43:15.287728 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd252c-195a-4b35-a092-e8c369c4321e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:43:15.290114 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f7cd252c-195a-4b35-a092-e8c369c4321e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:43:15.309834 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd252c-195a-4b35-a092-e8c369c4321e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:43:15.311330 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd252c-195a-4b35-a092-e8c369c4321e service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:43:15.324653 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1464/2912] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:43:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:43:23.688356 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945b6e1-40b6-4d79-9fcb-b6c726c7049b service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:43:23.701680 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945b6e1-40b6-4d79-9fcb-b6c726c7049b service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:43:23.721991 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389f030-6bfd-4b26-9a39-a422280aa8da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0433f6219478476286ea27c5c82d41a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:43:23.723124 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389f030-6bfd-4b26-9a39-a422280aa8da service placement] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:43:23.723862 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389f030-6bfd-4b26-9a39-a422280aa8da service placement] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:43:23.724610 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389f030-6bfd-4b26-9a39-a422280aa8da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:43:23.727875 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-1389f030-6bfd-4b26-9a39-a422280aa8da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:43:23.742767 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389f030-6bfd-4b26-9a39-a422280aa8da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:43:23.744899 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389f030-6bfd-4b26-9a39-a422280aa8da service placement] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:43:23.759196 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1449/2913] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:43:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:43:23.780669 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd252c-195a-4b35-a092-e8c369c4321e service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:43:23.892823 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd252c-195a-4b35-a092-e8c369c4321e service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:43:23.898013 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7bebc-ab98-4d27-b888-eebccaf9250e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:43:23.898957 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7bebc-ab98-4d27-b888-eebccaf9250e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:43:23.899867 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7bebc-ab98-4d27-b888-eebccaf9250e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:43:23.900214 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7bebc-ab98-4d27-b888-eebccaf9250e admin admin] PATH_INFO: `/v3/users/9ccaae7ef80a4e9683f13b99f02c6ccd` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:43:23.901474 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7bebc-ab98-4d27-b888-eebccaf9250e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ccaae7ef80a4e9683f13b99f02c6ccd)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:43:23.903652 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7bebc-ab98-4d27-b888-eebccaf9250e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:43:23.958198 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cdf7bebc-ab98-4d27-b888-eebccaf9250e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ccaae7ef80a4e9683f13b99f02c6ccd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:43:23.958815 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cdf7bebc-ab98-4d27-b888-eebccaf9250e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ccaae7ef80a4e9683f13b99f02c6ccd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:43:23.971891 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cdf7bebc-ab98-4d27-b888-eebccaf9250e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ccaae7ef80a4e9683f13b99f02c6ccd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:43:23.980590 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cdf7bebc-ab98-4d27-b888-eebccaf9250e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ccaae7ef80a4e9683f13b99f02c6ccd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:43:23.981562 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cdf7bebc-ab98-4d27-b888-eebccaf9250e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ccaae7ef80a4e9683f13b99f02c6ccd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:43:23.996892 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1465/2914] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:43:23 2022] DELETE /identity/v3/users/9ccaae7ef80a4e9683f13b99f02c6ccd => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:43:24.176453 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389f030-6bfd-4b26-9a39-a422280aa8da service placement] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:43:24.187741 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389f030-6bfd-4b26-9a39-a422280aa8da service placement] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:43:24.246003 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd649d2-7480-4c1e-a3b3-a82e583cdee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:43:24.246874 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd649d2-7480-4c1e-a3b3-a82e583cdee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:43:24.247153 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd649d2-7480-4c1e-a3b3-a82e583cdee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:43:24.247430 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd649d2-7480-4c1e-a3b3-a82e583cdee9 admin admin] PATH_INFO: `/v3/projects/2c8853f28e054be9b704f36c811b8d9c` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:43:24.248625 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd649d2-7480-4c1e-a3b3-a82e583cdee9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c8853f28e054be9b704f36c811b8d9c)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:43:24.250585 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd649d2-7480-4c1e-a3b3-a82e583cdee9 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:43:24.297641 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-1dd649d2-7480-4c1e-a3b3-a82e583cdee9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c8853f28e054be9b704f36c811b8d9c', 'request_id': 'req-1dd649d2-7480-4c1e-a3b3-a82e583cdee9'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:43:24.304942 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-1dd649d2-7480-4c1e-a3b3-a82e583cdee9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c8853f28e054be9b704f36c811b8d9c', 'request_id': 'req-1dd649d2-7480-4c1e-a3b3-a82e583cdee9'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:43:24.311023 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-1dd649d2-7480-4c1e-a3b3-a82e583cdee9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c8853f28e054be9b704f36c811b8d9c', 'request_id': 'req-1dd649d2-7480-4c1e-a3b3-a82e583cdee9'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:43:24.335389 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-1dd649d2-7480-4c1e-a3b3-a82e583cdee9 admin admin] The token cache is being invalidate because project 2c8853f28e054be9b704f36c811b8d9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:43:24.335665 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-1dd649d2-7480-4c1e-a3b3-a82e583cdee9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:43:24.336307 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-1dd649d2-7480-4c1e-a3b3-a82e583cdee9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:43:24.337839 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1450/2915] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:43:24 2022] DELETE /identity/v3/projects/2c8853f28e054be9b704f36c811b8d9c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:43:24.341796 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7bebc-ab98-4d27-b888-eebccaf9250e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:43:24.343382 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cdf7bebc-ab98-4d27-b888-eebccaf9250e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:43:24.356073 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7bebc-ab98-4d27-b888-eebccaf9250e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:43:24.388567 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:43:24.413524 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34960381-533e-47dc-bf9f-2bd843f2e3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:43:24.414408 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34960381-533e-47dc-bf9f-2bd843f2e3e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:43:24.415210 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34960381-533e-47dc-bf9f-2bd843f2e3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:43:24.415480 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34960381-533e-47dc-bf9f-2bd843f2e3e3 admin admin] PATH_INFO: `/v3/users/97382973092f447fbe0aaa4beeb764c9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:43:24.416760 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34960381-533e-47dc-bf9f-2bd843f2e3e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97382973092f447fbe0aaa4beeb764c9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:43:24.418691 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34960381-533e-47dc-bf9f-2bd843f2e3e3 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:43:24.464177 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-34960381-533e-47dc-bf9f-2bd843f2e3e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97382973092f447fbe0aaa4beeb764c9'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:43:24.464761 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-34960381-533e-47dc-bf9f-2bd843f2e3e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97382973092f447fbe0aaa4beeb764c9'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:43:24.476488 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-34960381-533e-47dc-bf9f-2bd843f2e3e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97382973092f447fbe0aaa4beeb764c9'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:43:24.484458 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-34960381-533e-47dc-bf9f-2bd843f2e3e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97382973092f447fbe0aaa4beeb764c9'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:43:24.485084 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-34960381-533e-47dc-bf9f-2bd843f2e3e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97382973092f447fbe0aaa4beeb764c9'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:43:24.497701 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1466/2916] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Jun 1 04:43:24 2022] DELETE /identity/v3/users/97382973092f447fbe0aaa4beeb764c9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:43:24.669003 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd649d2-7480-4c1e-a3b3-a82e583cdee9 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:43:24.670675 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-1dd649d2-7480-4c1e-a3b3-a82e583cdee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:43:24.684158 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd649d2-7480-4c1e-a3b3-a82e583cdee9 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:43:24.734903 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:43:24.746940 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cec254-c440-465f-864e-fdf347c2c36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d7c60c25057425ca69e91e85691a580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7aa99b52f0384814a1f8896bb995a2b2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:43:24.748131 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cec254-c440-465f-864e-fdf347c2c36e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:43:24.748528 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cec254-c440-465f-864e-fdf347c2c36e admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:43:24.749037 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cec254-c440-465f-864e-fdf347c2c36e admin admin] PATH_INFO: `/v3/projects/883da8cd1e94493eb4b97a6dd80a057f` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:43:24.750582 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cec254-c440-465f-864e-fdf347c2c36e admin admin] RBAC: Authorizing `identity:delete_project(project_id=883da8cd1e94493eb4b97a6dd80a057f)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:43:24.752517 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cec254-c440-465f-864e-fdf347c2c36e admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:43:24.802485 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-77cec254-c440-465f-864e-fdf347c2c36e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '883da8cd1e94493eb4b97a6dd80a057f', 'request_id': 'req-77cec254-c440-465f-864e-fdf347c2c36e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:43:24.812098 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-77cec254-c440-465f-864e-fdf347c2c36e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '883da8cd1e94493eb4b97a6dd80a057f', 'request_id': 'req-77cec254-c440-465f-864e-fdf347c2c36e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:43:24.822954 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-77cec254-c440-465f-864e-fdf347c2c36e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '883da8cd1e94493eb4b97a6dd80a057f', 'request_id': 'req-77cec254-c440-465f-864e-fdf347c2c36e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:43:24.835171 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-77cec254-c440-465f-864e-fdf347c2c36e admin admin] The token cache is being invalidate because project 883da8cd1e94493eb4b97a6dd80a057f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 04:43:24.835461 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-77cec254-c440-465f-864e-fdf347c2c36e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:43:24.836123 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-77cec254-c440-465f-864e-fdf347c2c36e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 04:43:24.837682 dv-cinder-667108-37-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1451/2917] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Jun 1 04:43:24 2022] DELETE /identity/v3/projects/883da8cd1e94493eb4b97a6dd80a057f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 04:43:34.494318 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=37,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:43:34.831828 dv-cinder-667108-37-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=27,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 04:46:45.077896 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34960381-533e-47dc-bf9f-2bd843f2e3e3 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 04:46:45.079318 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-34960381-533e-47dc-bf9f-2bd843f2e3e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:46:45.161298 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34960381-533e-47dc-bf9f-2bd843f2e3e3 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 04:46:45.225471 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383cc451-9241-4992-b93f-ff87a0e9e39c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0433f6219478476286ea27c5c82d41a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31d68f64d21647688074554062952074', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 04:46:45.226164 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cc451-9241-4992-b93f-ff87a0e9e39c service placement] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 04:46:45.226450 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cc451-9241-4992-b93f-ff87a0e9e39c service placement] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 04:46:45.226728 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cc451-9241-4992-b93f-ff87a0e9e39c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 04:46:45.229825 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-383cc451-9241-4992-b93f-ff87a0e9e39c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 04:46:45.241867 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383cc451-9241-4992-b93f-ff87a0e9e39c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 04:46:45.243472 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383cc451-9241-4992-b93f-ff87a0e9e39c service placement] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 04:46:45.253215 dv-cinder-667108-37-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1467/2918] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Jun 1 04:46:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 04:46:55.249009 dv-cinder-667108-37-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=58 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}